Jul 29 10:01:52.254842 ip-10-0-141-60 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 10:01:52.254854 ip-10-0-141-60 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 10:01:52.254861 ip-10-0-141-60 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 10:01:52.255072 ip-10-0-141-60 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 10:02:02.323862 ip-10-0-141-60 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 10:02:02.323882 ip-10-0-141-60 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5d99923230cf4b808ff911af59a9e58d -- Jul 29 10:04:09.198848 ip-10-0-141-60 systemd[1]: Starting Kubernetes Kubelet... Jul 29 10:04:09.605424 ip-10-0-141-60 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 10:04:09.605424 ip-10-0-141-60 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 10:04:09.605424 ip-10-0-141-60 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 10:04:09.605424 ip-10-0-141-60 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 10:04:09.605424 ip-10-0-141-60 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 10:04:09.608508 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.608362 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 10:04:09.613135 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613117 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:04:09.613135 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613133 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:04:09.613135 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613137 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613141 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613144 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613146 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613149 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613152 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613154 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613157 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613160 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613163 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613165 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613168 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613170 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613175 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613180 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613182 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613185 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613188 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613190 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:04:09.613237 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613193 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613196 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613198 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613201 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613203 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613206 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613210 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613212 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613215 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613217 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613220 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613222 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613225 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613227 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613230 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613233 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613236 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613239 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613241 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613244 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:04:09.613744 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613248 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613252 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613255 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613258 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613261 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613264 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613268 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613271 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613273 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613276 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613278 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613281 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613284 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613286 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613290 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613293 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613296 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613299 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613302 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613305 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:04:09.614234 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613307 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613310 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613312 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613315 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613317 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613320 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613323 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613327 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613330 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613333 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613335 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613338 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613341 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613343 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613346 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613349 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613351 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613354 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613358 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613360 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:04:09.614750 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613363 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613366 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613368 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613370 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613373 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613376 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613378 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613381 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613384 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613386 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613389 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613392 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613395 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613397 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613400 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613402 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613405 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.613408 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614134 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614141 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:04:09.615236 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614144 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614147 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614150 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614153 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614156 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614158 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614161 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614163 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614166 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614168 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614171 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614174 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614176 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614179 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614181 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614184 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614186 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614189 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614192 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614194 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:04:09.615729 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614197 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614199 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614202 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614205 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614207 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614210 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614212 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614215 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614217 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614220 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614223 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614225 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614228 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614230 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614233 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614236 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614239 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614241 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614244 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614247 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:04:09.616220 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614250 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614253 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614257 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614260 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614263 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614266 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614269 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614272 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614274 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614277 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614279 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614282 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614284 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614287 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614289 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614292 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614294 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614297 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614299 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:04:09.616712 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614302 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614305 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614308 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614310 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614313 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614315 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614318 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614320 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614323 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614327 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614329 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614336 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614339 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614342 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614345 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614348 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614350 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614353 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614355 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:04:09.617187 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614358 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614361 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614365 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614367 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614370 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614372 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614375 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614378 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614380 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614383 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614385 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614388 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614390 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614395 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614398 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614402 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614404 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614407 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614409 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:04:09.617700 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614800 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614806 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614809 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614812 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614814 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614819 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614821 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614824 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614826 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614829 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614832 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614834 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614837 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614840 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614842 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614845 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614848 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614850 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614853 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614855 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:04:09.618202 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614858 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614860 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614863 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614866 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614868 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614870 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614874 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614877 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614879 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614882 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614884 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614887 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614890 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614892 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614895 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614898 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614900 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614904 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614907 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:04:09.618753 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614910 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614912 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614914 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614917 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614920 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614923 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614925 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614928 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614931 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614933 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614936 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614940 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614944 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614946 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614949 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614952 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614955 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614958 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614960 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614964 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:04:09.619214 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614967 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614969 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614972 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614974 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614977 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614979 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614982 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614984 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614987 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614990 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614994 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614996 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.614999 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615001 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615004 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615006 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615009 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615011 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615014 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615016 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:04:09.619842 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615019 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615021 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615024 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615028 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615031 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615033 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615036 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615039 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615043 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615046 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615049 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615053 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615056 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615058 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615061 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615063 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615067 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615070 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615073 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615076 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:04:09.620374 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615150 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615161 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615173 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615180 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615186 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615191 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615196 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615200 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615204 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615207 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615210 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615213 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615217 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615220 2577 flags.go:64] FLAG: --cgroup-root="" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615222 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615225 2577 flags.go:64] FLAG: --client-ca-file="" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615228 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615231 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615235 2577 flags.go:64] FLAG: --cluster-domain="" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615238 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615242 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615245 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615248 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615253 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 10:04:09.620880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615256 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615259 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615263 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615266 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615269 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615272 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615275 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615278 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615282 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615285 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615288 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615292 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615295 2577 flags.go:64] FLAG: --enable-server="true" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615298 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615302 2577 flags.go:64] FLAG: --event-burst="100" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615306 2577 flags.go:64] FLAG: --event-qps="50" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615309 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615312 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615314 2577 flags.go:64] FLAG: --eviction-hard="" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615318 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615321 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615324 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615327 2577 flags.go:64] FLAG: --eviction-soft="" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615330 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615332 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 10:04:09.621458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615336 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615338 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615341 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615344 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615346 2577 flags.go:64] FLAG: --feature-gates="" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615350 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615354 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615357 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615360 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615363 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615366 2577 flags.go:64] FLAG: --help="false" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615369 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-141-60.ec2.internal" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615372 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615375 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615378 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615381 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615385 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615388 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615391 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615395 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615398 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615401 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615404 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615407 2577 flags.go:64] FLAG: --kube-reserved="" Jul 29 10:04:09.622096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615410 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615413 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615416 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615419 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615421 2577 flags.go:64] FLAG: --lock-file="" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615424 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615427 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615430 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615436 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615438 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615441 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615444 2577 flags.go:64] FLAG: --logging-format="text" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615447 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615450 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615455 2577 flags.go:64] FLAG: --manifest-url="" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615458 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615463 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615465 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615469 2577 flags.go:64] FLAG: --max-pods="110" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615472 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615475 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615478 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615481 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615484 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615487 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 10:04:09.622740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615490 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615496 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615499 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615503 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615506 2577 flags.go:64] FLAG: --pod-cidr="" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615509 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615514 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615517 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615520 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615523 2577 flags.go:64] FLAG: --port="10250" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615526 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615529 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0098340af7c38c10c" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615533 2577 flags.go:64] FLAG: --qos-reserved="" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615535 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615538 2577 flags.go:64] FLAG: --register-node="true" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615542 2577 flags.go:64] FLAG: --register-with-taints="" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615545 2577 flags.go:64] FLAG: --registry-burst="10" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615548 2577 flags.go:64] FLAG: --registry-qps="5" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615551 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615554 2577 flags.go:64] FLAG: --reserved-memory="" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615557 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615560 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615565 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615567 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615570 2577 flags.go:64] FLAG: --runonce="false" Jul 29 10:04:09.623348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615573 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615589 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615593 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615596 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615598 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615602 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615605 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615608 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615611 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615613 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615616 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615620 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615623 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615626 2577 flags.go:64] FLAG: --system-cgroups="" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615628 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615634 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615637 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615639 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615643 2577 flags.go:64] FLAG: --tls-min-version="" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615646 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615649 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615653 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615656 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615659 2577 flags.go:64] FLAG: --v="2" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615663 2577 flags.go:64] FLAG: --version="false" Jul 29 10:04:09.624405 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615667 2577 flags.go:64] FLAG: --vmodule="" Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615671 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.615674 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615787 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615793 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615797 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615799 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615802 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615805 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615808 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615811 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615814 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615817 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615821 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615825 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615828 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615831 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615834 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615837 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615840 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:04:09.625198 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615842 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615845 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615848 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615851 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615853 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615856 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615858 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615861 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615865 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615867 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615869 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615872 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615875 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615877 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615880 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615883 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615886 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615889 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615892 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615895 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:04:09.625723 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615897 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615900 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615903 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615906 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615908 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615911 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615913 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615916 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615919 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615921 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615924 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615926 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615930 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615932 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615935 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615937 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615940 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615942 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615945 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:04:09.626223 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615947 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615951 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615953 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615956 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615959 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615961 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615964 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615966 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615969 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615972 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615975 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615977 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615980 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615983 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615985 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615988 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615990 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615992 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615995 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.615997 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:04:09.626711 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616000 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616002 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616005 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616008 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616010 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616013 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616017 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616021 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616025 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616028 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616031 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616034 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616036 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616041 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616043 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616046 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616049 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616051 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616054 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:04:09.627201 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616057 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616059 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616063 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.616066 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.616906 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.625438 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.625455 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.625476 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.625486 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625561 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625567 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625570 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625573 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625588 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625591 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:04:09.627682 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625594 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625597 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625600 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625604 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625609 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625612 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625614 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625617 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625620 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625623 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625625 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625628 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625630 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625633 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625636 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625639 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625641 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625644 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625646 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:04:09.628060 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625650 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625653 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625655 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625658 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625661 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625664 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625667 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625670 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625672 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625675 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625677 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625680 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625682 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625685 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625688 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625690 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625693 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625695 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625698 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625701 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:04:09.628522 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625703 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625706 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625708 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625711 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625713 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625716 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625718 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625721 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625724 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625727 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625730 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625732 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625736 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625739 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625741 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625744 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625747 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625750 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625753 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625755 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:04:09.629032 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625758 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625760 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625763 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625765 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625768 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625770 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625773 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625776 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625780 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625783 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625786 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625789 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625793 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625796 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625800 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625803 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625806 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625809 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625812 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:04:09.629504 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625815 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625818 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625820 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625823 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625826 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625828 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625831 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625833 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625837 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625840 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625843 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625846 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625848 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625851 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625854 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:04:09.630059 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.625859 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.625996 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626002 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626005 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626008 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626010 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626013 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626016 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626018 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626021 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626024 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626026 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626028 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626031 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626034 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626037 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626039 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626042 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626044 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626047 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:04:09.630472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626049 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626052 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626054 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626056 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626059 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626061 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626065 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626068 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626070 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626074 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626077 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626080 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626083 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626086 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626089 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626091 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626094 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626096 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626099 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:04:09.630993 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626101 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626104 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626107 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626109 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626112 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626114 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626117 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626120 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626123 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626125 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626128 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626130 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626133 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626135 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626138 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626142 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626145 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626148 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626150 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:04:09.631472 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626153 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626156 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626159 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626162 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626164 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626167 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626170 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626172 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626175 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626177 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626180 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626182 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626186 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626189 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626192 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626195 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626198 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626200 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626203 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:04:09.631977 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626206 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626209 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626214 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626217 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626219 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626222 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626224 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626227 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626229 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626232 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626235 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626237 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626240 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626243 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626245 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626248 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626251 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626253 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626256 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626258 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626261 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:04:09.632431 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626264 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:04:11.194606 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:09.626266 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:04:11.194606 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.626271 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 10:04:11.194606 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.626405 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 10:04:11.194606 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.630189 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 10:04:11.194606 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.631562 2577 server.go:1019] "Starting client certificate rotation" Jul 29 10:04:11.194606 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.631664 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 10:04:11.194606 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:09.631706 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 10:04:11.195786 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.195772 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 10:04:11.196934 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.196915 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 10:04:11.208360 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.208345 2577 log.go:25] "Validated CRI v1 runtime API" Jul 29 10:04:11.210597 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.210583 2577 log.go:25] "Validated CRI v1 image API" Jul 29 10:04:11.213561 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.213545 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 10:04:11.217170 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.217146 2577 fs.go:135] Filesystem UUIDs: map[6b273a57-a6c2-48e5-b233-2fe4f8082b68:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c54b3c2b-bfdc-46c0-8526-57b1e5b9ba3d:/dev/nvme0n1p3] Jul 29 10:04:11.217241 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.217169 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 10:04:11.221678 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.221574 2577 manager.go:216] Machine: {Timestamp:2026-07-29 10:04:11.221102878 +0000 UTC m=+0.341896261 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101842 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25d89dda99381408a2fdffd0fcd196 SystemUUID:ec25d89d-da99-3814-08a2-fdffd0fcd196 BootID:5d999232-30cf-4b80-8ff9-11af59a9e58d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:84:05:76:25:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:84:05:76:25:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:b2:39:76:94:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 10:04:11.221678 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.221671 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 10:04:11.221792 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.221743 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 10:04:11.224375 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.224346 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 10:04:11.224509 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.224378 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-60.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 10:04:11.225967 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.225957 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 10:04:11.226012 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.225970 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 10:04:11.226012 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.225978 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 10:04:11.226741 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.226730 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 10:04:11.227948 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.227938 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 10:04:11.230085 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.230072 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 29 10:04:11.230603 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.230592 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 10:04:11.230638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.230626 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 29 10:04:11.230638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.230635 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 10:04:11.230692 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.230650 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 10:04:11.230692 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.230660 2577 kubelet.go:398] "Adding apiserver pod source" Jul 29 10:04:11.230692 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.230670 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 10:04:11.232037 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.232013 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 10:04:11.232121 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.232052 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 10:04:11.233480 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.233445 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 10:04:11.234834 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.234815 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 10:04:11.237032 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.237013 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 10:04:11.237101 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.237056 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 10:04:11.239906 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.239890 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 10:04:11.239967 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.239915 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 10:04:11.239967 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.239926 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 10:04:11.239967 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.239935 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 10:04:11.239967 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.239947 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 10:04:11.239967 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.239955 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 10:04:11.239967 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.239965 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 10:04:11.240183 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.239973 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 10:04:11.240183 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.239998 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 10:04:11.240183 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.240007 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 10:04:11.240183 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.240019 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 10:04:11.240183 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.240027 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 10:04:11.241533 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.241504 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-60.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 10:04:11.241585 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.241572 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 10:04:11.241616 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.241585 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 10:04:11.241616 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.241597 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 10:04:11.244880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.244865 2577 server.go:1268] "Started kubelet" Jul 29 10:04:11.244961 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.244940 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 10:04:11.245048 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.244955 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 10:04:11.245048 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.245042 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 10:04:11.245195 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.245176 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-60.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 10:04:11.245710 ip-10-0-141-60 systemd[1]: Started Kubernetes Kubelet. Jul 29 10:04:11.247303 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.247288 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 29 10:04:11.247874 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.247858 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 10:04:11.253837 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.253817 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 10:04:11.255325 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.255305 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gmhb2" Jul 29 10:04:11.256651 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.255320 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-60.ec2.internal.18c6ba94f60b34e5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-60.ec2.internal,UID:ip-10-0-141-60.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-60.ec2.internal,},FirstTimestamp:2026-07-29 10:04:11.244836069 +0000 UTC m=+0.365629452,LastTimestamp:2026-07-29 10:04:11.244836069 +0000 UTC m=+0.365629452,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-60.ec2.internal,}" Jul 29 10:04:11.257805 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.257790 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 10:04:11.257805 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.257798 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 10:04:11.258228 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.257926 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-60.ec2.internal\" not found" Jul 29 10:04:11.258573 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.258556 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 10:04:11.258573 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.258566 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 10:04:11.258698 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.258582 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 10:04:11.258698 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.258667 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 29 10:04:11.258698 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.258676 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 29 10:04:11.258815 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.258739 2577 factory.go:55] Registering systemd factory Jul 29 10:04:11.258815 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.258753 2577 factory.go:223] Registration of the systemd container factory successfully Jul 29 10:04:11.258997 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.258964 2577 factory.go:153] Registering CRI-O factory Jul 29 10:04:11.258997 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.258999 2577 factory.go:223] Registration of the crio container factory successfully Jul 29 10:04:11.259148 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.259046 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 10:04:11.259148 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.259066 2577 factory.go:103] Registering Raw factory Jul 29 10:04:11.259148 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.259081 2577 manager.go:1196] Started watching for new ooms in manager Jul 29 10:04:11.259711 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.259698 2577 manager.go:349] Starting recovery of all containers Jul 29 10:04:11.262654 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.262635 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gmhb2" Jul 29 10:04:11.270294 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.270268 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-60.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 10:04:11.270380 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.270324 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 10:04:11.271659 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.271644 2577 manager.go:354] Recovery completed Jul 29 10:04:11.276091 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.275967 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:04:11.278974 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.278957 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:04:11.279070 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.279004 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:04:11.279070 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.279019 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:04:11.279620 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.279607 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 10:04:11.279620 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.279618 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 10:04:11.279713 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.279633 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 29 10:04:11.279713 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.279608 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:04:11.281575 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.281561 2577 policy_none.go:49] "None policy: Start" Jul 29 10:04:11.281575 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.281576 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 10:04:11.281664 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.281587 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 10:04:11.282512 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.282496 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:04:11.282565 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.282522 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:04:11.282565 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.282531 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:04:11.282957 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.282944 2577 policy_none.go:47] "Start" Jul 29 10:04:11.322534 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.322516 2577 manager.go:337] "Starting Device Plugin manager" Jul 29 10:04:11.322626 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.322558 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 10:04:11.322626 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.322572 2577 server.go:87] "Starting device plugin registration server" Jul 29 10:04:11.322836 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.322824 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 10:04:11.322874 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.322838 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 10:04:11.322956 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.322940 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 10:04:11.323056 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.323045 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 10:04:11.323056 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.323056 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 10:04:11.324183 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.324166 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 10:04:11.324294 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.324206 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-60.ec2.internal\" not found" Jul 29 10:04:11.423284 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.423203 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:04:11.439772 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.424747 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:04:11.439772 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.424778 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:04:11.439772 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.424790 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:04:11.439772 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.424816 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.439772 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.433468 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.439772 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.433490 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-60.ec2.internal\": node \"ip-10-0-141-60.ec2.internal\" not found" Jul 29 10:04:11.447860 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.447840 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-60.ec2.internal\" not found" Jul 29 10:04:11.489978 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.489952 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 10:04:11.491083 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.491060 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 10:04:11.491179 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.491096 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 10:04:11.491179 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.491115 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 10:04:11.491179 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.491146 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 10:04:11.493429 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.493411 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:04:11.548708 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.548670 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-60.ec2.internal\" not found" Jul 29 10:04:11.592132 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.592102 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-60.ec2.internal"] Jul 29 10:04:11.592245 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.592192 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:04:11.593311 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.593292 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:04:11.593403 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.593332 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:04:11.593403 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.593346 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:04:11.595258 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.595245 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:04:11.595366 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.595353 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.595419 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.595382 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:04:11.596425 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.596408 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:04:11.596495 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.596434 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:04:11.596495 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.596443 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:04:11.596495 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.596415 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:04:11.596586 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.596514 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:04:11.596586 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.596529 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:04:11.597934 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.597920 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.597996 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.597946 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:04:11.599134 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.599120 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:04:11.599207 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.599142 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:04:11.599207 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.599155 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:04:11.622543 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.622524 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-60.ec2.internal\" not found" node="ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.626926 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.626904 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-60.ec2.internal\" not found" node="ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.649536 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.649515 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-60.ec2.internal\" not found" Jul 29 10:04:11.660607 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.660586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d621d3160f8888ed0c403b78ec3a0c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal\" (UID: \"3d621d3160f8888ed0c403b78ec3a0c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.660682 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.660609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52a974b3871525f86872b1ca0a85018c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-60.ec2.internal\" (UID: \"52a974b3871525f86872b1ca0a85018c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.660682 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.660626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d621d3160f8888ed0c403b78ec3a0c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal\" (UID: \"3d621d3160f8888ed0c403b78ec3a0c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.750654 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.750558 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-60.ec2.internal\" not found" Jul 29 10:04:11.760929 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.760904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d621d3160f8888ed0c403b78ec3a0c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal\" (UID: \"3d621d3160f8888ed0c403b78ec3a0c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.761035 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.760935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d621d3160f8888ed0c403b78ec3a0c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal\" (UID: \"3d621d3160f8888ed0c403b78ec3a0c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.761035 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.760954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52a974b3871525f86872b1ca0a85018c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-60.ec2.internal\" (UID: \"52a974b3871525f86872b1ca0a85018c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.761035 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.761001 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52a974b3871525f86872b1ca0a85018c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-60.ec2.internal\" (UID: \"52a974b3871525f86872b1ca0a85018c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.761154 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.761027 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d621d3160f8888ed0c403b78ec3a0c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal\" (UID: \"3d621d3160f8888ed0c403b78ec3a0c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.761154 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.761035 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d621d3160f8888ed0c403b78ec3a0c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal\" (UID: \"3d621d3160f8888ed0c403b78ec3a0c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.851107 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.851058 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-60.ec2.internal\" not found" Jul 29 10:04:11.926657 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.926617 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.932330 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:11.932019 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-60.ec2.internal" Jul 29 10:04:11.951475 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:11.951444 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-60.ec2.internal\" not found" Jul 29 10:04:12.052040 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:12.051941 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-60.ec2.internal\" not found" Jul 29 10:04:12.116775 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.115626 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:04:12.152104 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:12.152073 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-60.ec2.internal\" not found" Jul 29 10:04:12.192920 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.192885 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 10:04:12.193379 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.193069 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 10:04:12.193379 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.193075 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 10:04:12.240883 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.240856 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:04:12.258591 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.258567 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal" Jul 29 10:04:12.258591 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.258592 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 10:04:12.273868 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.273841 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 09:59:11 +0000 UTC" deadline="2028-02-25 21:12:20.615092511 +0000 UTC" Jul 29 10:04:12.273868 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.273865 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13835h8m8.341229926s" Jul 29 10:04:12.275673 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.275660 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 10:04:12.276759 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.276744 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 10:04:12.277707 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.277695 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-60.ec2.internal" Jul 29 10:04:12.290240 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.290225 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 10:04:12.309060 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.309007 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tsf5" Jul 29 10:04:12.317305 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.317287 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tsf5" Jul 29 10:04:12.456853 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:12.456818 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d621d3160f8888ed0c403b78ec3a0c9.slice/crio-76326a3418e3f9cbf38b741ebb667d59c318526146ad388c6cace2c8def20bbc WatchSource:0}: Error finding container 76326a3418e3f9cbf38b741ebb667d59c318526146ad388c6cace2c8def20bbc: Status 404 returned error can't find the container with id 76326a3418e3f9cbf38b741ebb667d59c318526146ad388c6cace2c8def20bbc Jul 29 10:04:12.457608 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:12.457588 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a974b3871525f86872b1ca0a85018c.slice/crio-6a2bbd4e9fabbff85fb548c5657cc5cb0d924e66f18a976a296b734e3c35452a WatchSource:0}: Error finding container 6a2bbd4e9fabbff85fb548c5657cc5cb0d924e66f18a976a296b734e3c35452a: Status 404 returned error can't find the container with id 6a2bbd4e9fabbff85fb548c5657cc5cb0d924e66f18a976a296b734e3c35452a Jul 29 10:04:12.464305 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.464289 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 10:04:12.494130 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.494079 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal" event={"ID":"3d621d3160f8888ed0c403b78ec3a0c9","Type":"ContainerStarted","Data":"76326a3418e3f9cbf38b741ebb667d59c318526146ad388c6cace2c8def20bbc"} Jul 29 10:04:12.495054 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.495031 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-60.ec2.internal" event={"ID":"52a974b3871525f86872b1ca0a85018c","Type":"ContainerStarted","Data":"6a2bbd4e9fabbff85fb548c5657cc5cb0d924e66f18a976a296b734e3c35452a"} Jul 29 10:04:12.559545 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:12.559482 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:04:13.230947 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.230900 2577 apiserver.go:52] "Watching apiserver" Jul 29 10:04:13.241810 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.241786 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 10:04:13.242218 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.242192 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-8n87s","openshift-multus/multus-t9h8f","openshift-multus/network-metrics-daemon-bgz7n","openshift-network-diagnostics/network-check-target-vff5m","openshift-network-operator/iptables-alerter-grz4x","kube-system/global-pull-secret-syncer-jp7ll","kube-system/kube-apiserver-proxy-ip-10-0-141-60.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892","openshift-image-registry/node-ca-kj6nw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-bvfh6","kube-system/konnectivity-agent-2lmjk","openshift-cluster-node-tuning-operator/tuned-sp6sg","openshift-dns/node-resolver-v2zfl"] Jul 29 10:04:13.243697 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.243679 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.245354 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.245077 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.246254 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.246232 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:13.246360 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.246312 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:13.246958 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.246724 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 10:04:13.246958 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.246781 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4hr4q\"" Jul 29 10:04:13.246958 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.246810 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 10:04:13.247496 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.247479 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 10:04:13.247777 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.247759 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:13.247858 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.247825 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:13.248562 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.248537 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 10:04:13.248844 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.248825 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 10:04:13.249658 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.249093 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2g8kp\"" Jul 29 10:04:13.249658 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.249355 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 10:04:13.250086 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.250017 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-grz4x" Jul 29 10:04:13.250775 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.250671 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:13.250775 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.250738 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:13.253393 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.252346 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.254742 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.254678 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qjhjw\"" Jul 29 10:04:13.255015 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.254971 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 10:04:13.255244 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.255214 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 10:04:13.255336 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.255313 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 10:04:13.256575 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.255577 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.256575 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.256114 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kj6nw" Jul 29 10:04:13.256575 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.256180 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 10:04:13.256575 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.256435 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dbgzz\"" Jul 29 10:04:13.257268 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.257246 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 10:04:13.257565 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.257540 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v2zfl" Jul 29 10:04:13.259592 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.259253 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.259592 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.259368 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 10:04:13.259818 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.259798 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 10:04:13.259971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.259952 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8589q\"" Jul 29 10:04:13.260564 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.260545 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 10:04:13.260878 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.260858 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 10:04:13.260966 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.260938 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 10:04:13.261114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.261096 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 10:04:13.261195 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.261111 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2lmjk" Jul 29 10:04:13.261381 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.261363 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 10:04:13.261902 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.261880 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z2vz8\"" Jul 29 10:04:13.262869 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.262152 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p8q9w\"" Jul 29 10:04:13.262869 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.262465 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 10:04:13.262869 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.262614 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 10:04:13.262869 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.262670 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 10:04:13.262869 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.262714 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 10:04:13.262869 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.262813 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sfgfs\"" Jul 29 10:04:13.262869 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.262853 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 10:04:13.264371 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.264353 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 10:04:13.264371 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.264359 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 10:04:13.268048 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65c2029e-43db-42df-824c-8b26ae85cae5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.268152 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpv82\" (UniqueName: \"kubernetes.io/projected/abc91ee3-5c70-4596-b6ca-bb8778025009-kube-api-access-cpv82\") pod \"network-metrics-daemon-bgz7n\" (UID: \"abc91ee3-5c70-4596-b6ca-bb8778025009\") " pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:13.268152 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268076 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-dbus\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:13.268152 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268092 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-kubelet\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.268152 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268108 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-tuned\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.268152 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-device-dir\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.268152 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268147 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-etc-selinux\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/696ccdd1-b3a5-41f5-938e-122bbfae3658-ovnkube-script-lib\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-sysctl-d\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14336764-23e1-43c3-b669-115ef1fc5d04-host-slash\") pod \"iptables-alerter-grz4x\" (UID: \"14336764-23e1-43c3-b669-115ef1fc5d04\") " pod="openshift-network-operator/iptables-alerter-grz4x" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl2lj\" (UniqueName: \"kubernetes.io/projected/65c2029e-43db-42df-824c-8b26ae85cae5-kube-api-access-pl2lj\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64624666-4239-467e-b6d5-cd37f39a91a0-hosts-file\") pod \"node-resolver-v2zfl\" (UID: \"64624666-4239-467e-b6d5-cd37f39a91a0\") " pod="openshift-dns/node-resolver-v2zfl" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64624666-4239-467e-b6d5-cd37f39a91a0-tmp-dir\") pod \"node-resolver-v2zfl\" (UID: \"64624666-4239-467e-b6d5-cd37f39a91a0\") " pod="openshift-dns/node-resolver-v2zfl" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-etc-kubernetes\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/696ccdd1-b3a5-41f5-938e-122bbfae3658-env-overrides\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-sysconfig\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-kubernetes\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65c2029e-43db-42df-824c-8b26ae85cae5-cni-binary-copy\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268356 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-multus-socket-dir-parent\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-slash\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-etc-openvswitch\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268402 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-node-log\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.268438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-log-socket\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frm4k\" (UniqueName: \"kubernetes.io/projected/696ccdd1-b3a5-41f5-938e-122bbfae3658-kube-api-access-frm4k\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-cnibin\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-run-k8s-cni-cncf-io\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-run-multus-certs\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-lib-modules\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268574 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-var-lib-kubelet\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268594 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65c2029e-43db-42df-824c-8b26ae85cae5-os-release\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268619 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a572133-c816-43af-a04c-8d8bfe731bf9-cni-binary-copy\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268641 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8449b7fc-e9d6-4e28-ab0c-098653a0038c-serviceca\") pod \"node-ca-kj6nw\" (UID: \"8449b7fc-e9d6-4e28-ab0c-098653a0038c\") " pod="openshift-image-registry/node-ca-kj6nw" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268685 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-modprobe-d\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-sys\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268749 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-run-ovn-kubernetes\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-os-release\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/696ccdd1-b3a5-41f5-938e-122bbfae3658-ovnkube-config\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.269217 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-var-lib-openvswitch\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6wf8\" (UniqueName: \"kubernetes.io/projected/14336764-23e1-43c3-b669-115ef1fc5d04-kube-api-access-t6wf8\") pod \"iptables-alerter-grz4x\" (UID: \"14336764-23e1-43c3-b669-115ef1fc5d04\") " pod="openshift-network-operator/iptables-alerter-grz4x" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-sys-fs\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-system-cni-dir\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-var-lib-cni-bin\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268905 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjwh8\" (UniqueName: \"kubernetes.io/projected/8a572133-c816-43af-a04c-8d8bfe731bf9-kube-api-access-pjwh8\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268920 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-systemd-units\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-run\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268948 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-multus-cni-dir\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.268968 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65c2029e-43db-42df-824c-8b26ae85cae5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-cni-bin\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269026 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-cni-netd\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/696ccdd1-b3a5-41f5-938e-122bbfae3658-ovn-node-metrics-cert\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p87h2\" (UniqueName: \"kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2\") pod \"network-check-target-vff5m\" (UID: \"89ff5119-9ac3-4530-999d-96605fafbd39\") " pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269071 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8449b7fc-e9d6-4e28-ab0c-098653a0038c-host\") pod \"node-ca-kj6nw\" (UID: \"8449b7fc-e9d6-4e28-ab0c-098653a0038c\") " pod="openshift-image-registry/node-ca-kj6nw" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-run-netns\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.269971 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269103 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-socket-dir\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-hostroot\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-run-ovn\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-566zt\" (UniqueName: \"kubernetes.io/projected/4b0de08b-fe5a-4336-9297-5bcc90b4a169-kube-api-access-566zt\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269176 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65c2029e-43db-42df-824c-8b26ae85cae5-cnibin\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97km6\" (UniqueName: \"kubernetes.io/projected/887cc015-c57f-43c8-875e-ae4917095a09-kube-api-access-97km6\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269207 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-run-netns\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269223 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-kubelet-config\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-run-openvswitch\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269257 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-host\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269350 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269402 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcbbd\" (UniqueName: \"kubernetes.io/projected/64624666-4239-467e-b6d5-cd37f39a91a0-kube-api-access-qcbbd\") pod \"node-resolver-v2zfl\" (UID: \"64624666-4239-467e-b6d5-cd37f39a91a0\") " pod="openshift-dns/node-resolver-v2zfl" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269420 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65c2029e-43db-42df-824c-8b26ae85cae5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a572133-c816-43af-a04c-8d8bfe731bf9-multus-daemon-config\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269533 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs\") pod \"network-metrics-daemon-bgz7n\" (UID: \"abc91ee3-5c70-4596-b6ca-bb8778025009\") " pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:13.270813 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-run-systemd\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.271638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b0de08b-fe5a-4336-9297-5bcc90b4a169-tmp\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.271638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14336764-23e1-43c3-b669-115ef1fc5d04-iptables-alerter-script\") pod \"iptables-alerter-grz4x\" (UID: \"14336764-23e1-43c3-b669-115ef1fc5d04\") " pod="openshift-network-operator/iptables-alerter-grz4x" Jul 29 10:04:13.271638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269686 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 10:04:13.271638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-registration-dir\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.271638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-var-lib-kubelet\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.271638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-multus-conf-dir\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.271638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzkcv\" (UniqueName: \"kubernetes.io/projected/8449b7fc-e9d6-4e28-ab0c-098653a0038c-kube-api-access-fzkcv\") pod \"node-ca-kj6nw\" (UID: \"8449b7fc-e9d6-4e28-ab0c-098653a0038c\") " pod="openshift-image-registry/node-ca-kj6nw" Jul 29 10:04:13.271638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-sysctl-conf\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.271638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-systemd\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.271638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65c2029e-43db-42df-824c-8b26ae85cae5-system-cni-dir\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.271638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-var-lib-cni-multus\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.271638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.269846 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jqvg4\"" Jul 29 10:04:13.319326 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.319295 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 09:59:12 +0000 UTC" deadline="2028-03-12 12:25:44.020675216 +0000 UTC" Jul 29 10:04:13.319423 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.319327 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14210h21m30.701353358s" Jul 29 10:04:13.359627 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.359599 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 10:04:13.370941 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.370916 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65c2029e-43db-42df-824c-8b26ae85cae5-cnibin\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.371102 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.370951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97km6\" (UniqueName: \"kubernetes.io/projected/887cc015-c57f-43c8-875e-ae4917095a09-kube-api-access-97km6\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.371102 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.370975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-run-netns\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.371102 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-kubelet-config\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:13.371102 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-run-openvswitch\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.371102 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371039 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65c2029e-43db-42df-824c-8b26ae85cae5-cnibin\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.371102 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371050 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-host\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.371102 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371101 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-run-netns\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.371469 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371111 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-host\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.371469 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b4c766cb-3afa-4166-b24f-958b9c0b3bb1-agent-certs\") pod \"konnectivity-agent-2lmjk\" (UID: \"b4c766cb-3afa-4166-b24f-958b9c0b3bb1\") " pod="kube-system/konnectivity-agent-2lmjk" Jul 29 10:04:13.371469 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371157 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcbbd\" (UniqueName: \"kubernetes.io/projected/64624666-4239-467e-b6d5-cd37f39a91a0-kube-api-access-qcbbd\") pod \"node-resolver-v2zfl\" (UID: \"64624666-4239-467e-b6d5-cd37f39a91a0\") " pod="openshift-dns/node-resolver-v2zfl" Jul 29 10:04:13.371469 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371187 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65c2029e-43db-42df-824c-8b26ae85cae5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.371469 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371198 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-kubelet-config\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:13.371469 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371156 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-run-openvswitch\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.371469 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a572133-c816-43af-a04c-8d8bfe731bf9-multus-daemon-config\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.371469 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371415 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65c2029e-43db-42df-824c-8b26ae85cae5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.371865 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.371612 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:04:13.371865 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.371691 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs podName:abc91ee3-5c70-4596-b6ca-bb8778025009 nodeName:}" failed. No retries permitted until 2026-07-29 10:04:13.871655159 +0000 UTC m=+2.992448543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs") pod "network-metrics-daemon-bgz7n" (UID: "abc91ee3-5c70-4596-b6ca-bb8778025009") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:04:13.371865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs\") pod \"network-metrics-daemon-bgz7n\" (UID: \"abc91ee3-5c70-4596-b6ca-bb8778025009\") " pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:13.371865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:13.371865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-run-systemd\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.371865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b0de08b-fe5a-4336-9297-5bcc90b4a169-tmp\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.371865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14336764-23e1-43c3-b669-115ef1fc5d04-iptables-alerter-script\") pod \"iptables-alerter-grz4x\" (UID: \"14336764-23e1-43c3-b669-115ef1fc5d04\") " pod="openshift-network-operator/iptables-alerter-grz4x" Jul 29 10:04:13.371865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-registration-dir\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.371865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371823 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-run-systemd\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.371865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-var-lib-kubelet\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.371865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371856 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a572133-c816-43af-a04c-8d8bfe731bf9-multus-daemon-config\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.371914 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.371926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-multus-conf-dir\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.371962 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret podName:c70c9c83-ba38-4fcb-ad4e-1532b36229ed nodeName:}" failed. No retries permitted until 2026-07-29 10:04:13.871946204 +0000 UTC m=+2.992739575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret") pod "global-pull-secret-syncer-jp7ll" (UID: "c70c9c83-ba38-4fcb-ad4e-1532b36229ed") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzkcv\" (UniqueName: \"kubernetes.io/projected/8449b7fc-e9d6-4e28-ab0c-098653a0038c-kube-api-access-fzkcv\") pod \"node-ca-kj6nw\" (UID: \"8449b7fc-e9d6-4e28-ab0c-098653a0038c\") " pod="openshift-image-registry/node-ca-kj6nw" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-sysctl-conf\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372035 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-var-lib-kubelet\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-systemd\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372000 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-multus-conf-dir\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65c2029e-43db-42df-824c-8b26ae85cae5-system-cni-dir\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-var-lib-cni-multus\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372134 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65c2029e-43db-42df-824c-8b26ae85cae5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372158 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpv82\" (UniqueName: \"kubernetes.io/projected/abc91ee3-5c70-4596-b6ca-bb8778025009-kube-api-access-cpv82\") pod \"network-metrics-daemon-bgz7n\" (UID: \"abc91ee3-5c70-4596-b6ca-bb8778025009\") " pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372147 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372189 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-sysctl-conf\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372211 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-registration-dir\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372231 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-var-lib-cni-multus\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.372431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-dbus\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:13.373114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-kubelet\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.373114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-tuned\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.373114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-device-dir\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.373114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-etc-selinux\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.373114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372382 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/696ccdd1-b3a5-41f5-938e-122bbfae3658-ovnkube-script-lib\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.373114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372405 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-sysctl-d\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.373114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372430 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14336764-23e1-43c3-b669-115ef1fc5d04-host-slash\") pod \"iptables-alerter-grz4x\" (UID: \"14336764-23e1-43c3-b669-115ef1fc5d04\") " pod="openshift-network-operator/iptables-alerter-grz4x" Jul 29 10:04:13.373114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl2lj\" (UniqueName: \"kubernetes.io/projected/65c2029e-43db-42df-824c-8b26ae85cae5-kube-api-access-pl2lj\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.373114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372336 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-dbus\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:13.373114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372949 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64624666-4239-467e-b6d5-cd37f39a91a0-hosts-file\") pod \"node-resolver-v2zfl\" (UID: \"64624666-4239-467e-b6d5-cd37f39a91a0\") " pod="openshift-dns/node-resolver-v2zfl" Jul 29 10:04:13.373114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373016 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-device-dir\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.373114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373084 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14336764-23e1-43c3-b669-115ef1fc5d04-host-slash\") pod \"iptables-alerter-grz4x\" (UID: \"14336764-23e1-43c3-b669-115ef1fc5d04\") " pod="openshift-network-operator/iptables-alerter-grz4x" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373189 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-sysctl-d\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64624666-4239-467e-b6d5-cd37f39a91a0-tmp-dir\") pod \"node-resolver-v2zfl\" (UID: \"64624666-4239-467e-b6d5-cd37f39a91a0\") " pod="openshift-dns/node-resolver-v2zfl" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-etc-kubernetes\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373282 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65c2029e-43db-42df-824c-8b26ae85cae5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373301 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/696ccdd1-b3a5-41f5-938e-122bbfae3658-env-overrides\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.372472 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14336764-23e1-43c3-b669-115ef1fc5d04-iptables-alerter-script\") pod \"iptables-alerter-grz4x\" (UID: \"14336764-23e1-43c3-b669-115ef1fc5d04\") " pod="openshift-network-operator/iptables-alerter-grz4x" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-sysconfig\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-kubernetes\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373413 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-etc-selinux\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65c2029e-43db-42df-824c-8b26ae85cae5-cni-binary-copy\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373470 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-etc-kubernetes\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373482 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-multus-socket-dir-parent\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373529 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-kubernetes\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373550 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-multus-socket-dir-parent\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-slash\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373605 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-sysconfig\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.373680 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-etc-openvswitch\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373693 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-etc-openvswitch\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373730 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64624666-4239-467e-b6d5-cd37f39a91a0-hosts-file\") pod \"node-resolver-v2zfl\" (UID: \"64624666-4239-467e-b6d5-cd37f39a91a0\") " pod="openshift-dns/node-resolver-v2zfl" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373853 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/696ccdd1-b3a5-41f5-938e-122bbfae3658-env-overrides\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.373937 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65c2029e-43db-42df-824c-8b26ae85cae5-system-cni-dir\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374000 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64624666-4239-467e-b6d5-cd37f39a91a0-tmp-dir\") pod \"node-resolver-v2zfl\" (UID: \"64624666-4239-467e-b6d5-cd37f39a91a0\") " pod="openshift-dns/node-resolver-v2zfl" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374013 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-systemd\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-node-log\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374087 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-kubelet\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374091 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-log-socket\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374134 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-node-log\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374142 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-log-socket\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374145 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65c2029e-43db-42df-824c-8b26ae85cae5-cni-binary-copy\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frm4k\" (UniqueName: \"kubernetes.io/projected/696ccdd1-b3a5-41f5-938e-122bbfae3658-kube-api-access-frm4k\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374205 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b4c766cb-3afa-4166-b24f-958b9c0b3bb1-konnectivity-ca\") pod \"konnectivity-agent-2lmjk\" (UID: \"b4c766cb-3afa-4166-b24f-958b9c0b3bb1\") " pod="kube-system/konnectivity-agent-2lmjk" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374217 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-slash\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374232 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-cnibin\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-run-k8s-cni-cncf-io\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.374531 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374264 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/696ccdd1-b3a5-41f5-938e-122bbfae3658-ovnkube-script-lib\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-run-multus-certs\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374328 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-cnibin\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374351 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-lib-modules\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374375 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-run-k8s-cni-cncf-io\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374382 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-var-lib-kubelet\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65c2029e-43db-42df-824c-8b26ae85cae5-os-release\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374435 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a572133-c816-43af-a04c-8d8bfe731bf9-cni-binary-copy\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8449b7fc-e9d6-4e28-ab0c-098653a0038c-serviceca\") pod \"node-ca-kj6nw\" (UID: \"8449b7fc-e9d6-4e28-ab0c-098653a0038c\") " pod="openshift-image-registry/node-ca-kj6nw" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374468 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-lib-modules\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374481 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-modprobe-d\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-sys\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374563 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-var-lib-kubelet\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374705 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65c2029e-43db-42df-824c-8b26ae85cae5-os-release\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374806 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-modprobe-d\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374858 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.377210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-run-ovn-kubernetes\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-os-release\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/696ccdd1-b3a5-41f5-938e-122bbfae3658-ovnkube-config\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.374974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-var-lib-openvswitch\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375028 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6wf8\" (UniqueName: \"kubernetes.io/projected/14336764-23e1-43c3-b669-115ef1fc5d04-kube-api-access-t6wf8\") pod \"iptables-alerter-grz4x\" (UID: \"14336764-23e1-43c3-b669-115ef1fc5d04\") " pod="openshift-network-operator/iptables-alerter-grz4x" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375032 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8449b7fc-e9d6-4e28-ab0c-098653a0038c-serviceca\") pod \"node-ca-kj6nw\" (UID: \"8449b7fc-e9d6-4e28-ab0c-098653a0038c\") " pod="openshift-image-registry/node-ca-kj6nw" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375036 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a572133-c816-43af-a04c-8d8bfe731bf9-cni-binary-copy\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-sys-fs\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375071 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-run-ovn-kubernetes\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-system-cni-dir\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375099 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-var-lib-openvswitch\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375125 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-sys\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-var-lib-cni-bin\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375159 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjwh8\" (UniqueName: \"kubernetes.io/projected/8a572133-c816-43af-a04c-8d8bfe731bf9-kube-api-access-pjwh8\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375162 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-os-release\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375188 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-systemd-units\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375242 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-systemd-units\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375306 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-system-cni-dir\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.377968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375356 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-var-lib-cni-bin\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375424 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-sys-fs\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-run\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-multus-cni-dir\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375532 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65c2029e-43db-42df-824c-8b26ae85cae5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-cni-bin\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375598 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-cni-netd\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375603 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/696ccdd1-b3a5-41f5-938e-122bbfae3658-ovnkube-config\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375617 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-multus-cni-dir\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375625 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/696ccdd1-b3a5-41f5-938e-122bbfae3658-ovn-node-metrics-cert\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p87h2\" (UniqueName: \"kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2\") pod \"network-check-target-vff5m\" (UID: \"89ff5119-9ac3-4530-999d-96605fafbd39\") " pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375668 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-cni-bin\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375681 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-cni-netd\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8449b7fc-e9d6-4e28-ab0c-098653a0038c-host\") pod \"node-ca-kj6nw\" (UID: \"8449b7fc-e9d6-4e28-ab0c-098653a0038c\") " pod="openshift-image-registry/node-ca-kj6nw" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-run-netns\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375777 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-host-run-netns\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.379213 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375780 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-socket-dir\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.379849 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-hostroot\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.379849 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375833 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b0de08b-fe5a-4336-9297-5bcc90b4a169-run\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.379849 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-run-ovn\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.379849 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375878 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8449b7fc-e9d6-4e28-ab0c-098653a0038c-host\") pod \"node-ca-kj6nw\" (UID: \"8449b7fc-e9d6-4e28-ab0c-098653a0038c\") " pod="openshift-image-registry/node-ca-kj6nw" Jul 29 10:04:13.379849 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375879 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566zt\" (UniqueName: \"kubernetes.io/projected/4b0de08b-fe5a-4336-9297-5bcc90b4a169-kube-api-access-566zt\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.379849 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.375942 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.379849 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.376009 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-host-run-multus-certs\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.379849 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.376021 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/696ccdd1-b3a5-41f5-938e-122bbfae3658-run-ovn\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.379849 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.376187 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b0de08b-fe5a-4336-9297-5bcc90b4a169-tmp\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.379849 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.376241 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a572133-c816-43af-a04c-8d8bfe731bf9-hostroot\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.379849 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.376262 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65c2029e-43db-42df-824c-8b26ae85cae5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.379849 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.376326 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/887cc015-c57f-43c8-875e-ae4917095a09-socket-dir\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.379849 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.376745 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b0de08b-fe5a-4336-9297-5bcc90b4a169-etc-tuned\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.380443 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.380136 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/696ccdd1-b3a5-41f5-938e-122bbfae3658-ovn-node-metrics-cert\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.393781 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.393757 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:04:13.393883 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.393797 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:04:13.393883 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.393811 2577 projected.go:196] Error preparing data for projected volume kube-api-access-p87h2 for pod openshift-network-diagnostics/network-check-target-vff5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:04:13.393883 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.393869 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2 podName:89ff5119-9ac3-4530-999d-96605fafbd39 nodeName:}" failed. No retries permitted until 2026-07-29 10:04:13.893850411 +0000 UTC m=+3.014643798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p87h2" (UniqueName: "kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2") pod "network-check-target-vff5m" (UID: "89ff5119-9ac3-4530-999d-96605fafbd39") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:04:13.394607 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.394526 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frm4k\" (UniqueName: \"kubernetes.io/projected/696ccdd1-b3a5-41f5-938e-122bbfae3658-kube-api-access-frm4k\") pod \"ovnkube-node-bvfh6\" (UID: \"696ccdd1-b3a5-41f5-938e-122bbfae3658\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.394801 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.394767 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjwh8\" (UniqueName: \"kubernetes.io/projected/8a572133-c816-43af-a04c-8d8bfe731bf9-kube-api-access-pjwh8\") pod \"multus-t9h8f\" (UID: \"8a572133-c816-43af-a04c-8d8bfe731bf9\") " pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.395005 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.394931 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl2lj\" (UniqueName: \"kubernetes.io/projected/65c2029e-43db-42df-824c-8b26ae85cae5-kube-api-access-pl2lj\") pod \"multus-additional-cni-plugins-8n87s\" (UID: \"65c2029e-43db-42df-824c-8b26ae85cae5\") " pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.395095 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.395023 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6wf8\" (UniqueName: \"kubernetes.io/projected/14336764-23e1-43c3-b669-115ef1fc5d04-kube-api-access-t6wf8\") pod \"iptables-alerter-grz4x\" (UID: \"14336764-23e1-43c3-b669-115ef1fc5d04\") " pod="openshift-network-operator/iptables-alerter-grz4x" Jul 29 10:04:13.396588 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.396497 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzkcv\" (UniqueName: \"kubernetes.io/projected/8449b7fc-e9d6-4e28-ab0c-098653a0038c-kube-api-access-fzkcv\") pod \"node-ca-kj6nw\" (UID: \"8449b7fc-e9d6-4e28-ab0c-098653a0038c\") " pod="openshift-image-registry/node-ca-kj6nw" Jul 29 10:04:13.397604 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.397580 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97km6\" (UniqueName: \"kubernetes.io/projected/887cc015-c57f-43c8-875e-ae4917095a09-kube-api-access-97km6\") pod \"aws-ebs-csi-driver-node-bj892\" (UID: \"887cc015-c57f-43c8-875e-ae4917095a09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.398621 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.398552 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-566zt\" (UniqueName: \"kubernetes.io/projected/4b0de08b-fe5a-4336-9297-5bcc90b4a169-kube-api-access-566zt\") pod \"tuned-sp6sg\" (UID: \"4b0de08b-fe5a-4336-9297-5bcc90b4a169\") " pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.398739 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.398720 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpv82\" (UniqueName: \"kubernetes.io/projected/abc91ee3-5c70-4596-b6ca-bb8778025009-kube-api-access-cpv82\") pod \"network-metrics-daemon-bgz7n\" (UID: \"abc91ee3-5c70-4596-b6ca-bb8778025009\") " pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:13.399207 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.399190 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcbbd\" (UniqueName: \"kubernetes.io/projected/64624666-4239-467e-b6d5-cd37f39a91a0-kube-api-access-qcbbd\") pod \"node-resolver-v2zfl\" (UID: \"64624666-4239-467e-b6d5-cd37f39a91a0\") " pod="openshift-dns/node-resolver-v2zfl" Jul 29 10:04:13.476740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.476709 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b4c766cb-3afa-4166-b24f-958b9c0b3bb1-konnectivity-ca\") pod \"konnectivity-agent-2lmjk\" (UID: \"b4c766cb-3afa-4166-b24f-958b9c0b3bb1\") " pod="kube-system/konnectivity-agent-2lmjk" Jul 29 10:04:13.476929 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.476777 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b4c766cb-3afa-4166-b24f-958b9c0b3bb1-agent-certs\") pod \"konnectivity-agent-2lmjk\" (UID: \"b4c766cb-3afa-4166-b24f-958b9c0b3bb1\") " pod="kube-system/konnectivity-agent-2lmjk" Jul 29 10:04:13.477344 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.477315 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b4c766cb-3afa-4166-b24f-958b9c0b3bb1-konnectivity-ca\") pod \"konnectivity-agent-2lmjk\" (UID: \"b4c766cb-3afa-4166-b24f-958b9c0b3bb1\") " pod="kube-system/konnectivity-agent-2lmjk" Jul 29 10:04:13.479393 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.479372 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b4c766cb-3afa-4166-b24f-958b9c0b3bb1-agent-certs\") pod \"konnectivity-agent-2lmjk\" (UID: \"b4c766cb-3afa-4166-b24f-958b9c0b3bb1\") " pod="kube-system/konnectivity-agent-2lmjk" Jul 29 10:04:13.557841 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.557751 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" Jul 29 10:04:13.565906 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.565879 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t9h8f" Jul 29 10:04:13.575902 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.575871 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-grz4x" Jul 29 10:04:13.581062 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.581044 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8n87s" Jul 29 10:04:13.589387 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.589364 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:04:13.591480 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.591460 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" Jul 29 10:04:13.596862 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.596834 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kj6nw" Jul 29 10:04:13.605430 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.605411 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v2zfl" Jul 29 10:04:13.613388 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.613365 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:13.619142 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.619121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2lmjk" Jul 29 10:04:13.879204 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.879121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs\") pod \"network-metrics-daemon-bgz7n\" (UID: \"abc91ee3-5c70-4596-b6ca-bb8778025009\") " pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:13.879204 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.879167 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:13.879427 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.879319 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:04:13.879427 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.879324 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:04:13.879427 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.879386 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret podName:c70c9c83-ba38-4fcb-ad4e-1532b36229ed nodeName:}" failed. No retries permitted until 2026-07-29 10:04:14.879367666 +0000 UTC m=+4.000161054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret") pod "global-pull-secret-syncer-jp7ll" (UID: "c70c9c83-ba38-4fcb-ad4e-1532b36229ed") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:04:13.879427 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.879407 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs podName:abc91ee3-5c70-4596-b6ca-bb8778025009 nodeName:}" failed. No retries permitted until 2026-07-29 10:04:14.879396094 +0000 UTC m=+4.000189490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs") pod "network-metrics-daemon-bgz7n" (UID: "abc91ee3-5c70-4596-b6ca-bb8778025009") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:04:13.979714 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:13.979673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p87h2\" (UniqueName: \"kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2\") pod \"network-check-target-vff5m\" (UID: \"89ff5119-9ac3-4530-999d-96605fafbd39\") " pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:13.979898 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.979839 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:04:13.979898 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.979861 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:04:13.979898 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.979871 2577 projected.go:196] Error preparing data for projected volume kube-api-access-p87h2 for pod openshift-network-diagnostics/network-check-target-vff5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:04:13.980043 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:13.979929 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2 podName:89ff5119-9ac3-4530-999d-96605fafbd39 nodeName:}" failed. No retries permitted until 2026-07-29 10:04:14.979914407 +0000 UTC m=+4.100707777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p87h2" (UniqueName: "kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2") pod "network-check-target-vff5m" (UID: "89ff5119-9ac3-4530-999d-96605fafbd39") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:04:14.253676 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:14.253634 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0de08b_fe5a_4336_9297_5bcc90b4a169.slice/crio-3eb186afa9b97b99b9f72592f5344264ba87521a08710ea1a951467c0fbfab1f WatchSource:0}: Error finding container 3eb186afa9b97b99b9f72592f5344264ba87521a08710ea1a951467c0fbfab1f: Status 404 returned error can't find the container with id 3eb186afa9b97b99b9f72592f5344264ba87521a08710ea1a951467c0fbfab1f Jul 29 10:04:14.255022 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:14.254892 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14336764_23e1_43c3_b669_115ef1fc5d04.slice/crio-88e0327affbda65886bba16cb16dc85f412fa6e4ab9e6e2ae0e713ddc283e1c2 WatchSource:0}: Error finding container 88e0327affbda65886bba16cb16dc85f412fa6e4ab9e6e2ae0e713ddc283e1c2: Status 404 returned error can't find the container with id 88e0327affbda65886bba16cb16dc85f412fa6e4ab9e6e2ae0e713ddc283e1c2 Jul 29 10:04:14.262790 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:14.262742 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64624666_4239_467e_b6d5_cd37f39a91a0.slice/crio-3f4a5de08c287ab9efeaad15920b0756e5d74ad424d06b0db706a9a3608bd5a7 WatchSource:0}: Error finding container 3f4a5de08c287ab9efeaad15920b0756e5d74ad424d06b0db706a9a3608bd5a7: Status 404 returned error can't find the container with id 3f4a5de08c287ab9efeaad15920b0756e5d74ad424d06b0db706a9a3608bd5a7 Jul 29 10:04:14.264273 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:14.264161 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod696ccdd1_b3a5_41f5_938e_122bbfae3658.slice/crio-31bb3df0d4ca6d0bc615bf18ec3669ee380f93471ed5aee96295389debb9400c WatchSource:0}: Error finding container 31bb3df0d4ca6d0bc615bf18ec3669ee380f93471ed5aee96295389debb9400c: Status 404 returned error can't find the container with id 31bb3df0d4ca6d0bc615bf18ec3669ee380f93471ed5aee96295389debb9400c Jul 29 10:04:14.265085 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:14.265022 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a572133_c816_43af_a04c_8d8bfe731bf9.slice/crio-7a363c47a87a29ef77cb17b7e6ab0618f78848ce47470527dbea18d237583862 WatchSource:0}: Error finding container 7a363c47a87a29ef77cb17b7e6ab0618f78848ce47470527dbea18d237583862: Status 404 returned error can't find the container with id 7a363c47a87a29ef77cb17b7e6ab0618f78848ce47470527dbea18d237583862 Jul 29 10:04:14.267960 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:14.266510 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887cc015_c57f_43c8_875e_ae4917095a09.slice/crio-7b9f2373c803bc6e6be2c229b90e3f4c1771461b26c3a3267badcc759134580e WatchSource:0}: Error finding container 7b9f2373c803bc6e6be2c229b90e3f4c1771461b26c3a3267badcc759134580e: Status 404 returned error can't find the container with id 7b9f2373c803bc6e6be2c229b90e3f4c1771461b26c3a3267badcc759134580e Jul 29 10:04:14.267960 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:04:14.267428 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c766cb_3afa_4166_b24f_958b9c0b3bb1.slice/crio-8cad1bdc87ccd0ae623b10ab972850c43ca3a5d4123aa90119c86bed2c6d8f42 WatchSource:0}: Error finding container 8cad1bdc87ccd0ae623b10ab972850c43ca3a5d4123aa90119c86bed2c6d8f42: Status 404 returned error can't find the container with id 8cad1bdc87ccd0ae623b10ab972850c43ca3a5d4123aa90119c86bed2c6d8f42 Jul 29 10:04:14.319596 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.319554 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 09:59:12 +0000 UTC" deadline="2028-02-24 06:50:14.251586612 +0000 UTC" Jul 29 10:04:14.319596 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.319597 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13796h45m59.931994004s" Jul 29 10:04:14.355835 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.355811 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:04:14.491379 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.491358 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:14.491472 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.491385 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:14.491535 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:14.491468 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:14.491585 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:14.491537 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:14.499339 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.499310 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal" event={"ID":"3d621d3160f8888ed0c403b78ec3a0c9","Type":"ContainerStarted","Data":"f3e22bba866bbda13cd40ea7e906c77a455b7ed66080bec82833dae82e73e7c6"} Jul 29 10:04:14.500400 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.500375 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2lmjk" event={"ID":"b4c766cb-3afa-4166-b24f-958b9c0b3bb1","Type":"ContainerStarted","Data":"8cad1bdc87ccd0ae623b10ab972850c43ca3a5d4123aa90119c86bed2c6d8f42"} Jul 29 10:04:14.501496 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.501476 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" event={"ID":"887cc015-c57f-43c8-875e-ae4917095a09","Type":"ContainerStarted","Data":"7b9f2373c803bc6e6be2c229b90e3f4c1771461b26c3a3267badcc759134580e"} Jul 29 10:04:14.502546 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.502525 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" event={"ID":"696ccdd1-b3a5-41f5-938e-122bbfae3658","Type":"ContainerStarted","Data":"31bb3df0d4ca6d0bc615bf18ec3669ee380f93471ed5aee96295389debb9400c"} Jul 29 10:04:14.503581 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.503562 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v2zfl" event={"ID":"64624666-4239-467e-b6d5-cd37f39a91a0","Type":"ContainerStarted","Data":"3f4a5de08c287ab9efeaad15920b0756e5d74ad424d06b0db706a9a3608bd5a7"} Jul 29 10:04:14.504660 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.504643 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kj6nw" event={"ID":"8449b7fc-e9d6-4e28-ab0c-098653a0038c","Type":"ContainerStarted","Data":"30286a160b2e5fdd49b2d08ada6cf2be557d06d32398d00720898182d83f5b34"} Jul 29 10:04:14.505618 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.505601 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" event={"ID":"4b0de08b-fe5a-4336-9297-5bcc90b4a169","Type":"ContainerStarted","Data":"3eb186afa9b97b99b9f72592f5344264ba87521a08710ea1a951467c0fbfab1f"} Jul 29 10:04:14.506935 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.506918 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-60.ec2.internal" event={"ID":"52a974b3871525f86872b1ca0a85018c","Type":"ContainerStarted","Data":"37300d65086c7e026ca736dff4ac8c469eb3f2690d83c46dcceefda1eace897d"} Jul 29 10:04:14.507862 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.507838 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t9h8f" event={"ID":"8a572133-c816-43af-a04c-8d8bfe731bf9","Type":"ContainerStarted","Data":"7a363c47a87a29ef77cb17b7e6ab0618f78848ce47470527dbea18d237583862"} Jul 29 10:04:14.508997 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.508967 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8n87s" event={"ID":"65c2029e-43db-42df-824c-8b26ae85cae5","Type":"ContainerStarted","Data":"b68e690b004dbb7ac616b5028c2b09cac864db1952ec5689871332fcff6a6403"} Jul 29 10:04:14.509899 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.509882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-grz4x" event={"ID":"14336764-23e1-43c3-b669-115ef1fc5d04","Type":"ContainerStarted","Data":"88e0327affbda65886bba16cb16dc85f412fa6e4ab9e6e2ae0e713ddc283e1c2"} Jul 29 10:04:14.528296 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.528254 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-60.ec2.internal" podStartSLOduration=2.528242747 podStartE2EDuration="2.528242747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:04:14.527834714 +0000 UTC m=+3.648628095" watchObservedRunningTime="2026-07-29 10:04:14.528242747 +0000 UTC m=+3.649036140" Jul 29 10:04:14.885485 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.884734 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs\") pod \"network-metrics-daemon-bgz7n\" (UID: \"abc91ee3-5c70-4596-b6ca-bb8778025009\") " pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:14.885485 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.884781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:14.885485 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:14.884907 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:04:14.885485 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:14.884968 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret podName:c70c9c83-ba38-4fcb-ad4e-1532b36229ed nodeName:}" failed. No retries permitted until 2026-07-29 10:04:16.884950286 +0000 UTC m=+6.005743660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret") pod "global-pull-secret-syncer-jp7ll" (UID: "c70c9c83-ba38-4fcb-ad4e-1532b36229ed") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:04:14.885485 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:14.885360 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:04:14.885485 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:14.885407 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs podName:abc91ee3-5c70-4596-b6ca-bb8778025009 nodeName:}" failed. No retries permitted until 2026-07-29 10:04:16.885392034 +0000 UTC m=+6.006185407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs") pod "network-metrics-daemon-bgz7n" (UID: "abc91ee3-5c70-4596-b6ca-bb8778025009") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:04:14.985915 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:14.985880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p87h2\" (UniqueName: \"kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2\") pod \"network-check-target-vff5m\" (UID: \"89ff5119-9ac3-4530-999d-96605fafbd39\") " pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:14.986102 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:14.986081 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:04:14.986166 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:14.986104 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:04:14.986166 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:14.986117 2577 projected.go:196] Error preparing data for projected volume kube-api-access-p87h2 for pod openshift-network-diagnostics/network-check-target-vff5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:04:14.986270 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:14.986188 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2 podName:89ff5119-9ac3-4530-999d-96605fafbd39 nodeName:}" failed. No retries permitted until 2026-07-29 10:04:16.986166693 +0000 UTC m=+6.106960074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p87h2" (UniqueName: "kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2") pod "network-check-target-vff5m" (UID: "89ff5119-9ac3-4530-999d-96605fafbd39") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:04:15.493567 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:15.493014 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:15.493567 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:15.493157 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:15.521326 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:15.513248 2577 generic.go:356] "Generic (PLEG): container finished" podID="3d621d3160f8888ed0c403b78ec3a0c9" containerID="f3e22bba866bbda13cd40ea7e906c77a455b7ed66080bec82833dae82e73e7c6" exitCode=0 Jul 29 10:04:15.521326 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:15.513852 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal" event={"ID":"3d621d3160f8888ed0c403b78ec3a0c9","Type":"ContainerDied","Data":"f3e22bba866bbda13cd40ea7e906c77a455b7ed66080bec82833dae82e73e7c6"} Jul 29 10:04:16.492072 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:16.491538 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:16.492072 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:16.491664 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:16.492072 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:16.491784 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:16.492072 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:16.491888 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:16.520789 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:16.520757 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal" event={"ID":"3d621d3160f8888ed0c403b78ec3a0c9","Type":"ContainerStarted","Data":"97a54d1f421f05b0691b50e6f91c0e663524933fee36899b1017a825caf7e7c5"} Jul 29 10:04:16.902827 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:16.902750 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs\") pod \"network-metrics-daemon-bgz7n\" (UID: \"abc91ee3-5c70-4596-b6ca-bb8778025009\") " pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:16.902827 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:16.902797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:16.903068 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:16.902926 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:04:16.903068 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:16.903000 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret podName:c70c9c83-ba38-4fcb-ad4e-1532b36229ed nodeName:}" failed. No retries permitted until 2026-07-29 10:04:20.902966134 +0000 UTC m=+10.023759524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret") pod "global-pull-secret-syncer-jp7ll" (UID: "c70c9c83-ba38-4fcb-ad4e-1532b36229ed") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:04:16.903412 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:16.903387 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:04:16.903510 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:16.903444 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs podName:abc91ee3-5c70-4596-b6ca-bb8778025009 nodeName:}" failed. No retries permitted until 2026-07-29 10:04:20.903427241 +0000 UTC m=+10.024220631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs") pod "network-metrics-daemon-bgz7n" (UID: "abc91ee3-5c70-4596-b6ca-bb8778025009") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:04:17.004089 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:17.003451 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p87h2\" (UniqueName: \"kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2\") pod \"network-check-target-vff5m\" (UID: \"89ff5119-9ac3-4530-999d-96605fafbd39\") " pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:17.004089 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:17.003644 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:04:17.004089 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:17.003661 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:04:17.004089 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:17.003676 2577 projected.go:196] Error preparing data for projected volume kube-api-access-p87h2 for pod openshift-network-diagnostics/network-check-target-vff5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:04:17.004089 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:17.003731 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2 podName:89ff5119-9ac3-4530-999d-96605fafbd39 nodeName:}" failed. No retries permitted until 2026-07-29 10:04:21.003712956 +0000 UTC m=+10.124506339 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p87h2" (UniqueName: "kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2") pod "network-check-target-vff5m" (UID: "89ff5119-9ac3-4530-999d-96605fafbd39") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:04:17.491886 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:17.491846 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:17.492070 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:17.492011 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:18.492247 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:18.492205 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:18.492671 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:18.492262 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:18.492671 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:18.492350 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:18.492671 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:18.492493 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:19.491946 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:19.491862 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:19.492129 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:19.492024 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:20.492199 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:20.492067 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:20.492199 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:20.492096 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:20.492689 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:20.492205 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:20.492689 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:20.492314 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:20.934827 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:20.934734 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs\") pod \"network-metrics-daemon-bgz7n\" (UID: \"abc91ee3-5c70-4596-b6ca-bb8778025009\") " pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:20.934827 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:20.934786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:20.935053 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:20.934934 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:04:20.935053 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:20.935013 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret podName:c70c9c83-ba38-4fcb-ad4e-1532b36229ed nodeName:}" failed. No retries permitted until 2026-07-29 10:04:28.93497851 +0000 UTC m=+18.055771882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret") pod "global-pull-secret-syncer-jp7ll" (UID: "c70c9c83-ba38-4fcb-ad4e-1532b36229ed") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:04:20.935402 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:20.935286 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:04:20.935402 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:20.935352 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs podName:abc91ee3-5c70-4596-b6ca-bb8778025009 nodeName:}" failed. No retries permitted until 2026-07-29 10:04:28.935332578 +0000 UTC m=+18.056125951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs") pod "network-metrics-daemon-bgz7n" (UID: "abc91ee3-5c70-4596-b6ca-bb8778025009") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:04:21.035828 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:21.035788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p87h2\" (UniqueName: \"kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2\") pod \"network-check-target-vff5m\" (UID: \"89ff5119-9ac3-4530-999d-96605fafbd39\") " pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:21.036054 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:21.035942 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:04:21.036054 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:21.035964 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:04:21.036054 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:21.035977 2577 projected.go:196] Error preparing data for projected volume kube-api-access-p87h2 for pod openshift-network-diagnostics/network-check-target-vff5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:04:21.036054 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:21.036045 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2 podName:89ff5119-9ac3-4530-999d-96605fafbd39 nodeName:}" failed. No retries permitted until 2026-07-29 10:04:29.036031585 +0000 UTC m=+18.156824955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p87h2" (UniqueName: "kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2") pod "network-check-target-vff5m" (UID: "89ff5119-9ac3-4530-999d-96605fafbd39") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:04:21.492641 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:21.492605 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:21.493129 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:21.492718 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:22.492136 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:22.492101 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:22.492366 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:22.492158 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:22.492366 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:22.492231 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:22.492532 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:22.492350 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:23.491747 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:23.491708 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:23.492242 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:23.491833 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:24.492127 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:24.492089 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:24.492605 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:24.492089 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:24.492605 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:24.492236 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:24.492605 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:24.492280 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:25.491898 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:25.491859 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:25.492051 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:25.491969 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:26.491903 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:26.491852 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:26.492362 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:26.491853 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:26.492362 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:26.492056 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:26.492362 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:26.492120 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:27.492092 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:27.492061 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:27.492515 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:27.492189 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:28.492164 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:28.492133 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:28.492601 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:28.492140 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:28.492601 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:28.492231 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:28.492601 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:28.492342 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:28.989439 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:28.989357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs\") pod \"network-metrics-daemon-bgz7n\" (UID: \"abc91ee3-5c70-4596-b6ca-bb8778025009\") " pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:28.989439 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:28.989395 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:28.989659 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:28.989531 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:04:28.989659 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:28.989585 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret podName:c70c9c83-ba38-4fcb-ad4e-1532b36229ed nodeName:}" failed. No retries permitted until 2026-07-29 10:04:44.989569524 +0000 UTC m=+34.110362896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret") pod "global-pull-secret-syncer-jp7ll" (UID: "c70c9c83-ba38-4fcb-ad4e-1532b36229ed") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:04:28.989659 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:28.989531 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:04:28.989818 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:28.989681 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs podName:abc91ee3-5c70-4596-b6ca-bb8778025009 nodeName:}" failed. No retries permitted until 2026-07-29 10:04:44.989662241 +0000 UTC m=+34.110455617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs") pod "network-metrics-daemon-bgz7n" (UID: "abc91ee3-5c70-4596-b6ca-bb8778025009") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:04:29.090558 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:29.090522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p87h2\" (UniqueName: \"kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2\") pod \"network-check-target-vff5m\" (UID: \"89ff5119-9ac3-4530-999d-96605fafbd39\") " pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:29.090750 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:29.090677 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:04:29.090750 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:29.090698 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:04:29.090750 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:29.090711 2577 projected.go:196] Error preparing data for projected volume kube-api-access-p87h2 for pod openshift-network-diagnostics/network-check-target-vff5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:04:29.090902 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:29.090771 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2 podName:89ff5119-9ac3-4530-999d-96605fafbd39 nodeName:}" failed. No retries permitted until 2026-07-29 10:04:45.090752372 +0000 UTC m=+34.211545766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p87h2" (UniqueName: "kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2") pod "network-check-target-vff5m" (UID: "89ff5119-9ac3-4530-999d-96605fafbd39") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:04:29.492341 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:29.492309 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:29.492773 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:29.492452 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:30.491942 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:30.491908 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:30.492145 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:30.492047 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:30.492145 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:30.492099 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:30.492254 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:30.492224 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:31.492852 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:31.492819 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:31.493323 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:31.492931 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:32.491919 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.491495 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:32.492071 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.491535 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:32.492111 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:32.492071 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:32.492160 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:32.492138 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:32.556527 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.556501 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t9h8f" event={"ID":"8a572133-c816-43af-a04c-8d8bfe731bf9","Type":"ContainerStarted","Data":"fb930656dac751b5dada9f151e827647c8eaf8bd2e9c5410fddcc26415333db9"} Jul 29 10:04:32.558084 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.558060 2577 generic.go:356] "Generic (PLEG): container finished" podID="65c2029e-43db-42df-824c-8b26ae85cae5" containerID="f1042ae6be2450efb0869a6c21f67494989f872c36a4342efe24e1bedbffcc2b" exitCode=0 Jul 29 10:04:32.558159 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.558106 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8n87s" event={"ID":"65c2029e-43db-42df-824c-8b26ae85cae5","Type":"ContainerDied","Data":"f1042ae6be2450efb0869a6c21f67494989f872c36a4342efe24e1bedbffcc2b"} Jul 29 10:04:32.559538 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.559486 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2lmjk" event={"ID":"b4c766cb-3afa-4166-b24f-958b9c0b3bb1","Type":"ContainerStarted","Data":"1b51477508567e4ab80a7991591bb0b8281d9f8cfe8cfa9abbdceda1d4eb60ad"} Jul 29 10:04:32.561172 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.561117 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" event={"ID":"887cc015-c57f-43c8-875e-ae4917095a09","Type":"ContainerStarted","Data":"84c5dd667e90b2fff3845809116bf552b4bdf991495d242f1ad360d1e161c2b3"} Jul 29 10:04:32.566132 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.566107 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" event={"ID":"696ccdd1-b3a5-41f5-938e-122bbfae3658","Type":"ContainerStarted","Data":"28e52ea0e7daeb6c69400451103006d17f2715d764698b0bf91cdbc31ecb45b5"} Jul 29 10:04:32.566218 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.566184 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" event={"ID":"696ccdd1-b3a5-41f5-938e-122bbfae3658","Type":"ContainerStarted","Data":"8c1d0f055813b9f0e81410c7674836a6131ee75d8d29c646ea24d87f37be12f8"} Jul 29 10:04:32.566275 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.566239 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" event={"ID":"696ccdd1-b3a5-41f5-938e-122bbfae3658","Type":"ContainerStarted","Data":"0d984c35dd2a67d07dd5457837bfe9723ada8a93b131d8b66197eaa4f554520c"} Jul 29 10:04:32.566334 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.566279 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" event={"ID":"696ccdd1-b3a5-41f5-938e-122bbfae3658","Type":"ContainerStarted","Data":"c57ce1e7734de76c13e23e3b569ddec6f08a289a93dbb59b25ce7ee0d448f944"} Jul 29 10:04:32.566371 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.566334 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" event={"ID":"696ccdd1-b3a5-41f5-938e-122bbfae3658","Type":"ContainerStarted","Data":"148d0fefdcc55da3e3e730ef0a7edc5207623291d51e44dc2607a67ad3a8464e"} Jul 29 10:04:32.570781 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.570753 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v2zfl" event={"ID":"64624666-4239-467e-b6d5-cd37f39a91a0","Type":"ContainerStarted","Data":"92bbdd89bb1c36b2abdecf2872c08933e7ca7f1074dd9c7940f684bcfeb3d4d3"} Jul 29 10:04:32.572294 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.572267 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kj6nw" event={"ID":"8449b7fc-e9d6-4e28-ab0c-098653a0038c","Type":"ContainerStarted","Data":"c732e0f872e7ba3aceec228ea6653737260875f1173b7ecb570a2831a1a3f4c9"} Jul 29 10:04:32.573486 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.573465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" event={"ID":"4b0de08b-fe5a-4336-9297-5bcc90b4a169","Type":"ContainerStarted","Data":"954d8485e449de3357b416c91cb67d9b96a480e4d109cd007b9179f72cb05e40"} Jul 29 10:04:32.581610 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.581571 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-60.ec2.internal" podStartSLOduration=20.581561186 podStartE2EDuration="20.581561186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:04:16.53837354 +0000 UTC m=+5.659166950" watchObservedRunningTime="2026-07-29 10:04:32.581561186 +0000 UTC m=+21.702354579" Jul 29 10:04:32.581914 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.581894 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t9h8f" podStartSLOduration=3.8331433710000002 podStartE2EDuration="21.581887939s" totalImagesPullingTime="17.748744568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:04:32.581376838 +0000 UTC m=+21.702170230" watchObservedRunningTime="2026-07-29 10:04:32.581887939 +0000 UTC m=+21.702681685" Jul 29 10:04:32.601474 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.601438 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kj6nw" podStartSLOduration=3.883523844 podStartE2EDuration="21.601425375s" totalImagesPullingTime="17.717901531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:04:32.600925378 +0000 UTC m=+21.721718773" watchObservedRunningTime="2026-07-29 10:04:32.601425375 +0000 UTC m=+21.722218768" Jul 29 10:04:32.623211 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.623168 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v2zfl" podStartSLOduration=9.09113547 podStartE2EDuration="21.623154466s" totalImagesPullingTime="12.532018996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:04:32.622910379 +0000 UTC m=+21.743703772" watchObservedRunningTime="2026-07-29 10:04:32.623154466 +0000 UTC m=+21.743947858" Jul 29 10:04:32.675149 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.675098 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2lmjk" podStartSLOduration=3.96425821 podStartE2EDuration="21.675082317s" totalImagesPullingTime="17.710824107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:04:32.674571882 +0000 UTC m=+21.795365274" watchObservedRunningTime="2026-07-29 10:04:32.675082317 +0000 UTC m=+21.795875709" Jul 29 10:04:32.694609 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.694563 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sp6sg" podStartSLOduration=3.971739131 podStartE2EDuration="21.694547842s" totalImagesPullingTime="17.722808711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:04:32.694207498 +0000 UTC m=+21.815000892" watchObservedRunningTime="2026-07-29 10:04:32.694547842 +0000 UTC m=+21.815341232" Jul 29 10:04:32.701727 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.701703 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:32.784632 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:32.784554 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:33.246012 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:33.245971 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v2zfl_64624666-4239-467e-b6d5-cd37f39a91a0/dns-node-resolver/0.log" Jul 29 10:04:33.384804 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:33.384694 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:33.459249 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:33.459216 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:33.492107 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:33.492076 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:33.492256 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:33.492212 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:33.579755 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:33.579722 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" event={"ID":"696ccdd1-b3a5-41f5-938e-122bbfae3658","Type":"ContainerStarted","Data":"aa7196cc1c5931c823fab3a160201607fbbc284ef23447fc7d39a6dc75a66dee"} Jul 29 10:04:33.581268 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:33.581238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-grz4x" event={"ID":"14336764-23e1-43c3-b669-115ef1fc5d04","Type":"ContainerStarted","Data":"1b9185f54b083c9632e428ae2a1032c4081b5f0bffb3e4731977bc3d0a667107"} Jul 29 10:04:33.602695 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:33.602637 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-grz4x" podStartSLOduration=4.883123303 podStartE2EDuration="22.602615191s" totalImagesPullingTime="17.719491888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:04:33.602302752 +0000 UTC m=+22.723096143" watchObservedRunningTime="2026-07-29 10:04:33.602615191 +0000 UTC m=+22.723408584" Jul 29 10:04:33.731081 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:33.731048 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:33.739716 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:33.739692 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 10:04:33.860000 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:33.859950 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:33.923607 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:33.923515 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:34.252397 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:34.252317 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kj6nw_8449b7fc-e9d6-4e28-ab0c-098653a0038c/node-ca/0.log" Jul 29 10:04:34.278599 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:34.278568 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:34.334667 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:34.334541 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T10:04:33.73971207Z","UUID":"cf31cd41-814f-4217-b795-36e411c0d5bd","Handler":null,"Name":"","Endpoint":""} Jul 29 10:04:34.336315 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:34.336288 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 10:04:34.336438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:34.336348 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 10:04:34.491599 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:34.491570 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:34.491760 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:34.491694 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:34.491840 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:34.491774 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:34.491904 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:34.491878 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:34.585930 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:34.585813 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" event={"ID":"887cc015-c57f-43c8-875e-ae4917095a09","Type":"ContainerStarted","Data":"014668209fdd45b92bf83b66cecbc5a8a8d4d9af822fbd8e8fcce207303b54ca"} Jul 29 10:04:34.632544 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:34.632507 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:35.252016 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:35.251966 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:35.492029 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:35.491976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:35.492195 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:35.492133 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:35.594165 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:35.594086 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" event={"ID":"696ccdd1-b3a5-41f5-938e-122bbfae3658","Type":"ContainerStarted","Data":"f32c031691f09ab52b6ba531d88fc62c911a0224b674db531c72d4887f2232a5"} Jul 29 10:04:36.492126 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:36.492082 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:36.492325 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:36.492135 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:36.492325 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:36.492236 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:36.492446 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:36.492358 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:36.589481 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:36.589451 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:36.700467 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:36.700321 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:36.800849 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:36.800811 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:36.928472 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:36.928441 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:36.951466 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:36.951440 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2lmjk" Jul 29 10:04:36.951953 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:36.951936 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2lmjk" Jul 29 10:04:37.111253 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.111230 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:37.307962 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.307881 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:37.491716 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.491675 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:37.491853 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:37.491812 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:37.599428 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.599336 2577 generic.go:356] "Generic (PLEG): container finished" podID="65c2029e-43db-42df-824c-8b26ae85cae5" containerID="3699aa87869e93133ff733a24075f8274396e9ad5909130dda5dab30c73ea840" exitCode=0 Jul 29 10:04:37.599644 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.599429 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8n87s" event={"ID":"65c2029e-43db-42df-824c-8b26ae85cae5","Type":"ContainerDied","Data":"3699aa87869e93133ff733a24075f8274396e9ad5909130dda5dab30c73ea840"} Jul 29 10:04:37.601580 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.601560 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" event={"ID":"887cc015-c57f-43c8-875e-ae4917095a09","Type":"ContainerStarted","Data":"bdbd0f6ebf993a0284bafe056a32474f241c5a10022619b2af8a721976da1c6b"} Jul 29 10:04:37.605116 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.605089 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" event={"ID":"696ccdd1-b3a5-41f5-938e-122bbfae3658","Type":"ContainerStarted","Data":"3c86d43c475838dda6c524b3d5593b5a6f65c917ca086381e99db6fe295b7a08"} Jul 29 10:04:37.605334 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.605308 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2lmjk" Jul 29 10:04:37.605461 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.605346 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:37.605461 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.605406 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:37.605461 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.605451 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:37.606053 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.606025 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2lmjk" Jul 29 10:04:37.620057 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.620035 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:37.620177 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.620132 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:04:37.666504 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.666456 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" podStartSLOduration=8.755318944 podStartE2EDuration="26.666439887s" totalImagesPullingTime="17.911120943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:04:37.652917022 +0000 UTC m=+26.773710425" watchObservedRunningTime="2026-07-29 10:04:37.666439887 +0000 UTC m=+26.787233279" Jul 29 10:04:37.688114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:37.688071 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj892" podStartSLOduration=4.663449277 podStartE2EDuration="26.688056036s" totalImagesPullingTime="22.024606759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:04:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:04:37.688047095 +0000 UTC m=+26.808840487" watchObservedRunningTime="2026-07-29 10:04:37.688056036 +0000 UTC m=+26.808849428" Jul 29 10:04:38.029096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:38.029065 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:38.488879 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:38.488846 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:38.491862 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:38.491842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:38.491993 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:38.491961 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:38.492046 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:38.492017 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:38.492133 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:38.492114 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:38.683894 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:38.683850 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:38.916238 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:38.915923 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:39.089361 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:39.089265 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:39.283030 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:39.282998 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:39.491609 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:39.491579 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:39.491772 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:39.491676 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:39.613556 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:39.613524 2577 generic.go:356] "Generic (PLEG): container finished" podID="65c2029e-43db-42df-824c-8b26ae85cae5" containerID="aac3460c1a27c8c3208f3af62470651123e15e44e19dede08ec42a4f7a7ffddd" exitCode=0 Jul 29 10:04:39.613720 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:39.613608 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8n87s" event={"ID":"65c2029e-43db-42df-824c-8b26ae85cae5","Type":"ContainerDied","Data":"aac3460c1a27c8c3208f3af62470651123e15e44e19dede08ec42a4f7a7ffddd"} Jul 29 10:04:39.664893 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:39.664862 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:40.194003 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:40.193955 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:40.295584 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:40.295550 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:40.479138 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:40.479071 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:40.492074 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:40.492054 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:40.492153 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:40.492054 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:40.492194 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:40.492176 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:40.492233 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:40.492216 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:41.495146 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:41.495121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:41.495560 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:41.495209 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:41.619780 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:41.619750 2577 generic.go:356] "Generic (PLEG): container finished" podID="65c2029e-43db-42df-824c-8b26ae85cae5" containerID="46b9a71cf0e316738f66d2a1e3dd4f00b8ebb3551bc0ed83be7bb029dbfbad06" exitCode=0 Jul 29 10:04:41.619938 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:41.619808 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8n87s" event={"ID":"65c2029e-43db-42df-824c-8b26ae85cae5","Type":"ContainerDied","Data":"46b9a71cf0e316738f66d2a1e3dd4f00b8ebb3551bc0ed83be7bb029dbfbad06"} Jul 29 10:04:41.745195 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:41.745116 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:41.803310 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:41.803279 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:42.081821 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:42.081752 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:42.182081 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:42.182052 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:42.282111 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:42.282073 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:42.492083 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:42.492052 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:42.492083 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:42.492074 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:42.492307 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:42.492186 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:42.492307 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:42.492294 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:42.681628 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:42.681597 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:42.886045 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:42.885957 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:42.987335 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:42.987302 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:43.120089 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:43.120055 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:43.297102 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:43.297071 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:43.478211 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:43.478182 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:43.492210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:43.492186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:43.492365 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:43.492319 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:43.884940 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:43.884905 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:44.271801 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:44.271769 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:44.343020 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:44.342969 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:44.492078 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:44.492048 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:44.492078 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:44.492059 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:44.492322 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:44.492170 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:44.492322 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:44.492311 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:44.688758 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:44.688677 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:45.012899 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:45.012859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs\") pod \"network-metrics-daemon-bgz7n\" (UID: \"abc91ee3-5c70-4596-b6ca-bb8778025009\") " pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:45.013359 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:45.012909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:45.013359 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:45.013043 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:04:45.013359 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:45.013089 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:04:45.013359 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:45.013121 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs podName:abc91ee3-5c70-4596-b6ca-bb8778025009 nodeName:}" failed. No retries permitted until 2026-07-29 10:05:17.01310313 +0000 UTC m=+66.133896518 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs") pod "network-metrics-daemon-bgz7n" (UID: "abc91ee3-5c70-4596-b6ca-bb8778025009") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:04:45.013359 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:45.013146 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret podName:c70c9c83-ba38-4fcb-ad4e-1532b36229ed nodeName:}" failed. No retries permitted until 2026-07-29 10:05:17.01312939 +0000 UTC m=+66.133922764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret") pod "global-pull-secret-syncer-jp7ll" (UID: "c70c9c83-ba38-4fcb-ad4e-1532b36229ed") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:04:45.113912 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:45.113868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p87h2\" (UniqueName: \"kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2\") pod \"network-check-target-vff5m\" (UID: \"89ff5119-9ac3-4530-999d-96605fafbd39\") " pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:45.114085 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:45.114065 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:04:45.114140 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:45.114092 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:04:45.114140 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:45.114106 2577 projected.go:196] Error preparing data for projected volume kube-api-access-p87h2 for pod openshift-network-diagnostics/network-check-target-vff5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:04:45.114222 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:45.114170 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2 podName:89ff5119-9ac3-4530-999d-96605fafbd39 nodeName:}" failed. No retries permitted until 2026-07-29 10:05:17.114151104 +0000 UTC m=+66.234944479 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p87h2" (UniqueName: "kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2") pod "network-check-target-vff5m" (UID: "89ff5119-9ac3-4530-999d-96605fafbd39") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:04:45.304821 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:45.304735 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:45.491410 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:45.491380 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:45.491582 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:45.491478 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:45.876617 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:45.876587 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:46.082635 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:46.082613 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:46.483330 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:46.483302 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:46.491410 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:46.491389 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:46.491490 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:46.491392 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:46.491571 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:46.491477 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:46.491606 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:46.491562 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:46.632450 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:46.632419 2577 generic.go:356] "Generic (PLEG): container finished" podID="65c2029e-43db-42df-824c-8b26ae85cae5" containerID="3589d76f980236eb16dce254802e60a306524b2a0cf55bee530f2f4df6d074d9" exitCode=0 Jul 29 10:04:46.632600 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:46.632473 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8n87s" event={"ID":"65c2029e-43db-42df-824c-8b26ae85cae5","Type":"ContainerDied","Data":"3589d76f980236eb16dce254802e60a306524b2a0cf55bee530f2f4df6d074d9"} Jul 29 10:04:46.685942 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:46.685911 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:47.136499 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:47.136422 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:47.292778 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:47.292744 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:47.491693 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:47.491668 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:47.491822 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:47.491788 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:47.637515 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:47.637484 2577 generic.go:356] "Generic (PLEG): container finished" podID="65c2029e-43db-42df-824c-8b26ae85cae5" containerID="698a775c4b54ab1c59c9ed8c8c80900aa8356c3d8dbf4eb9da1c7fa44fa80c10" exitCode=0 Jul 29 10:04:47.637657 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:47.637532 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8n87s" event={"ID":"65c2029e-43db-42df-824c-8b26ae85cae5","Type":"ContainerDied","Data":"698a775c4b54ab1c59c9ed8c8c80900aa8356c3d8dbf4eb9da1c7fa44fa80c10"} Jul 29 10:04:48.491426 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:48.491397 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:48.491882 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:48.491521 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:48.491882 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:48.491563 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:48.491882 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:48.491657 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:48.642367 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:48.642327 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8n87s" event={"ID":"65c2029e-43db-42df-824c-8b26ae85cae5","Type":"ContainerStarted","Data":"770cd3a2a32f95fd996b4ffe47ba43a38777ee02fea49bfb16b0460bd1e4daf6"} Jul 29 10:04:48.669246 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:48.669207 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8n87s" podStartSLOduration=8.747557199 podStartE2EDuration="37.669194207s" totalImagesPullingTime="28.921637008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:04:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:04:48.667751707 +0000 UTC m=+37.788545101" watchObservedRunningTime="2026-07-29 10:04:48.669194207 +0000 UTC m=+37.789987639" Jul 29 10:04:49.491446 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:49.491411 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:49.491853 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:49.491514 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:50.491512 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:50.491480 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:50.491863 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:50.491482 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:50.491863 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:50.491577 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:50.491863 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:50.491659 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:51.492878 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:51.492849 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:51.493241 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:51.492926 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:52.491755 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:52.491727 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:52.491755 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:52.491748 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:52.491962 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:52.491819 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:52.491962 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:52.491944 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:53.491586 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:53.491561 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:53.491958 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:53.491660 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:54.491375 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:54.491342 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:54.491567 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:54.491457 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:54.491567 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:54.491505 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:54.491910 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:54.491591 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:55.491799 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:55.491772 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:55.492298 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:55.491893 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:56.085212 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:56.083212 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:56.229775 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:56.229746 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:56.328673 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:56.328635 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:56.492065 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:56.492035 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:56.492065 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:56.492068 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:56.492477 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:56.492145 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:56.492477 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:56.492258 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:56.550263 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:56.550235 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:56.644155 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:56.644126 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:57.491612 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:57.491371 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:57.491750 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:57.491719 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:57.518229 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:57.518163 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bgz7n"] Jul 29 10:04:57.518577 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:57.518249 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:57.518577 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:57.518329 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:04:57.523537 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:57.523513 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vff5m"] Jul 29 10:04:57.527613 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:57.527594 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jp7ll"] Jul 29 10:04:57.527695 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:57.527679 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:57.527777 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:57.527761 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:57.659434 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:57.659405 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:57.659602 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:57.659508 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:59.271789 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:59.271752 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:59.350653 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:59.350622 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:59.426833 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:59.426763 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:04:59.491970 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:59.491929 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:04:59.491970 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:59.491955 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:04:59.492223 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:04:59.492077 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:04:59.492223 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:59.492077 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jp7ll" podUID="c70c9c83-ba38-4fcb-ad4e-1532b36229ed" Jul 29 10:04:59.492223 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:59.492167 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vff5m" podUID="89ff5119-9ac3-4530-999d-96605fafbd39" Jul 29 10:04:59.492372 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:04:59.492267 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgz7n" podUID="abc91ee3-5c70-4596-b6ca-bb8778025009" Jul 29 10:05:00.657116 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.657087 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-60.ec2.internal" event="NodeReady" Jul 29 10:05:00.657460 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.657198 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 10:05:00.707938 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.707911 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mcks8"] Jul 29 10:05:00.709786 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.709763 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:00.710800 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.710781 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vc2cq"] Jul 29 10:05:00.712676 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.712655 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 10:05:00.712771 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.712657 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2b94c\"" Jul 29 10:05:00.712771 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.712705 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vc2cq" Jul 29 10:05:00.712945 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.712927 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 10:05:00.715233 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.715217 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 10:05:00.715887 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.715856 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 10:05:00.715975 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.715911 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 10:05:00.715975 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.715861 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-44xbx\"" Jul 29 10:05:00.722211 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.722191 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mcks8"] Jul 29 10:05:00.725260 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.725241 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vc2cq"] Jul 29 10:05:00.733077 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.733061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/274c70c3-bc07-45b9-a022-d22424d91ca3-tmp-dir\") pod \"dns-default-mcks8\" (UID: \"274c70c3-bc07-45b9-a022-d22424d91ca3\") " pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:00.733187 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.733119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwqlv\" (UniqueName: \"kubernetes.io/projected/274c70c3-bc07-45b9-a022-d22424d91ca3-kube-api-access-cwqlv\") pod \"dns-default-mcks8\" (UID: \"274c70c3-bc07-45b9-a022-d22424d91ca3\") " pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:00.733187 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.733156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/274c70c3-bc07-45b9-a022-d22424d91ca3-config-volume\") pod \"dns-default-mcks8\" (UID: \"274c70c3-bc07-45b9-a022-d22424d91ca3\") " pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:00.733187 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.733179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/274c70c3-bc07-45b9-a022-d22424d91ca3-metrics-tls\") pod \"dns-default-mcks8\" (UID: \"274c70c3-bc07-45b9-a022-d22424d91ca3\") " pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:00.733320 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.733211 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39d85ba5-919c-4235-acb7-8f7de0f2d0b7-cert\") pod \"ingress-canary-vc2cq\" (UID: \"39d85ba5-919c-4235-acb7-8f7de0f2d0b7\") " pod="openshift-ingress-canary/ingress-canary-vc2cq" Jul 29 10:05:00.733320 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.733234 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c94q\" (UniqueName: \"kubernetes.io/projected/39d85ba5-919c-4235-acb7-8f7de0f2d0b7-kube-api-access-7c94q\") pod \"ingress-canary-vc2cq\" (UID: \"39d85ba5-919c-4235-acb7-8f7de0f2d0b7\") " pod="openshift-ingress-canary/ingress-canary-vc2cq" Jul 29 10:05:00.809877 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.809817 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hfdm7"] Jul 29 10:05:00.811592 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.811578 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.814428 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.814407 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 10:05:00.814748 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.814732 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 10:05:00.814816 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.814734 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 10:05:00.815038 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.815023 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 10:05:00.815594 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.815578 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dkjgn\"" Jul 29 10:05:00.830303 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.830282 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hfdm7"] Jul 29 10:05:00.834013 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.833974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/274c70c3-bc07-45b9-a022-d22424d91ca3-tmp-dir\") pod \"dns-default-mcks8\" (UID: \"274c70c3-bc07-45b9-a022-d22424d91ca3\") " pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:00.834112 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.834031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f673db28-e353-4bdc-87ee-be9fee5676ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.834112 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.834063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f673db28-e353-4bdc-87ee-be9fee5676ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.834112 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.834088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2fdv\" (UniqueName: \"kubernetes.io/projected/f673db28-e353-4bdc-87ee-be9fee5676ca-kube-api-access-k2fdv\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.834271 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.834187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f673db28-e353-4bdc-87ee-be9fee5676ca-crio-socket\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.834271 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.834220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwqlv\" (UniqueName: \"kubernetes.io/projected/274c70c3-bc07-45b9-a022-d22424d91ca3-kube-api-access-cwqlv\") pod \"dns-default-mcks8\" (UID: \"274c70c3-bc07-45b9-a022-d22424d91ca3\") " pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:00.834271 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.834250 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/274c70c3-bc07-45b9-a022-d22424d91ca3-config-volume\") pod \"dns-default-mcks8\" (UID: \"274c70c3-bc07-45b9-a022-d22424d91ca3\") " pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:00.834411 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.834273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/274c70c3-bc07-45b9-a022-d22424d91ca3-metrics-tls\") pod \"dns-default-mcks8\" (UID: \"274c70c3-bc07-45b9-a022-d22424d91ca3\") " pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:00.834411 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.834275 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/274c70c3-bc07-45b9-a022-d22424d91ca3-tmp-dir\") pod \"dns-default-mcks8\" (UID: \"274c70c3-bc07-45b9-a022-d22424d91ca3\") " pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:00.834411 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.834326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39d85ba5-919c-4235-acb7-8f7de0f2d0b7-cert\") pod \"ingress-canary-vc2cq\" (UID: \"39d85ba5-919c-4235-acb7-8f7de0f2d0b7\") " pod="openshift-ingress-canary/ingress-canary-vc2cq" Jul 29 10:05:00.834411 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.834351 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c94q\" (UniqueName: \"kubernetes.io/projected/39d85ba5-919c-4235-acb7-8f7de0f2d0b7-kube-api-access-7c94q\") pod \"ingress-canary-vc2cq\" (UID: \"39d85ba5-919c-4235-acb7-8f7de0f2d0b7\") " pod="openshift-ingress-canary/ingress-canary-vc2cq" Jul 29 10:05:00.834411 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.834385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f673db28-e353-4bdc-87ee-be9fee5676ca-data-volume\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.834847 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.834828 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/274c70c3-bc07-45b9-a022-d22424d91ca3-config-volume\") pod \"dns-default-mcks8\" (UID: \"274c70c3-bc07-45b9-a022-d22424d91ca3\") " pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:00.838224 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.838201 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39d85ba5-919c-4235-acb7-8f7de0f2d0b7-cert\") pod \"ingress-canary-vc2cq\" (UID: \"39d85ba5-919c-4235-acb7-8f7de0f2d0b7\") " pod="openshift-ingress-canary/ingress-canary-vc2cq" Jul 29 10:05:00.838224 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.838213 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/274c70c3-bc07-45b9-a022-d22424d91ca3-metrics-tls\") pod \"dns-default-mcks8\" (UID: \"274c70c3-bc07-45b9-a022-d22424d91ca3\") " pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:00.848811 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.848788 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwqlv\" (UniqueName: \"kubernetes.io/projected/274c70c3-bc07-45b9-a022-d22424d91ca3-kube-api-access-cwqlv\") pod \"dns-default-mcks8\" (UID: \"274c70c3-bc07-45b9-a022-d22424d91ca3\") " pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:00.849386 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.849363 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c94q\" (UniqueName: \"kubernetes.io/projected/39d85ba5-919c-4235-acb7-8f7de0f2d0b7-kube-api-access-7c94q\") pod \"ingress-canary-vc2cq\" (UID: \"39d85ba5-919c-4235-acb7-8f7de0f2d0b7\") " pod="openshift-ingress-canary/ingress-canary-vc2cq" Jul 29 10:05:00.864254 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.864234 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:00.935527 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.935502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f673db28-e353-4bdc-87ee-be9fee5676ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.935630 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.935529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f673db28-e353-4bdc-87ee-be9fee5676ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.935630 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.935545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2fdv\" (UniqueName: \"kubernetes.io/projected/f673db28-e353-4bdc-87ee-be9fee5676ca-kube-api-access-k2fdv\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.935630 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.935580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f673db28-e353-4bdc-87ee-be9fee5676ca-crio-socket\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.935834 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.935629 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f673db28-e353-4bdc-87ee-be9fee5676ca-data-volume\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.935834 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.935800 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f673db28-e353-4bdc-87ee-be9fee5676ca-crio-socket\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.936015 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.935976 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f673db28-e353-4bdc-87ee-be9fee5676ca-data-volume\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.936153 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.936134 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f673db28-e353-4bdc-87ee-be9fee5676ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.937682 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.937663 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f673db28-e353-4bdc-87ee-be9fee5676ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.944652 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.944633 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2fdv\" (UniqueName: \"kubernetes.io/projected/f673db28-e353-4bdc-87ee-be9fee5676ca-kube-api-access-k2fdv\") pod \"insights-runtime-extractor-hfdm7\" (UID: \"f673db28-e353-4bdc-87ee-be9fee5676ca\") " pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:00.967799 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:00.967778 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:01.020582 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.020557 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:01.026225 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.026205 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vc2cq" Jul 29 10:05:01.049796 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.049764 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jnnfz"] Jul 29 10:05:01.052232 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.052207 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jnnfz" Jul 29 10:05:01.053114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.053088 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:01.055277 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.055257 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 29 10:05:01.055389 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.055360 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-n79fd\"" Jul 29 10:05:01.062447 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.062370 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jnnfz"] Jul 29 10:05:01.120473 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.120305 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hfdm7" Jul 29 10:05:01.137403 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.137369 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/832ec802-27e7-4f28-9971-a39fae384923-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-jnnfz\" (UID: \"832ec802-27e7-4f28-9971-a39fae384923\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jnnfz" Jul 29 10:05:01.164803 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.164774 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vc2cq"] Jul 29 10:05:01.167104 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.167081 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mcks8"] Jul 29 10:05:01.168171 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:01.168149 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d85ba5_919c_4235_acb7_8f7de0f2d0b7.slice/crio-febbcdcecf4d923098846c7b17a09c41476ceb85be473d2771ba801d85e1b73e WatchSource:0}: Error finding container febbcdcecf4d923098846c7b17a09c41476ceb85be473d2771ba801d85e1b73e: Status 404 returned error can't find the container with id febbcdcecf4d923098846c7b17a09c41476ceb85be473d2771ba801d85e1b73e Jul 29 10:05:01.170151 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:01.170129 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274c70c3_bc07_45b9_a022_d22424d91ca3.slice/crio-c60fcee021b5589a7b02061eba39d7834ba183f3b4c268fd204c8963eb8bad81 WatchSource:0}: Error finding container c60fcee021b5589a7b02061eba39d7834ba183f3b4c268fd204c8963eb8bad81: Status 404 returned error can't find the container with id c60fcee021b5589a7b02061eba39d7834ba183f3b4c268fd204c8963eb8bad81 Jul 29 10:05:01.238659 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.238627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/832ec802-27e7-4f28-9971-a39fae384923-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-jnnfz\" (UID: \"832ec802-27e7-4f28-9971-a39fae384923\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jnnfz" Jul 29 10:05:01.238796 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:05:01.238770 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 29 10:05:01.238843 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:05:01.238830 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/832ec802-27e7-4f28-9971-a39fae384923-tls-certificates podName:832ec802-27e7-4f28-9971-a39fae384923 nodeName:}" failed. No retries permitted until 2026-07-29 10:05:01.738814711 +0000 UTC m=+50.859608083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/832ec802-27e7-4f28-9971-a39fae384923-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-jnnfz" (UID: "832ec802-27e7-4f28-9971-a39fae384923") : secret "prometheus-operator-admission-webhook-tls" not found Jul 29 10:05:01.248168 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.248144 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hfdm7"] Jul 29 10:05:01.251007 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:01.250973 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf673db28_e353_4bdc_87ee_be9fee5676ca.slice/crio-1cfa11fdee385c4b4e5b4435ce4f2988be5718b0a40537c50460248a18eac269 WatchSource:0}: Error finding container 1cfa11fdee385c4b4e5b4435ce4f2988be5718b0a40537c50460248a18eac269: Status 404 returned error can't find the container with id 1cfa11fdee385c4b4e5b4435ce4f2988be5718b0a40537c50460248a18eac269 Jul 29 10:05:01.495112 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.495084 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:05:01.495287 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.495192 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:05:01.495287 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.495215 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:05:01.498122 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.498099 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nxwvh\"" Jul 29 10:05:01.498270 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.498152 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 10:05:01.498270 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.498157 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 10:05:01.498270 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.498172 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 10:05:01.498270 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.498221 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x9kk4\"" Jul 29 10:05:01.498270 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.498156 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 10:05:01.502762 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.502739 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:01.642965 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.642938 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:01.668576 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.668548 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hfdm7" event={"ID":"f673db28-e353-4bdc-87ee-be9fee5676ca","Type":"ContainerStarted","Data":"1cfa11fdee385c4b4e5b4435ce4f2988be5718b0a40537c50460248a18eac269"} Jul 29 10:05:01.669664 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.669643 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vc2cq" event={"ID":"39d85ba5-919c-4235-acb7-8f7de0f2d0b7","Type":"ContainerStarted","Data":"febbcdcecf4d923098846c7b17a09c41476ceb85be473d2771ba801d85e1b73e"} Jul 29 10:05:01.670728 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.670706 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mcks8" event={"ID":"274c70c3-bc07-45b9-a022-d22424d91ca3","Type":"ContainerStarted","Data":"c60fcee021b5589a7b02061eba39d7834ba183f3b4c268fd204c8963eb8bad81"} Jul 29 10:05:01.741505 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.741474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/832ec802-27e7-4f28-9971-a39fae384923-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-jnnfz\" (UID: \"832ec802-27e7-4f28-9971-a39fae384923\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jnnfz" Jul 29 10:05:01.741668 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.741650 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:01.744546 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.744528 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/832ec802-27e7-4f28-9971-a39fae384923-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-jnnfz\" (UID: \"832ec802-27e7-4f28-9971-a39fae384923\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jnnfz" Jul 29 10:05:01.824079 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.823997 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:01.896063 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.896025 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:01.963275 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:01.963243 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jnnfz" Jul 29 10:05:02.131566 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:02.131531 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jnnfz"] Jul 29 10:05:02.140483 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:02.136665 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod832ec802_27e7_4f28_9971_a39fae384923.slice/crio-524307e94ecd8848d6d7ce94d1e70b091b307f62c71fd3fa15f703ee7bc66fbf WatchSource:0}: Error finding container 524307e94ecd8848d6d7ce94d1e70b091b307f62c71fd3fa15f703ee7bc66fbf: Status 404 returned error can't find the container with id 524307e94ecd8848d6d7ce94d1e70b091b307f62c71fd3fa15f703ee7bc66fbf Jul 29 10:05:02.675237 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:02.675202 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jnnfz" event={"ID":"832ec802-27e7-4f28-9971-a39fae384923","Type":"ContainerStarted","Data":"524307e94ecd8848d6d7ce94d1e70b091b307f62c71fd3fa15f703ee7bc66fbf"} Jul 29 10:05:04.031519 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.031262 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:04.132313 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.132244 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:04.682475 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.682439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jnnfz" event={"ID":"832ec802-27e7-4f28-9971-a39fae384923","Type":"ContainerStarted","Data":"a625b83bf58c593d85f8260b5bd697b9977403059d2dc8489599e30317152f3c"} Jul 29 10:05:04.682667 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.682505 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jnnfz" Jul 29 10:05:04.684632 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.684588 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mcks8" event={"ID":"274c70c3-bc07-45b9-a022-d22424d91ca3","Type":"ContainerStarted","Data":"fecc3b290166c95a1a9f26cc634bb2ad3d8e222710f16f1cd373e0204e724a0f"} Jul 29 10:05:04.684753 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.684640 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mcks8" event={"ID":"274c70c3-bc07-45b9-a022-d22424d91ca3","Type":"ContainerStarted","Data":"b6690b863e623dab7866608bcb7e3b121dc1f179743714610a72eb6df82377d6"} Jul 29 10:05:04.684753 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.684671 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:04.688698 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.688678 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jnnfz" Jul 29 10:05:04.700040 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.699966 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jnnfz" podStartSLOduration=2.01299112 podStartE2EDuration="3.699950035s" totalImagesPullingTime="1.686958915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:04.699260659 +0000 UTC m=+53.820054052" watchObservedRunningTime="2026-07-29 10:05:04.699950035 +0000 UTC m=+53.820743421" Jul 29 10:05:04.718744 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.718696 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mcks8" podStartSLOduration=2.061816851 podStartE2EDuration="4.718652298s" totalImagesPullingTime="2.656835447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:04.71786954 +0000 UTC m=+53.838662933" watchObservedRunningTime="2026-07-29 10:05:04.718652298 +0000 UTC m=+53.839445728" Jul 29 10:05:04.898353 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.898324 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:04.906429 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.906404 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-zj5jk"] Jul 29 10:05:04.918324 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.918280 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-zj5jk" Jul 29 10:05:04.920957 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.920901 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-zj5jk"] Jul 29 10:05:04.921438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.921416 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6ccql\"" Jul 29 10:05:04.921740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.921719 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 10:05:04.921960 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.921935 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 10:05:04.970863 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.970812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68hgv\" (UniqueName: \"kubernetes.io/projected/4272ab48-a027-4870-b2e4-36707a0caa75-kube-api-access-68hgv\") pod \"downloads-7c97dc4555-zj5jk\" (UID: \"4272ab48-a027-4870-b2e4-36707a0caa75\") " pod="openshift-console/downloads-7c97dc4555-zj5jk" Jul 29 10:05:04.994427 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:04.994398 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:05.072254 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.072212 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68hgv\" (UniqueName: \"kubernetes.io/projected/4272ab48-a027-4870-b2e4-36707a0caa75-kube-api-access-68hgv\") pod \"downloads-7c97dc4555-zj5jk\" (UID: \"4272ab48-a027-4870-b2e4-36707a0caa75\") " pod="openshift-console/downloads-7c97dc4555-zj5jk" Jul 29 10:05:05.083237 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.083211 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68hgv\" (UniqueName: \"kubernetes.io/projected/4272ab48-a027-4870-b2e4-36707a0caa75-kube-api-access-68hgv\") pod \"downloads-7c97dc4555-zj5jk\" (UID: \"4272ab48-a027-4870-b2e4-36707a0caa75\") " pod="openshift-console/downloads-7c97dc4555-zj5jk" Jul 29 10:05:05.096207 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.096149 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:05.122286 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.122253 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-5wgcv"] Jul 29 10:05:05.124961 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.124943 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:05.127956 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.127929 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 29 10:05:05.128123 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.128098 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 10:05:05.128384 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.128202 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 29 10:05:05.128384 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.128319 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 10:05:05.129568 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.129549 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-z7ljf\"" Jul 29 10:05:05.129664 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.129555 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 10:05:05.135544 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.135485 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-5wgcv"] Jul 29 10:05:05.173643 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.173612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccd18598-498a-4899-80ee-2953e1620c4b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-5wgcv\" (UID: \"ccd18598-498a-4899-80ee-2953e1620c4b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:05.173643 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.173653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wk54\" (UniqueName: \"kubernetes.io/projected/ccd18598-498a-4899-80ee-2953e1620c4b-kube-api-access-4wk54\") pod \"prometheus-operator-84d69f794d-5wgcv\" (UID: \"ccd18598-498a-4899-80ee-2953e1620c4b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:05.173894 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.173726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccd18598-498a-4899-80ee-2953e1620c4b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-5wgcv\" (UID: \"ccd18598-498a-4899-80ee-2953e1620c4b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:05.173894 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.173766 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccd18598-498a-4899-80ee-2953e1620c4b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-5wgcv\" (UID: \"ccd18598-498a-4899-80ee-2953e1620c4b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:05.196457 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.196423 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:05.231271 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.231187 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-zj5jk" Jul 29 10:05:05.262419 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.262391 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:05.274438 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.274407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccd18598-498a-4899-80ee-2953e1620c4b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-5wgcv\" (UID: \"ccd18598-498a-4899-80ee-2953e1620c4b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:05.274595 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.274477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccd18598-498a-4899-80ee-2953e1620c4b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-5wgcv\" (UID: \"ccd18598-498a-4899-80ee-2953e1620c4b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:05.274595 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.274506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wk54\" (UniqueName: \"kubernetes.io/projected/ccd18598-498a-4899-80ee-2953e1620c4b-kube-api-access-4wk54\") pod \"prometheus-operator-84d69f794d-5wgcv\" (UID: \"ccd18598-498a-4899-80ee-2953e1620c4b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:05.274595 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.274572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccd18598-498a-4899-80ee-2953e1620c4b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-5wgcv\" (UID: \"ccd18598-498a-4899-80ee-2953e1620c4b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:05.274595 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:05:05.274596 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 29 10:05:05.274867 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:05:05.274656 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd18598-498a-4899-80ee-2953e1620c4b-prometheus-operator-tls podName:ccd18598-498a-4899-80ee-2953e1620c4b nodeName:}" failed. No retries permitted until 2026-07-29 10:05:05.774637203 +0000 UTC m=+54.895430595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ccd18598-498a-4899-80ee-2953e1620c4b-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-5wgcv" (UID: "ccd18598-498a-4899-80ee-2953e1620c4b") : secret "prometheus-operator-tls" not found Jul 29 10:05:05.275184 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.275161 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccd18598-498a-4899-80ee-2953e1620c4b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-5wgcv\" (UID: \"ccd18598-498a-4899-80ee-2953e1620c4b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:05.277184 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.277159 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccd18598-498a-4899-80ee-2953e1620c4b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-5wgcv\" (UID: \"ccd18598-498a-4899-80ee-2953e1620c4b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:05.284214 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.284194 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wk54\" (UniqueName: \"kubernetes.io/projected/ccd18598-498a-4899-80ee-2953e1620c4b-kube-api-access-4wk54\") pod \"prometheus-operator-84d69f794d-5wgcv\" (UID: \"ccd18598-498a-4899-80ee-2953e1620c4b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:05.508114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.508024 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:05.659041 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.658477 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:05.715176 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.715143 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:05.778638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.778552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccd18598-498a-4899-80ee-2953e1620c4b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-5wgcv\" (UID: \"ccd18598-498a-4899-80ee-2953e1620c4b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:05.781299 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.781277 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccd18598-498a-4899-80ee-2953e1620c4b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-5wgcv\" (UID: \"ccd18598-498a-4899-80ee-2953e1620c4b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:05.977914 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:05.977882 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:06.036495 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:06.036391 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" Jul 29 10:05:06.047261 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:06.047215 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:06.801186 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:06.801139 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:07.002880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:07.002851 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:07.444360 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:07.444327 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:07.640805 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:07.640775 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:07.681140 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:07.681107 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-zj5jk"] Jul 29 10:05:07.688038 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:07.688013 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-5wgcv"] Jul 29 10:05:07.692842 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:07.692812 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vc2cq" event={"ID":"39d85ba5-919c-4235-acb7-8f7de0f2d0b7","Type":"ContainerStarted","Data":"bfb110617e02c4a1fc087d72f8ddc6b59f0de3de4f4fe40306206c38dc7f91cf"} Jul 29 10:05:07.693256 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:07.693230 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd18598_498a_4899_80ee_2953e1620c4b.slice/crio-ef52ed92dce84d294f31ef8a853c12ea0bce5c27f089bafd3b93688987ea494a WatchSource:0}: Error finding container ef52ed92dce84d294f31ef8a853c12ea0bce5c27f089bafd3b93688987ea494a: Status 404 returned error can't find the container with id ef52ed92dce84d294f31ef8a853c12ea0bce5c27f089bafd3b93688987ea494a Jul 29 10:05:07.694600 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:07.694540 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hfdm7" event={"ID":"f673db28-e353-4bdc-87ee-be9fee5676ca","Type":"ContainerStarted","Data":"cd1832276235ed310ef11bcceb87c0950474c656ce4b58146cf589d94842e95b"} Jul 29 10:05:07.695751 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:07.695718 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-zj5jk" event={"ID":"4272ab48-a027-4870-b2e4-36707a0caa75","Type":"ContainerStarted","Data":"05af0c7686ad7a4b471f91faeb358ee20b7162add5ab69ea9283f9b4f23efa66"} Jul 29 10:05:07.710538 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:07.710486 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vc2cq" podStartSLOduration=1.333438952 podStartE2EDuration="7.710472221s" totalImagesPullingTime="6.377033269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:07.70995048 +0000 UTC m=+56.830743864" watchObservedRunningTime="2026-07-29 10:05:07.710472221 +0000 UTC m=+56.831265613" Jul 29 10:05:07.719886 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:07.719847 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:08.701439 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:08.701376 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" event={"ID":"ccd18598-498a-4899-80ee-2953e1620c4b","Type":"ContainerStarted","Data":"ef52ed92dce84d294f31ef8a853c12ea0bce5c27f089bafd3b93688987ea494a"} Jul 29 10:05:09.631095 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:09.631063 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvfh6" Jul 29 10:05:09.809697 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:09.809667 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:09.910966 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:09.910839 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:10.474024 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:10.473941 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:10.575128 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:10.575079 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:12.217757 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:12.217719 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:12.718806 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:12.718761 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hfdm7" event={"ID":"f673db28-e353-4bdc-87ee-be9fee5676ca","Type":"ContainerStarted","Data":"b5d2a689b860a7c718ebdcbfe6ec62b5e3268eb430832a8fc65858501c1c440f"} Jul 29 10:05:12.721824 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:12.721792 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" event={"ID":"ccd18598-498a-4899-80ee-2953e1620c4b","Type":"ContainerStarted","Data":"5f35c9a3b441afb0af7ca16529efcbad7e60386a8741252395b32d547e8eb7a7"} Jul 29 10:05:12.721968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:12.721889 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" event={"ID":"ccd18598-498a-4899-80ee-2953e1620c4b","Type":"ContainerStarted","Data":"111fe8d715c8e6a89c0d23df78ccaf8bc1a31b7520636a09d4d3ff6fb8a0102b"} Jul 29 10:05:12.740977 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:12.740924 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-5wgcv" podStartSLOduration=3.559724014 podStartE2EDuration="7.740911515s" totalImagesPullingTime="4.181187501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:12.740504819 +0000 UTC m=+61.861298214" watchObservedRunningTime="2026-07-29 10:05:12.740911515 +0000 UTC m=+61.861704902" Jul 29 10:05:13.132141 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:13.132007 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:13.208943 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:13.208898 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:14.248286 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.248249 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:14.349798 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.349735 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:14.472749 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.472715 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:14.503340 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.503255 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd"] Jul 29 10:05:14.512635 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.512609 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" Jul 29 10:05:14.516024 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.516000 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 29 10:05:14.516844 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.516796 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 29 10:05:14.516977 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.516850 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-28x7s\"" Jul 29 10:05:14.528350 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.528328 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd"] Jul 29 10:05:14.546342 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.546305 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p5gkv"] Jul 29 10:05:14.547865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.547671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1950b4b-53df-42d5-a339-23b887bc8c5c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-8c9dd\" (UID: \"b1950b4b-53df-42d5-a339-23b887bc8c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" Jul 29 10:05:14.547865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.547708 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfjz7\" (UniqueName: \"kubernetes.io/projected/b1950b4b-53df-42d5-a339-23b887bc8c5c-kube-api-access-rfjz7\") pod \"openshift-state-metrics-b8f49f5c6-8c9dd\" (UID: \"b1950b4b-53df-42d5-a339-23b887bc8c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" Jul 29 10:05:14.547865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.547740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1950b4b-53df-42d5-a339-23b887bc8c5c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-8c9dd\" (UID: \"b1950b4b-53df-42d5-a339-23b887bc8c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" Jul 29 10:05:14.547865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.547790 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1950b4b-53df-42d5-a339-23b887bc8c5c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-8c9dd\" (UID: \"b1950b4b-53df-42d5-a339-23b887bc8c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" Jul 29 10:05:14.550928 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.550428 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj"] Jul 29 10:05:14.550928 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.550566 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.552709 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.552664 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.553895 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.553875 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 10:05:14.554062 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.554039 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 10:05:14.554286 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.554148 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 10:05:14.554467 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.554450 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-frn8w\"" Jul 29 10:05:14.556245 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.556224 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 29 10:05:14.556915 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.556899 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 29 10:05:14.562774 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.562557 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8twpp\"" Jul 29 10:05:14.564778 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.564136 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 29 10:05:14.576292 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.576271 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj"] Jul 29 10:05:14.600523 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.600479 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:14.649133 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1950b4b-53df-42d5-a339-23b887bc8c5c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-8c9dd\" (UID: \"b1950b4b-53df-42d5-a339-23b887bc8c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" Jul 29 10:05:14.649275 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95855b9d-6612-4182-9ad0-8ea89de5f1c9-sys\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.649275 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649172 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-tls\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.649275 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjt6v\" (UniqueName: \"kubernetes.io/projected/2fbce395-c761-480c-a1e6-e6ae4ba653df-kube-api-access-vjt6v\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.649275 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649229 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1950b4b-53df-42d5-a339-23b887bc8c5c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-8c9dd\" (UID: \"b1950b4b-53df-42d5-a339-23b887bc8c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" Jul 29 10:05:14.649275 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649249 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95855b9d-6612-4182-9ad0-8ea89de5f1c9-root\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.649275 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649270 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2fbce395-c761-480c-a1e6-e6ae4ba653df-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.649589 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fbce395-c761-480c-a1e6-e6ae4ba653df-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.649589 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vw6f\" (UniqueName: \"kubernetes.io/projected/95855b9d-6612-4182-9ad0-8ea89de5f1c9-kube-api-access-9vw6f\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.649589 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649369 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-wtmp\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.649589 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1950b4b-53df-42d5-a339-23b887bc8c5c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-8c9dd\" (UID: \"b1950b4b-53df-42d5-a339-23b887bc8c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" Jul 29 10:05:14.649589 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649451 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfjz7\" (UniqueName: \"kubernetes.io/projected/b1950b4b-53df-42d5-a339-23b887bc8c5c-kube-api-access-rfjz7\") pod \"openshift-state-metrics-b8f49f5c6-8c9dd\" (UID: \"b1950b4b-53df-42d5-a339-23b887bc8c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" Jul 29 10:05:14.649589 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fbce395-c761-480c-a1e6-e6ae4ba653df-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.649589 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95855b9d-6612-4182-9ad0-8ea89de5f1c9-metrics-client-ca\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.649589 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649540 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-textfile\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.649589 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2fbce395-c761-480c-a1e6-e6ae4ba653df-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.650038 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fbce395-c761-480c-a1e6-e6ae4ba653df-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.650038 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649629 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.650038 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.649661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.650827 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.650783 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1950b4b-53df-42d5-a339-23b887bc8c5c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-8c9dd\" (UID: \"b1950b4b-53df-42d5-a339-23b887bc8c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" Jul 29 10:05:14.652716 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.652689 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1950b4b-53df-42d5-a339-23b887bc8c5c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-8c9dd\" (UID: \"b1950b4b-53df-42d5-a339-23b887bc8c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" Jul 29 10:05:14.653517 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.653492 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1950b4b-53df-42d5-a339-23b887bc8c5c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-8c9dd\" (UID: \"b1950b4b-53df-42d5-a339-23b887bc8c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" Jul 29 10:05:14.661325 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.661281 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfjz7\" (UniqueName: \"kubernetes.io/projected/b1950b4b-53df-42d5-a339-23b887bc8c5c-kube-api-access-rfjz7\") pod \"openshift-state-metrics-b8f49f5c6-8c9dd\" (UID: \"b1950b4b-53df-42d5-a339-23b887bc8c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" Jul 29 10:05:14.670956 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.670924 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:14.689027 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.689002 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mcks8" Jul 29 10:05:14.750145 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-wtmp\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.750145 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fbce395-c761-480c-a1e6-e6ae4ba653df-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.750413 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95855b9d-6612-4182-9ad0-8ea89de5f1c9-metrics-client-ca\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.750413 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-textfile\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.750413 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750348 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-wtmp\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.750413 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750372 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2fbce395-c761-480c-a1e6-e6ae4ba653df-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.750413 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750404 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fbce395-c761-480c-a1e6-e6ae4ba653df-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.750663 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.750663 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.750663 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750526 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95855b9d-6612-4182-9ad0-8ea89de5f1c9-sys\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.750663 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750551 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-tls\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.750663 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750578 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjt6v\" (UniqueName: \"kubernetes.io/projected/2fbce395-c761-480c-a1e6-e6ae4ba653df-kube-api-access-vjt6v\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.750663 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95855b9d-6612-4182-9ad0-8ea89de5f1c9-root\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.750663 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2fbce395-c761-480c-a1e6-e6ae4ba653df-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.751021 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fbce395-c761-480c-a1e6-e6ae4ba653df-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.751021 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vw6f\" (UniqueName: \"kubernetes.io/projected/95855b9d-6612-4182-9ad0-8ea89de5f1c9-kube-api-access-9vw6f\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.751021 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750874 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95855b9d-6612-4182-9ad0-8ea89de5f1c9-metrics-client-ca\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.751021 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.750912 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fbce395-c761-480c-a1e6-e6ae4ba653df-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.751222 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.751047 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2fbce395-c761-480c-a1e6-e6ae4ba653df-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.751222 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.751065 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95855b9d-6612-4182-9ad0-8ea89de5f1c9-sys\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.751222 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.751192 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-textfile\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.751369 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.751341 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95855b9d-6612-4182-9ad0-8ea89de5f1c9-root\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.758149 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.757504 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2fbce395-c761-480c-a1e6-e6ae4ba653df-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.758149 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.758102 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.758316 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.758286 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.764895 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.764866 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vw6f\" (UniqueName: \"kubernetes.io/projected/95855b9d-6612-4182-9ad0-8ea89de5f1c9-kube-api-access-9vw6f\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.768731 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.768684 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95855b9d-6612-4182-9ad0-8ea89de5f1c9-node-exporter-tls\") pod \"node-exporter-p5gkv\" (UID: \"95855b9d-6612-4182-9ad0-8ea89de5f1c9\") " pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.768969 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.768948 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjt6v\" (UniqueName: \"kubernetes.io/projected/2fbce395-c761-480c-a1e6-e6ae4ba653df-kube-api-access-vjt6v\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.770575 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.770552 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fbce395-c761-480c-a1e6-e6ae4ba653df-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.771176 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.771148 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fbce395-c761-480c-a1e6-e6ae4ba653df-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-w5tkj\" (UID: \"2fbce395-c761-480c-a1e6-e6ae4ba653df\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.774315 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.774287 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:14.823842 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.823818 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" Jul 29 10:05:14.836466 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.836446 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5994fb8b68-wwwnv"] Jul 29 10:05:14.838701 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.838680 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:14.841859 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.841674 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 10:05:14.841859 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.841767 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 10:05:14.842694 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.842600 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 10:05:14.842694 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.842616 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 10:05:14.842874 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.842728 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8kxqq\"" Jul 29 10:05:14.842922 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.842902 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 10:05:14.851096 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.851073 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5994fb8b68-wwwnv"] Jul 29 10:05:14.858774 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.858745 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:14.863627 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.863607 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p5gkv" Jul 29 10:05:14.871741 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.871724 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" Jul 29 10:05:14.918040 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.918004 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:14.952710 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.952684 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-oauth-config\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:14.952861 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.952721 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-serving-cert\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:14.952861 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.952740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-config\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:14.952861 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.952778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-oauth-serving-cert\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:14.952861 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.952847 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-service-ca\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:14.953059 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:14.952885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qkbv\" (UniqueName: \"kubernetes.io/projected/f6982956-2bee-4dca-b0b6-21cd95c0efb1-kube-api-access-6qkbv\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:15.054313 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.054235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-oauth-serving-cert\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:15.054313 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.054304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-service-ca\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:15.054653 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.054333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qkbv\" (UniqueName: \"kubernetes.io/projected/f6982956-2bee-4dca-b0b6-21cd95c0efb1-kube-api-access-6qkbv\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:15.054653 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.054427 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-oauth-config\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:15.054653 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.054466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-serving-cert\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:15.054653 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.054495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-config\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:15.055082 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.055054 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-oauth-serving-cert\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:15.055220 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.055194 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-config\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:15.055469 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.055448 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-service-ca\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:15.057522 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.057504 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-serving-cert\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:15.057650 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.057632 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-oauth-config\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:15.064638 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.064609 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qkbv\" (UniqueName: \"kubernetes.io/projected/f6982956-2bee-4dca-b0b6-21cd95c0efb1-kube-api-access-6qkbv\") pod \"console-5994fb8b68-wwwnv\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:15.150577 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.150543 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:15.547091 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.547054 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:15.643329 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.643286 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:15.649852 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.649823 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:05:15.741538 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.741506 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:05:15.741677 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.741614 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.744810 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.744784 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 10:05:15.745513 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.745077 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 10:05:15.745513 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.745175 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 10:05:15.745513 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.745208 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c29xf\"" Jul 29 10:05:15.745513 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.745414 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 10:05:15.745513 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.745475 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 10:05:15.749614 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.745536 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 10:05:15.749614 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.745590 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 10:05:15.749614 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.745661 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 10:05:15.749614 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.745728 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 10:05:15.861818 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.861742 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.861818 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.861801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-config-volume\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.862034 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.861850 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.862034 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.861923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.862034 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.861956 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b5c92eb2-d130-4116-a51d-57ff2a00b804-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.862034 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.862009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5c92eb2-d130-4116-a51d-57ff2a00b804-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.862034 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.862032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5c92eb2-d130-4116-a51d-57ff2a00b804-config-out\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.862208 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.862047 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.862208 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.862063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.862208 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.862136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5c92eb2-d130-4116-a51d-57ff2a00b804-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.862208 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.862169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-web-config\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.862208 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.862190 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwdv5\" (UniqueName: \"kubernetes.io/projected/b5c92eb2-d130-4116-a51d-57ff2a00b804-kube-api-access-mwdv5\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.862208 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.862208 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5c92eb2-d130-4116-a51d-57ff2a00b804-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.906370 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:15.906297 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95855b9d_6612_4182_9ad0_8ea89de5f1c9.slice/crio-1fede5e2e281e589eb0f38e873a17960a67670be3a61ad7a1984705136c6bae9 WatchSource:0}: Error finding container 1fede5e2e281e589eb0f38e873a17960a67670be3a61ad7a1984705136c6bae9: Status 404 returned error can't find the container with id 1fede5e2e281e589eb0f38e873a17960a67670be3a61ad7a1984705136c6bae9 Jul 29 10:05:15.970317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.964250 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-web-config\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.970317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.964298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwdv5\" (UniqueName: \"kubernetes.io/projected/b5c92eb2-d130-4116-a51d-57ff2a00b804-kube-api-access-mwdv5\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.970317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.964327 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5c92eb2-d130-4116-a51d-57ff2a00b804-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.970317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.964387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.970317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.964454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-config-volume\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.970317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.964478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.970317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.964505 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.970317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.964529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b5c92eb2-d130-4116-a51d-57ff2a00b804-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.970317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.964558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5c92eb2-d130-4116-a51d-57ff2a00b804-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.970317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.964592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5c92eb2-d130-4116-a51d-57ff2a00b804-config-out\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.970317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.964614 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.970317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.964647 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.970317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.964699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5c92eb2-d130-4116-a51d-57ff2a00b804-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.972271 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.972196 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5c92eb2-d130-4116-a51d-57ff2a00b804-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.972731 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.972707 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b5c92eb2-d130-4116-a51d-57ff2a00b804-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.972833 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.972801 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5c92eb2-d130-4116-a51d-57ff2a00b804-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.975699 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.975653 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5c92eb2-d130-4116-a51d-57ff2a00b804-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.977209 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.977186 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.977957 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.977918 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5c92eb2-d130-4116-a51d-57ff2a00b804-config-out\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.979788 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.978503 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.979788 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.979627 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.981380 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.981335 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.982794 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.982753 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.992026 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.990513 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-web-config\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.992026 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.990928 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-config-volume\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:15.992798 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:15.992756 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwdv5\" (UniqueName: \"kubernetes.io/projected/b5c92eb2-d130-4116-a51d-57ff2a00b804-kube-api-access-mwdv5\") pod \"alertmanager-main-0\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:16.008858 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.006839 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:16.053349 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.053300 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:05:16.066329 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.066298 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd"] Jul 29 10:05:16.081017 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.080958 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj"] Jul 29 10:05:16.101848 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.101822 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5994fb8b68-wwwnv"] Jul 29 10:05:16.200824 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:16.200784 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1950b4b_53df_42d5_a339_23b887bc8c5c.slice/crio-a425633e4397abbab71a8d86a711fcbd27f43bbb2f4cd26c97a7fb372fa57f17 WatchSource:0}: Error finding container a425633e4397abbab71a8d86a711fcbd27f43bbb2f4cd26c97a7fb372fa57f17: Status 404 returned error can't find the container with id a425633e4397abbab71a8d86a711fcbd27f43bbb2f4cd26c97a7fb372fa57f17 Jul 29 10:05:16.201867 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:16.201843 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fbce395_c761_480c_a1e6_e6ae4ba653df.slice/crio-5a173df3c86801eb5014ab1d934e8737fe402439c8316f6858f4900bbd3e0e6e WatchSource:0}: Error finding container 5a173df3c86801eb5014ab1d934e8737fe402439c8316f6858f4900bbd3e0e6e: Status 404 returned error can't find the container with id 5a173df3c86801eb5014ab1d934e8737fe402439c8316f6858f4900bbd3e0e6e Jul 29 10:05:16.202447 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:16.202410 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6982956_2bee_4dca_b0b6_21cd95c0efb1.slice/crio-a0273ad163c9f851b122318783d3b22e91aae514b609d4fae7acc5892adc84ce WatchSource:0}: Error finding container a0273ad163c9f851b122318783d3b22e91aae514b609d4fae7acc5892adc84ce: Status 404 returned error can't find the container with id a0273ad163c9f851b122318783d3b22e91aae514b609d4fae7acc5892adc84ce Jul 29 10:05:16.388401 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.388263 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:05:16.388528 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.388403 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:16.392720 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:16.392691 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5c92eb2_d130_4116_a51d_57ff2a00b804.slice/crio-e08777f925215de26526848b6cfc5ce2d2aefcd56a4342af617c49435526859e WatchSource:0}: Error finding container e08777f925215de26526848b6cfc5ce2d2aefcd56a4342af617c49435526859e: Status 404 returned error can't find the container with id e08777f925215de26526848b6cfc5ce2d2aefcd56a4342af617c49435526859e Jul 29 10:05:16.485412 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.485384 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:16.547762 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.547735 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp"] Jul 29 10:05:16.571451 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.571415 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp"] Jul 29 10:05:16.571595 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.571579 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.574530 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.574504 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 29 10:05:16.574530 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.574511 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 29 10:05:16.574701 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.574642 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bnmjj1etttv0h\"" Jul 29 10:05:16.574701 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.574660 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 29 10:05:16.575154 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.575061 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 29 10:05:16.575154 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.575065 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gzdp8\"" Jul 29 10:05:16.575154 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.575113 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 29 10:05:16.670054 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.670026 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-grpc-tls\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.670211 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.670069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.670211 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.670098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xl4x\" (UniqueName: \"kubernetes.io/projected/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-kube-api-access-5xl4x\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.670211 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.670197 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-metrics-client-ca\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.670370 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.670243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.670370 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.670291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-tls\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.670370 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.670341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.670521 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.670373 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.740500 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.740415 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hfdm7" event={"ID":"f673db28-e353-4bdc-87ee-be9fee5676ca","Type":"ContainerStarted","Data":"66cacfba6bf516ca67ada3f00656cc16b556fea4beab0dc9303ed317c9bbfa36"} Jul 29 10:05:16.742351 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.742323 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerStarted","Data":"e08777f925215de26526848b6cfc5ce2d2aefcd56a4342af617c49435526859e"} Jul 29 10:05:16.744691 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.744567 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" event={"ID":"b1950b4b-53df-42d5-a339-23b887bc8c5c","Type":"ContainerStarted","Data":"82c0e0f40d49464142adf2e3b12f0badb6b5e2578fc403ccb42e26650f011af8"} Jul 29 10:05:16.744691 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.744628 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" event={"ID":"b1950b4b-53df-42d5-a339-23b887bc8c5c","Type":"ContainerStarted","Data":"c8055d832c35df6598b27daf9ce50326fc766a41c0d5fab62812e14fab3ed85c"} Jul 29 10:05:16.744691 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.744659 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" event={"ID":"b1950b4b-53df-42d5-a339-23b887bc8c5c","Type":"ContainerStarted","Data":"a425633e4397abbab71a8d86a711fcbd27f43bbb2f4cd26c97a7fb372fa57f17"} Jul 29 10:05:16.745908 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.745881 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" event={"ID":"2fbce395-c761-480c-a1e6-e6ae4ba653df","Type":"ContainerStarted","Data":"5a173df3c86801eb5014ab1d934e8737fe402439c8316f6858f4900bbd3e0e6e"} Jul 29 10:05:16.747425 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.747400 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5994fb8b68-wwwnv" event={"ID":"f6982956-2bee-4dca-b0b6-21cd95c0efb1","Type":"ContainerStarted","Data":"a0273ad163c9f851b122318783d3b22e91aae514b609d4fae7acc5892adc84ce"} Jul 29 10:05:16.748611 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.748586 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p5gkv" event={"ID":"95855b9d-6612-4182-9ad0-8ea89de5f1c9","Type":"ContainerStarted","Data":"1fede5e2e281e589eb0f38e873a17960a67670be3a61ad7a1984705136c6bae9"} Jul 29 10:05:16.762718 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.762499 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hfdm7" podStartSLOduration=1.9016212860000001 podStartE2EDuration="16.762478755s" totalImagesPullingTime="14.860857469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:05:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:16.760227922 +0000 UTC m=+65.881021315" watchObservedRunningTime="2026-07-29 10:05:16.762478755 +0000 UTC m=+65.883272150" Jul 29 10:05:16.771740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.771605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.771740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.771651 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xl4x\" (UniqueName: \"kubernetes.io/projected/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-kube-api-access-5xl4x\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.771740 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.771730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-metrics-client-ca\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.771959 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.771768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.771959 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.771811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-tls\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.771959 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.771845 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.771959 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.771883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.771959 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.771938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-grpc-tls\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.772652 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.772604 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-metrics-client-ca\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.775113 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.775052 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-grpc-tls\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.775591 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.775564 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.775686 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.775585 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.776472 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.776449 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.776472 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.776467 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-tls\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.777315 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.777282 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.783911 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.783875 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xl4x\" (UniqueName: \"kubernetes.io/projected/19fe0bcf-51c7-4f16-af1d-1dc958d5e75c-kube-api-access-5xl4x\") pod \"thanos-querier-5d9dd7f9cb-mtvkp\" (UID: \"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c\") " pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:16.883563 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:16.883533 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:17.072020 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.071927 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp"] Jul 29 10:05:17.074343 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.074319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs\") pod \"network-metrics-daemon-bgz7n\" (UID: \"abc91ee3-5c70-4596-b6ca-bb8778025009\") " pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:05:17.074590 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.074476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:05:17.077401 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.077350 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 10:05:17.077401 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.077395 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 10:05:17.088052 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.088005 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc91ee3-5c70-4596-b6ca-bb8778025009-metrics-certs\") pod \"network-metrics-daemon-bgz7n\" (UID: \"abc91ee3-5c70-4596-b6ca-bb8778025009\") " pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:05:17.088145 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.088059 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c70c9c83-ba38-4fcb-ad4e-1532b36229ed-original-pull-secret\") pod \"global-pull-secret-syncer-jp7ll\" (UID: \"c70c9c83-ba38-4fcb-ad4e-1532b36229ed\") " pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:05:17.105304 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.105104 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jp7ll" Jul 29 10:05:17.113605 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.113500 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nxwvh\"" Jul 29 10:05:17.121245 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.121225 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgz7n" Jul 29 10:05:17.175370 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.175345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p87h2\" (UniqueName: \"kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2\") pod \"network-check-target-vff5m\" (UID: \"89ff5119-9ac3-4530-999d-96605fafbd39\") " pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:05:17.178712 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.178689 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 10:05:17.190724 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.190525 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 10:05:17.201063 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.201008 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p87h2\" (UniqueName: \"kubernetes.io/projected/89ff5119-9ac3-4530-999d-96605fafbd39-kube-api-access-p87h2\") pod \"network-check-target-vff5m\" (UID: \"89ff5119-9ac3-4530-999d-96605fafbd39\") " pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:05:17.419045 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.418957 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x9kk4\"" Jul 29 10:05:17.431219 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.426779 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:05:17.464369 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:17.464291 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19fe0bcf_51c7_4f16_af1d_1dc958d5e75c.slice/crio-3d9b8391ac766d4ddb20399cd2e06055c93531ff61b3138a7a6a72cb3a29ae02 WatchSource:0}: Error finding container 3d9b8391ac766d4ddb20399cd2e06055c93531ff61b3138a7a6a72cb3a29ae02: Status 404 returned error can't find the container with id 3d9b8391ac766d4ddb20399cd2e06055c93531ff61b3138a7a6a72cb3a29ae02 Jul 29 10:05:17.533355 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.533305 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:17.639256 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.639142 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:17.717714 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.717633 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bgz7n"] Jul 29 10:05:17.721634 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.721552 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:17.736693 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.736665 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jp7ll"] Jul 29 10:05:17.759526 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.758729 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p5gkv" event={"ID":"95855b9d-6612-4182-9ad0-8ea89de5f1c9","Type":"ContainerStarted","Data":"0ec9aee7575db2bcb2cb7d79b25e36f0d9deb4e179d5e6dc7e39de401eec550a"} Jul 29 10:05:17.762492 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.762398 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" event={"ID":"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c","Type":"ContainerStarted","Data":"3d9b8391ac766d4ddb20399cd2e06055c93531ff61b3138a7a6a72cb3a29ae02"} Jul 29 10:05:17.945309 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.945235 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vff5m"] Jul 29 10:05:17.950142 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:17.950110 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:18.153835 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:18.153751 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc91ee3_5c70_4596_b6ca_bb8778025009.slice/crio-ea73aa9292103383e99ec56019996cbd4387a8d597664f699a2ade9aff0057e4 WatchSource:0}: Error finding container ea73aa9292103383e99ec56019996cbd4387a8d597664f699a2ade9aff0057e4: Status 404 returned error can't find the container with id ea73aa9292103383e99ec56019996cbd4387a8d597664f699a2ade9aff0057e4 Jul 29 10:05:18.154940 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:18.154912 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ff5119_9ac3_4530_999d_96605fafbd39.slice/crio-383ef3cec9f7997e602c3b6bfda2dc60f62697bed33fdf8232165b501e9ad000 WatchSource:0}: Error finding container 383ef3cec9f7997e602c3b6bfda2dc60f62697bed33fdf8232165b501e9ad000: Status 404 returned error can't find the container with id 383ef3cec9f7997e602c3b6bfda2dc60f62697bed33fdf8232165b501e9ad000 Jul 29 10:05:18.424643 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:18.424564 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70c9c83_ba38_4fcb_ad4e_1532b36229ed.slice/crio-98126ab693545ae2c06e16dc081f006b93ad5752747134d603d3d270676ac71b WatchSource:0}: Error finding container 98126ab693545ae2c06e16dc081f006b93ad5752747134d603d3d270676ac71b: Status 404 returned error can't find the container with id 98126ab693545ae2c06e16dc081f006b93ad5752747134d603d3d270676ac71b Jul 29 10:05:18.773782 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:18.773729 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jp7ll" event={"ID":"c70c9c83-ba38-4fcb-ad4e-1532b36229ed","Type":"ContainerStarted","Data":"98126ab693545ae2c06e16dc081f006b93ad5752747134d603d3d270676ac71b"} Jul 29 10:05:18.777854 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:18.777792 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgz7n" event={"ID":"abc91ee3-5c70-4596-b6ca-bb8778025009","Type":"ContainerStarted","Data":"ea73aa9292103383e99ec56019996cbd4387a8d597664f699a2ade9aff0057e4"} Jul 29 10:05:18.781741 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:18.781719 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vff5m" event={"ID":"89ff5119-9ac3-4530-999d-96605fafbd39","Type":"ContainerStarted","Data":"383ef3cec9f7997e602c3b6bfda2dc60f62697bed33fdf8232165b501e9ad000"} Jul 29 10:05:18.854440 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:18.854410 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-877fd99b-2hwqx"] Jul 29 10:05:18.859526 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:18.858484 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:18.863054 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:18.863027 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 29 10:05:18.863296 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:18.863275 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9j839bo7ofcnn\"" Jul 29 10:05:18.863401 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:18.863359 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 29 10:05:18.863532 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:18.863417 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 29 10:05:18.863532 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:18.863483 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xfs86\"" Jul 29 10:05:18.863804 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:18.863785 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 10:05:18.868829 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:18.868736 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-877fd99b-2hwqx"] Jul 29 10:05:19.017301 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.016914 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c025de3d-99a8-45ea-862e-cecd07377c52-client-ca-bundle\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.017301 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.016961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c025de3d-99a8-45ea-862e-cecd07377c52-metrics-server-audit-profiles\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.017301 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.017011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c025de3d-99a8-45ea-862e-cecd07377c52-audit-log\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.017301 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.017057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c025de3d-99a8-45ea-862e-cecd07377c52-secret-metrics-server-tls\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.017301 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.017084 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c025de3d-99a8-45ea-862e-cecd07377c52-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.017301 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.017111 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c025de3d-99a8-45ea-862e-cecd07377c52-secret-metrics-server-client-certs\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.017301 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.017142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzl82\" (UniqueName: \"kubernetes.io/projected/c025de3d-99a8-45ea-862e-cecd07377c52-kube-api-access-lzl82\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.119268 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.118688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c025de3d-99a8-45ea-862e-cecd07377c52-secret-metrics-server-client-certs\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.119268 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.118728 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzl82\" (UniqueName: \"kubernetes.io/projected/c025de3d-99a8-45ea-862e-cecd07377c52-kube-api-access-lzl82\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.119268 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.118827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c025de3d-99a8-45ea-862e-cecd07377c52-client-ca-bundle\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.119268 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.118857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c025de3d-99a8-45ea-862e-cecd07377c52-metrics-server-audit-profiles\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.119268 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.118887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c025de3d-99a8-45ea-862e-cecd07377c52-audit-log\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.119268 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.118924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c025de3d-99a8-45ea-862e-cecd07377c52-secret-metrics-server-tls\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.119660 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.119299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c025de3d-99a8-45ea-862e-cecd07377c52-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.119660 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.119601 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c025de3d-99a8-45ea-862e-cecd07377c52-audit-log\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.120513 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.120456 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c025de3d-99a8-45ea-862e-cecd07377c52-metrics-server-audit-profiles\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.120513 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.120469 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c025de3d-99a8-45ea-862e-cecd07377c52-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.122626 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.122602 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c025de3d-99a8-45ea-862e-cecd07377c52-client-ca-bundle\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.123059 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.123037 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c025de3d-99a8-45ea-862e-cecd07377c52-secret-metrics-server-tls\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.123923 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.123874 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c025de3d-99a8-45ea-862e-cecd07377c52-secret-metrics-server-client-certs\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.130659 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.130617 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzl82\" (UniqueName: \"kubernetes.io/projected/c025de3d-99a8-45ea-862e-cecd07377c52-kube-api-access-lzl82\") pod \"metrics-server-877fd99b-2hwqx\" (UID: \"c025de3d-99a8-45ea-862e-cecd07377c52\") " pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.188002 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.187668 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:19.272811 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.272737 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:19.287712 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.286373 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5"] Jul 29 10:05:19.289664 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.289098 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5" Jul 29 10:05:19.293641 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.293418 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-d28qt\"" Jul 29 10:05:19.294870 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.294226 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 29 10:05:19.303389 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.302272 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5"] Jul 29 10:05:19.356393 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.356326 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:19.422859 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.422779 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntphh\" (UniqueName: \"kubernetes.io/projected/044ff117-dade-48f3-bd1e-fa5de90bcddc-kube-api-access-ntphh\") pod \"monitoring-plugin-68b7fc9574-sw4q5\" (UID: \"044ff117-dade-48f3-bd1e-fa5de90bcddc\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5" Jul 29 10:05:19.422859 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.422834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/044ff117-dade-48f3-bd1e-fa5de90bcddc-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sw4q5\" (UID: \"044ff117-dade-48f3-bd1e-fa5de90bcddc\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5" Jul 29 10:05:19.492814 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.492730 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:19.524355 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.524316 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntphh\" (UniqueName: \"kubernetes.io/projected/044ff117-dade-48f3-bd1e-fa5de90bcddc-kube-api-access-ntphh\") pod \"monitoring-plugin-68b7fc9574-sw4q5\" (UID: \"044ff117-dade-48f3-bd1e-fa5de90bcddc\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5" Jul 29 10:05:19.524516 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.524375 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/044ff117-dade-48f3-bd1e-fa5de90bcddc-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sw4q5\" (UID: \"044ff117-dade-48f3-bd1e-fa5de90bcddc\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5" Jul 29 10:05:19.524590 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:05:19.524520 2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 29 10:05:19.524637 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:05:19.524595 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044ff117-dade-48f3-bd1e-fa5de90bcddc-monitoring-plugin-cert podName:044ff117-dade-48f3-bd1e-fa5de90bcddc nodeName:}" failed. No retries permitted until 2026-07-29 10:05:20.024570776 +0000 UTC m=+69.145364148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/044ff117-dade-48f3-bd1e-fa5de90bcddc-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-sw4q5" (UID: "044ff117-dade-48f3-bd1e-fa5de90bcddc") : secret "monitoring-plugin-cert" not found Jul 29 10:05:19.542230 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.542167 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntphh\" (UniqueName: \"kubernetes.io/projected/044ff117-dade-48f3-bd1e-fa5de90bcddc-kube-api-access-ntphh\") pod \"monitoring-plugin-68b7fc9574-sw4q5\" (UID: \"044ff117-dade-48f3-bd1e-fa5de90bcddc\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5" Jul 29 10:05:19.590979 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.590910 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:19.647649 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.647569 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:19.787832 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.787737 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" event={"ID":"2fbce395-c761-480c-a1e6-e6ae4ba653df","Type":"ContainerStarted","Data":"30a311d5d4722346094db757b1311586b0dd65e19073414a200f998400ad9ee0"} Jul 29 10:05:19.790150 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.790122 2577 generic.go:356] "Generic (PLEG): container finished" podID="95855b9d-6612-4182-9ad0-8ea89de5f1c9" containerID="0ec9aee7575db2bcb2cb7d79b25e36f0d9deb4e179d5e6dc7e39de401eec550a" exitCode=0 Jul 29 10:05:19.790486 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.790462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p5gkv" event={"ID":"95855b9d-6612-4182-9ad0-8ea89de5f1c9","Type":"ContainerDied","Data":"0ec9aee7575db2bcb2cb7d79b25e36f0d9deb4e179d5e6dc7e39de401eec550a"} Jul 29 10:05:19.792868 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.792839 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerStarted","Data":"1404c2ba78d767b0abc38aaabab1ba241e485324751b09c03c13f8849d8c9220"} Jul 29 10:05:19.795972 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.795947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" event={"ID":"b1950b4b-53df-42d5-a339-23b887bc8c5c","Type":"ContainerStarted","Data":"058faaea288ac7587f56b6ee657de6f3cb91376e405bcc9d0aacdde0b6b4b9f4"} Jul 29 10:05:19.824876 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.824843 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:19.871702 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:19.871040 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8c9dd" podStartSLOduration=3.501983753 podStartE2EDuration="5.871016635s" totalImagesPullingTime="2.369032882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:19.829137338 +0000 UTC m=+68.949930732" watchObservedRunningTime="2026-07-29 10:05:19.871016635 +0000 UTC m=+68.991810008" Jul 29 10:05:20.025408 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.025366 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:20.029289 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.029259 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/044ff117-dade-48f3-bd1e-fa5de90bcddc-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sw4q5\" (UID: \"044ff117-dade-48f3-bd1e-fa5de90bcddc\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5" Jul 29 10:05:20.032229 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.032205 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/044ff117-dade-48f3-bd1e-fa5de90bcddc-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sw4q5\" (UID: \"044ff117-dade-48f3-bd1e-fa5de90bcddc\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5" Jul 29 10:05:20.204716 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.204681 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5" Jul 29 10:05:20.816462 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.812758 2577 generic.go:356] "Generic (PLEG): container finished" podID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerID="1404c2ba78d767b0abc38aaabab1ba241e485324751b09c03c13f8849d8c9220" exitCode=0 Jul 29 10:05:20.816462 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.814035 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerDied","Data":"1404c2ba78d767b0abc38aaabab1ba241e485324751b09c03c13f8849d8c9220"} Jul 29 10:05:20.845245 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.845203 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 10:05:20.849053 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.848937 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:20.853592 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.853568 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.857132 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.857113 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z4f86\"" Jul 29 10:05:20.860437 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.860414 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 10:05:20.860880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.860861 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 10:05:20.861079 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.861063 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 10:05:20.861282 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.861227 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 10:05:20.861404 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.861388 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 10:05:20.863044 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.861615 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 10:05:20.863044 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.861679 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 10:05:20.863044 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.861763 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 10:05:20.863044 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.861825 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 10:05:20.863044 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.861905 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 10:05:20.863044 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.861908 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 10:05:20.863044 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.863011 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 10:05:20.865610 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.863951 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-534b36ajtrki9\"" Jul 29 10:05:20.865610 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.864075 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 10:05:20.865610 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.864163 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 10:05:20.879411 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.879360 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 10:05:20.938493 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.938407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grxmv\" (UniqueName: \"kubernetes.io/projected/27b27049-63d5-45d8-95a7-4c756f9e2c9e-kube-api-access-grxmv\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.938730 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.938706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27b27049-63d5-45d8-95a7-4c756f9e2c9e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.938819 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.938804 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.938880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.938836 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.938880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.938873 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939010 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.938925 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939010 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.938951 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939119 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.939007 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939119 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.939085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939221 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.939180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939275 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.939222 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27b27049-63d5-45d8-95a7-4c756f9e2c9e-config-out\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939275 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.939248 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939381 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.939272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939381 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.939314 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939381 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.939371 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-config\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939521 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.939397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-web-config\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939521 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.939447 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939521 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.939474 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939521 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.939516 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:20.939712 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:20.939549 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.001640 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.001561 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:21.040373 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.040304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.041477 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.040711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.041477 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.040756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.041477 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.040780 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.041477 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.040817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.041477 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.040860 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.041477 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.040898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.041477 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.040924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27b27049-63d5-45d8-95a7-4c756f9e2c9e-config-out\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.041477 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.040947 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.041477 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.040971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.041477 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.041354 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.041477 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.041461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-config\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.041477 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.041488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-web-config\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.042228 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.041519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.042228 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.041550 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.042228 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.041581 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.042228 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.041612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.042228 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.041658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grxmv\" (UniqueName: \"kubernetes.io/projected/27b27049-63d5-45d8-95a7-4c756f9e2c9e-kube-api-access-grxmv\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.042228 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.041778 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27b27049-63d5-45d8-95a7-4c756f9e2c9e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.042228 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.041843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.042667 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.042297 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.042667 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.042303 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.044773 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.044488 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.045119 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.044876 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.046286 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.045368 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.046286 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.046038 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.046286 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.046096 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.047898 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.047857 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.048869 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.048846 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27b27049-63d5-45d8-95a7-4c756f9e2c9e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.050742 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.050709 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27b27049-63d5-45d8-95a7-4c756f9e2c9e-config-out\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.051535 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.051493 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.051632 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.051590 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.052391 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.052345 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.052515 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.052492 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-config\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.052665 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.052590 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-web-config\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.053062 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.053013 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.053289 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.053246 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.054793 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.054756 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.055694 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.055656 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.056393 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.056321 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grxmv\" (UniqueName: \"kubernetes.io/projected/27b27049-63d5-45d8-95a7-4c756f9e2c9e-kube-api-access-grxmv\") pod \"prometheus-k8s-0\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:21.103526 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.103483 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:21.175027 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:21.174978 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:22.164060 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:22.164020 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:22.273855 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:22.273822 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:22.364318 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:22.364265 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:23.854005 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:23.853944 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:23.954592 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:23.954562 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:26.130168 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:26.130132 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:26.183037 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:26.183007 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:29.280178 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:29.280093 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:29.376383 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:29.376349 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:30.646164 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:30.646139 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5"] Jul 29 10:05:31.370288 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:31.370248 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:31.441334 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:31.441243 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:31.891951 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:31.891883 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:31.955885 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:31.955853 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:32.155610 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:32.155538 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-877fd99b-2hwqx"] Jul 29 10:05:32.461103 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:32.461065 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044ff117_dade_48f3_bd1e_fa5de90bcddc.slice/crio-62b43ed395e3da6ce86b62c0f95dc990679f0a3d5452371b96248f112334f9a7 WatchSource:0}: Error finding container 62b43ed395e3da6ce86b62c0f95dc990679f0a3d5452371b96248f112334f9a7: Status 404 returned error can't find the container with id 62b43ed395e3da6ce86b62c0f95dc990679f0a3d5452371b96248f112334f9a7 Jul 29 10:05:32.854236 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:32.854145 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:32.861662 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:32.861637 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5" event={"ID":"044ff117-dade-48f3-bd1e-fa5de90bcddc","Type":"ContainerStarted","Data":"62b43ed395e3da6ce86b62c0f95dc990679f0a3d5452371b96248f112334f9a7"} Jul 29 10:05:32.912036 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:32.912000 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:32.925634 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:32.925567 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc025de3d_99a8_45ea_862e_cecd07377c52.slice/crio-cc5c37b14b82d00869612179479e23663824689012f844b94c4c2042cfa79837 WatchSource:0}: Error finding container cc5c37b14b82d00869612179479e23663824689012f844b94c4c2042cfa79837: Status 404 returned error can't find the container with id cc5c37b14b82d00869612179479e23663824689012f844b94c4c2042cfa79837 Jul 29 10:05:33.084505 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.084481 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 10:05:33.336727 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:05:33.336695 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b27049_63d5_45d8_95a7_4c756f9e2c9e.slice/crio-4d50acbfcd1cdd7cb71562ff1531f4814b07e838d9a987168a92dbfb7506ab97 WatchSource:0}: Error finding container 4d50acbfcd1cdd7cb71562ff1531f4814b07e838d9a987168a92dbfb7506ab97: Status 404 returned error can't find the container with id 4d50acbfcd1cdd7cb71562ff1531f4814b07e838d9a987168a92dbfb7506ab97 Jul 29 10:05:33.869744 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.869707 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5994fb8b68-wwwnv" event={"ID":"f6982956-2bee-4dca-b0b6-21cd95c0efb1","Type":"ContainerStarted","Data":"ffc020b3bb068c64923f4e46b6955ae0b37a50e0f47268f65324fc603f5213f8"} Jul 29 10:05:33.871577 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.871553 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-zj5jk" event={"ID":"4272ab48-a027-4870-b2e4-36707a0caa75","Type":"ContainerStarted","Data":"401b6b995759113057cf23b5f14cb908f24eb8127e725db67d9c8b7c06dba388"} Jul 29 10:05:33.871703 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.871596 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-zj5jk" Jul 29 10:05:33.873426 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.873399 2577 patch_prober.go:28] interesting pod/downloads-7c97dc4555-zj5jk container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused" start-of-body= Jul 29 10:05:33.873539 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.873452 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-zj5jk" podUID="4272ab48-a027-4870-b2e4-36707a0caa75" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused" Jul 29 10:05:33.875221 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.875193 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" event={"ID":"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c","Type":"ContainerStarted","Data":"3231254c2f2ed32366682885b9745a0d57a81fad0a1a80b9ae394fed7c2dfff4"} Jul 29 10:05:33.875399 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.875356 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" event={"ID":"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c","Type":"ContainerStarted","Data":"d83a5233dec0bc1e7e459e1eb3a7cfc0368e5e416d0d1fb1a9fc71749bfffb96"} Jul 29 10:05:33.875470 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.875438 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" event={"ID":"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c","Type":"ContainerStarted","Data":"2e677e1cf7f0e18417e4971ea9ce5982af6254f3ffcfa7f789f0e2baa8749ef8"} Jul 29 10:05:33.878147 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.877970 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerStarted","Data":"3d181b2fe9950ec93bfc84e9d0108741f077c9a1f9e231be8548d870f0a1fcfe"} Jul 29 10:05:33.878147 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.878056 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerStarted","Data":"8986cae956ad890dbcc310dec20e5b48e584c035e4b871eb8e75c65be8e341d0"} Jul 29 10:05:33.878147 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.878099 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerStarted","Data":"c3c2c2e1b1689159ec55a630d66f7a7467622718bbb7b2cdb5c4e9f5a30cd369"} Jul 29 10:05:33.879488 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.879461 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" event={"ID":"c025de3d-99a8-45ea-862e-cecd07377c52","Type":"ContainerStarted","Data":"cc5c37b14b82d00869612179479e23663824689012f844b94c4c2042cfa79837"} Jul 29 10:05:33.882431 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.882408 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" event={"ID":"2fbce395-c761-480c-a1e6-e6ae4ba653df","Type":"ContainerStarted","Data":"724973fbdb82508c7ac6d123d25d905b6cc7ad179e313b421073d116c04b6e32"} Jul 29 10:05:33.882538 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.882460 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" event={"ID":"2fbce395-c761-480c-a1e6-e6ae4ba653df","Type":"ContainerStarted","Data":"34603c9d19ef2f9675256be2d39f3593022789ad8f21265b81a7210f8ecf3085"} Jul 29 10:05:33.884747 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.884722 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vff5m" event={"ID":"89ff5119-9ac3-4530-999d-96605fafbd39","Type":"ContainerStarted","Data":"a12ca4eb48a2b02b385791da31a40e1d955ccd7ef0f76e3849315f1dc00ebd90"} Jul 29 10:05:33.884836 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.884773 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:05:33.888158 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.888134 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p5gkv" event={"ID":"95855b9d-6612-4182-9ad0-8ea89de5f1c9","Type":"ContainerStarted","Data":"67032d2bc9cd9e5d132b00b3c59e74bade89cb07ebf055f0a1cc821c95eb1477"} Jul 29 10:05:33.889745 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.889734 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p5gkv" event={"ID":"95855b9d-6612-4182-9ad0-8ea89de5f1c9","Type":"ContainerStarted","Data":"eae99f3af5fbd4d042f51db304af68033c2b3a03ee63cd6a4d3fd15dc156bf36"} Jul 29 10:05:33.890285 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.889633 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5994fb8b68-wwwnv" podStartSLOduration=5.598347537 podStartE2EDuration="19.889614887s" totalImagesPullingTime="14.29126735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:33.888658347 +0000 UTC m=+83.009451742" watchObservedRunningTime="2026-07-29 10:05:33.889614887 +0000 UTC m=+83.010408279" Jul 29 10:05:33.893019 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.892115 2577 generic.go:356] "Generic (PLEG): container finished" podID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerID="251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e" exitCode=0 Jul 29 10:05:33.893019 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.892868 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerDied","Data":"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e"} Jul 29 10:05:33.893019 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.892941 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerStarted","Data":"4d50acbfcd1cdd7cb71562ff1531f4814b07e838d9a987168a92dbfb7506ab97"} Jul 29 10:05:33.895951 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.895926 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jp7ll" event={"ID":"c70c9c83-ba38-4fcb-ad4e-1532b36229ed","Type":"ContainerStarted","Data":"a32eeec7c6cb591750def0a883d7a91fcd86b6204ae181f54762d2c2dfbdda3e"} Jul 29 10:05:33.898719 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.898549 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgz7n" event={"ID":"abc91ee3-5c70-4596-b6ca-bb8778025009","Type":"ContainerStarted","Data":"5a157eb26b0a07408b77dfab04626068240a98cbda5679ec1b42a5106a3ec9b5"} Jul 29 10:05:33.898719 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.898593 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgz7n" event={"ID":"abc91ee3-5c70-4596-b6ca-bb8778025009","Type":"ContainerStarted","Data":"0ef2aecf26285d8be5fe31f79a47d7402f5f9e0c384ed9b7ad98ddbdc57b3754"} Jul 29 10:05:33.911500 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.911432 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w5tkj" podStartSLOduration=17.269360899 podStartE2EDuration="19.911411924s" totalImagesPullingTime="2.642051025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:33.909294605 +0000 UTC m=+83.030088046" watchObservedRunningTime="2026-07-29 10:05:33.911411924 +0000 UTC m=+83.032205317" Jul 29 10:05:33.948143 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.948096 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vff5m" podStartSLOduration=67.749070373 podStartE2EDuration="1m22.948080428s" totalImagesPullingTime="15.199010055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:33.9277941 +0000 UTC m=+83.048587492" watchObservedRunningTime="2026-07-29 10:05:33.948080428 +0000 UTC m=+83.068873820" Jul 29 10:05:33.948545 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.948511 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-zj5jk" podStartSLOduration=4.22215955 podStartE2EDuration="29.948502498s" totalImagesPullingTime="25.726342948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:33.947075116 +0000 UTC m=+83.067868512" watchObservedRunningTime="2026-07-29 10:05:33.948502498 +0000 UTC m=+83.069295895" Jul 29 10:05:33.966029 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.965886 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bgz7n" podStartSLOduration=67.700492887 podStartE2EDuration="1m22.965867963s" totalImagesPullingTime="15.265375076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:33.964964011 +0000 UTC m=+83.085757403" watchObservedRunningTime="2026-07-29 10:05:33.965867963 +0000 UTC m=+83.086661357" Jul 29 10:05:33.988456 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:33.988402 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p5gkv" podStartSLOduration=18.262212172 podStartE2EDuration="19.988386338s" totalImagesPullingTime="1.607630157s" totalInitContainerRuntime="118.544009ms" isStatefulPod=true podCreationTimestamp="2026-07-29 10:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:33.986511701 +0000 UTC m=+83.107305097" watchObservedRunningTime="2026-07-29 10:05:33.988386338 +0000 UTC m=+83.109179730" Jul 29 10:05:34.006318 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:34.006175 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jp7ll" podStartSLOduration=68.018115026 podStartE2EDuration="1m23.006153839s" totalImagesPullingTime="14.988038813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:34.004933123 +0000 UTC m=+83.125726517" watchObservedRunningTime="2026-07-29 10:05:34.006153839 +0000 UTC m=+83.126947233" Jul 29 10:05:34.073376 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:34.073337 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:34.170631 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:34.170536 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:34.240479 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:34.240400 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:34.914229 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:34.914039 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerStarted","Data":"64151eb3b96b96df4eb091ef859d8cf114b94520910e17300c300d2c6228a786"} Jul 29 10:05:34.914229 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:34.914117 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerStarted","Data":"9c733209a63da7d8c42d321404900c604569860e71b5eb63268580706d8fb2e9"} Jul 29 10:05:34.930602 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:34.929218 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-zj5jk" Jul 29 10:05:34.994124 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:34.994092 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5994fb8b68-wwwnv"] Jul 29 10:05:35.137006 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:35.129397 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:35.154866 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:35.153492 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:35.154866 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:35.153597 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:35.160679 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:35.160467 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:35.211004 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:35.210935 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:35.279272 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:35.279215 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:35.926451 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:35.926420 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:05:38.960974 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:38.960371 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" event={"ID":"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c","Type":"ContainerStarted","Data":"edc60eb31b920aa149c5031832c24f8c0509a9fd0839827ef9b55c615574ee6b"} Jul 29 10:05:38.968063 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:38.968032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerStarted","Data":"105dcf5091fab7be93812ff236c473d3d6e5e6bbd50b254420f6ce5d808d4ff0"} Jul 29 10:05:38.970129 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:38.970074 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" event={"ID":"c025de3d-99a8-45ea-862e-cecd07377c52","Type":"ContainerStarted","Data":"87d560ccfa390cd2af9a48b91831235f8f3acb727a941149576f147a0dfa164c"} Jul 29 10:05:38.972513 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:38.972147 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5" event={"ID":"044ff117-dade-48f3-bd1e-fa5de90bcddc","Type":"ContainerStarted","Data":"e7ec98da8e19a88be968222e48de666c9f1d718d3910752f20a1f516e69eb13b"} Jul 29 10:05:38.972624 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:38.972589 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5" Jul 29 10:05:38.979397 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:38.979160 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5" Jul 29 10:05:38.999615 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:38.999517 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.229531151 podStartE2EDuration="23.999498275s" totalImagesPullingTime="19.746300102s" totalInitContainerRuntime="23.667022ms" isStatefulPod=false podCreationTimestamp="2026-07-29 10:05:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:38.99796706 +0000 UTC m=+88.118760454" watchObservedRunningTime="2026-07-29 10:05:38.999498275 +0000 UTC m=+88.120291670" Jul 29 10:05:39.022821 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:39.019468 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sw4q5" podStartSLOduration=13.751157279 podStartE2EDuration="20.019449374s" totalImagesPullingTime="6.268292095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:39.018776372 +0000 UTC m=+88.139569763" watchObservedRunningTime="2026-07-29 10:05:39.019449374 +0000 UTC m=+88.140242759" Jul 29 10:05:39.188496 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:39.188407 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:39.188496 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:39.188471 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:39.982177 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:39.982137 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" event={"ID":"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c","Type":"ContainerStarted","Data":"33ff894c2f59551c611981835bf13ffa79ac540a5f691829366b462e29c217f7"} Jul 29 10:05:39.982712 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:39.982225 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" event={"ID":"19fe0bcf-51c7-4f16-af1d-1dc958d5e75c","Type":"ContainerStarted","Data":"618ffcda2fbe582ed1be953a0052f2f89ecde51f94c1c51eaea97d066be22bfc"} Jul 29 10:05:39.982712 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:39.982539 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:39.986434 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:39.986408 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerStarted","Data":"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6"} Jul 29 10:05:39.986561 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:39.986478 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerStarted","Data":"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee"} Jul 29 10:05:39.986561 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:39.986515 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerStarted","Data":"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9"} Jul 29 10:05:39.986561 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:39.986552 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerStarted","Data":"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997"} Jul 29 10:05:39.986746 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:39.986588 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerStarted","Data":"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27"} Jul 29 10:05:39.986746 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:39.986628 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerStarted","Data":"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213"} Jul 29 10:05:39.990086 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:39.990064 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" Jul 29 10:05:40.008011 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:40.006664 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" podStartSLOduration=16.656998076 podStartE2EDuration="22.006646938s" totalImagesPullingTime="5.349648862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:39.044772033 +0000 UTC m=+88.165565429" watchObservedRunningTime="2026-07-29 10:05:40.006646938 +0000 UTC m=+89.127440334" Jul 29 10:05:40.008160 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:40.008100 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5d9dd7f9cb-mtvkp" podStartSLOduration=3.219957108 podStartE2EDuration="24.008088609s" totalImagesPullingTime="20.788131501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:05:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:40.005861227 +0000 UTC m=+89.126654613" watchObservedRunningTime="2026-07-29 10:05:40.008088609 +0000 UTC m=+89.128882003" Jul 29 10:05:40.061810 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:40.061750 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=15.188786396 podStartE2EDuration="20.061729699s" totalImagesPullingTime="4.846097386s" totalInitContainerRuntime="26.845917ms" isStatefulPod=false podCreationTimestamp="2026-07-29 10:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:05:40.058496875 +0000 UTC m=+89.179290272" watchObservedRunningTime="2026-07-29 10:05:40.061729699 +0000 UTC m=+89.182523094" Jul 29 10:05:40.302478 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:40.302394 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:41.175687 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:41.175650 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:05:44.274464 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:44.274431 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:44.345445 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:44.345411 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:05:59.194109 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:59.194078 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:05:59.198554 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:05:59.198529 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-877fd99b-2hwqx" Jul 29 10:06:00.949679 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:00.949613 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5994fb8b68-wwwnv" podUID="f6982956-2bee-4dca-b0b6-21cd95c0efb1" containerName="console" containerID="cri-o://ffc020b3bb068c64923f4e46b6955ae0b37a50e0f47268f65324fc603f5213f8" gracePeriod=15 Jul 29 10:06:01.076957 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.076918 2577 generic.go:356] "Generic (PLEG): container finished" podID="f6982956-2bee-4dca-b0b6-21cd95c0efb1" containerID="ffc020b3bb068c64923f4e46b6955ae0b37a50e0f47268f65324fc603f5213f8" exitCode=0 Jul 29 10:06:01.077111 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.076968 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5994fb8b68-wwwnv" event={"ID":"f6982956-2bee-4dca-b0b6-21cd95c0efb1","Type":"ContainerDied","Data":"ffc020b3bb068c64923f4e46b6955ae0b37a50e0f47268f65324fc603f5213f8"} Jul 29 10:06:01.274041 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.274013 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:06:01.410856 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.409962 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-config\") pod \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " Jul 29 10:06:01.410856 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.410033 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-serving-cert\") pod \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " Jul 29 10:06:01.410856 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.410060 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-oauth-serving-cert\") pod \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " Jul 29 10:06:01.410856 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.410128 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-service-ca\") pod \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " Jul 29 10:06:01.410856 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.410163 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qkbv\" (UniqueName: \"kubernetes.io/projected/f6982956-2bee-4dca-b0b6-21cd95c0efb1-kube-api-access-6qkbv\") pod \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " Jul 29 10:06:01.410856 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.410259 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-oauth-config\") pod \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\" (UID: \"f6982956-2bee-4dca-b0b6-21cd95c0efb1\") " Jul 29 10:06:01.411661 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.411632 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f6982956-2bee-4dca-b0b6-21cd95c0efb1" (UID: "f6982956-2bee-4dca-b0b6-21cd95c0efb1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:06:01.411918 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.411879 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-service-ca" (OuterVolumeSpecName: "service-ca") pod "f6982956-2bee-4dca-b0b6-21cd95c0efb1" (UID: "f6982956-2bee-4dca-b0b6-21cd95c0efb1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:06:01.412107 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.412081 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-config" (OuterVolumeSpecName: "console-config") pod "f6982956-2bee-4dca-b0b6-21cd95c0efb1" (UID: "f6982956-2bee-4dca-b0b6-21cd95c0efb1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:06:01.417263 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.417212 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f6982956-2bee-4dca-b0b6-21cd95c0efb1" (UID: "f6982956-2bee-4dca-b0b6-21cd95c0efb1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:01.420373 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.420343 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6982956-2bee-4dca-b0b6-21cd95c0efb1-kube-api-access-6qkbv" (OuterVolumeSpecName: "kube-api-access-6qkbv") pod "f6982956-2bee-4dca-b0b6-21cd95c0efb1" (UID: "f6982956-2bee-4dca-b0b6-21cd95c0efb1"). InnerVolumeSpecName "kube-api-access-6qkbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:06:01.420464 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.420452 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f6982956-2bee-4dca-b0b6-21cd95c0efb1" (UID: "f6982956-2bee-4dca-b0b6-21cd95c0efb1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:01.511428 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.511392 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-oauth-config\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:01.511428 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.511424 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-config\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:01.511428 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.511434 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6982956-2bee-4dca-b0b6-21cd95c0efb1-console-serving-cert\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:01.511620 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.511445 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-oauth-serving-cert\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:01.511620 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.511466 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6982956-2bee-4dca-b0b6-21cd95c0efb1-service-ca\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:01.511620 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:01.511478 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qkbv\" (UniqueName: \"kubernetes.io/projected/f6982956-2bee-4dca-b0b6-21cd95c0efb1-kube-api-access-6qkbv\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:02.084670 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:02.084621 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5994fb8b68-wwwnv" event={"ID":"f6982956-2bee-4dca-b0b6-21cd95c0efb1","Type":"ContainerDied","Data":"a0273ad163c9f851b122318783d3b22e91aae514b609d4fae7acc5892adc84ce"} Jul 29 10:06:02.084670 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:02.084649 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5994fb8b68-wwwnv" Jul 29 10:06:02.085202 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:02.084725 2577 scope.go:117] "RemoveContainer" containerID="ffc020b3bb068c64923f4e46b6955ae0b37a50e0f47268f65324fc603f5213f8" Jul 29 10:06:02.106031 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:02.106005 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5994fb8b68-wwwnv"] Jul 29 10:06:02.110343 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:02.110316 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5994fb8b68-wwwnv"] Jul 29 10:06:03.496434 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:03.496402 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6982956-2bee-4dca-b0b6-21cd95c0efb1" path="/var/lib/kubelet/pods/f6982956-2bee-4dca-b0b6-21cd95c0efb1/volumes" Jul 29 10:06:04.919062 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:04.919038 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vff5m" Jul 29 10:06:21.175761 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:21.175728 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:21.237485 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:21.237460 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:22.177596 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:22.177574 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:33.881551 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:33.881507 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:06:34.326881 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:34.326847 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:06:34.959901 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:34.959867 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:06:34.960360 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:34.960180 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="alertmanager" containerID="cri-o://c3c2c2e1b1689159ec55a630d66f7a7467622718bbb7b2cdb5c4e9f5a30cd369" gracePeriod=120 Jul 29 10:06:34.960360 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:34.960283 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="kube-rbac-proxy-web" containerID="cri-o://3d181b2fe9950ec93bfc84e9d0108741f077c9a1f9e231be8548d870f0a1fcfe" gracePeriod=120 Jul 29 10:06:34.960360 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:34.960315 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="config-reloader" containerID="cri-o://8986cae956ad890dbcc310dec20e5b48e584c035e4b871eb8e75c65be8e341d0" gracePeriod=120 Jul 29 10:06:34.960532 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:34.960365 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="prom-label-proxy" containerID="cri-o://105dcf5091fab7be93812ff236c473d3d6e5e6bbd50b254420f6ce5d808d4ff0" gracePeriod=120 Jul 29 10:06:34.960532 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:34.960312 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="kube-rbac-proxy" containerID="cri-o://9c733209a63da7d8c42d321404900c604569860e71b5eb63268580706d8fb2e9" gracePeriod=120 Jul 29 10:06:34.960635 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:34.960265 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="kube-rbac-proxy-metric" containerID="cri-o://64151eb3b96b96df4eb091ef859d8cf114b94520910e17300c300d2c6228a786" gracePeriod=120 Jul 29 10:06:35.215993 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:35.215889 2577 generic.go:356] "Generic (PLEG): container finished" podID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerID="105dcf5091fab7be93812ff236c473d3d6e5e6bbd50b254420f6ce5d808d4ff0" exitCode=0 Jul 29 10:06:35.215993 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:35.215914 2577 generic.go:356] "Generic (PLEG): container finished" podID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerID="64151eb3b96b96df4eb091ef859d8cf114b94520910e17300c300d2c6228a786" exitCode=0 Jul 29 10:06:35.215993 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:35.215920 2577 generic.go:356] "Generic (PLEG): container finished" podID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerID="9c733209a63da7d8c42d321404900c604569860e71b5eb63268580706d8fb2e9" exitCode=0 Jul 29 10:06:35.215993 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:35.215926 2577 generic.go:356] "Generic (PLEG): container finished" podID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerID="8986cae956ad890dbcc310dec20e5b48e584c035e4b871eb8e75c65be8e341d0" exitCode=0 Jul 29 10:06:35.215993 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:35.215941 2577 generic.go:356] "Generic (PLEG): container finished" podID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerID="c3c2c2e1b1689159ec55a630d66f7a7467622718bbb7b2cdb5c4e9f5a30cd369" exitCode=0 Jul 29 10:06:35.215993 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:35.215969 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerDied","Data":"105dcf5091fab7be93812ff236c473d3d6e5e6bbd50b254420f6ce5d808d4ff0"} Jul 29 10:06:35.216348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:35.216063 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerDied","Data":"64151eb3b96b96df4eb091ef859d8cf114b94520910e17300c300d2c6228a786"} Jul 29 10:06:35.216348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:35.216103 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerDied","Data":"9c733209a63da7d8c42d321404900c604569860e71b5eb63268580706d8fb2e9"} Jul 29 10:06:35.216348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:35.216143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerDied","Data":"8986cae956ad890dbcc310dec20e5b48e584c035e4b871eb8e75c65be8e341d0"} Jul 29 10:06:35.216348 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:35.216181 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerDied","Data":"c3c2c2e1b1689159ec55a630d66f7a7467622718bbb7b2cdb5c4e9f5a30cd369"} Jul 29 10:06:36.221242 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.221215 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:36.222568 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.222548 2577 generic.go:356] "Generic (PLEG): container finished" podID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerID="3d181b2fe9950ec93bfc84e9d0108741f077c9a1f9e231be8548d870f0a1fcfe" exitCode=0 Jul 29 10:06:36.222652 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.222603 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerDied","Data":"3d181b2fe9950ec93bfc84e9d0108741f077c9a1f9e231be8548d870f0a1fcfe"} Jul 29 10:06:36.222698 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.222658 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b5c92eb2-d130-4116-a51d-57ff2a00b804","Type":"ContainerDied","Data":"e08777f925215de26526848b6cfc5ce2d2aefcd56a4342af617c49435526859e"} Jul 29 10:06:36.222698 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.222692 2577 scope.go:117] "RemoveContainer" containerID="105dcf5091fab7be93812ff236c473d3d6e5e6bbd50b254420f6ce5d808d4ff0" Jul 29 10:06:36.229783 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.229766 2577 scope.go:117] "RemoveContainer" containerID="64151eb3b96b96df4eb091ef859d8cf114b94520910e17300c300d2c6228a786" Jul 29 10:06:36.236369 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.236344 2577 scope.go:117] "RemoveContainer" containerID="9c733209a63da7d8c42d321404900c604569860e71b5eb63268580706d8fb2e9" Jul 29 10:06:36.243033 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.243013 2577 scope.go:117] "RemoveContainer" containerID="3d181b2fe9950ec93bfc84e9d0108741f077c9a1f9e231be8548d870f0a1fcfe" Jul 29 10:06:36.249311 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.249294 2577 scope.go:117] "RemoveContainer" containerID="8986cae956ad890dbcc310dec20e5b48e584c035e4b871eb8e75c65be8e341d0" Jul 29 10:06:36.256653 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.256624 2577 scope.go:117] "RemoveContainer" containerID="c3c2c2e1b1689159ec55a630d66f7a7467622718bbb7b2cdb5c4e9f5a30cd369" Jul 29 10:06:36.264226 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.264207 2577 scope.go:117] "RemoveContainer" containerID="1404c2ba78d767b0abc38aaabab1ba241e485324751b09c03c13f8849d8c9220" Jul 29 10:06:36.271044 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.271021 2577 scope.go:117] "RemoveContainer" containerID="105dcf5091fab7be93812ff236c473d3d6e5e6bbd50b254420f6ce5d808d4ff0" Jul 29 10:06:36.271316 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:06:36.271294 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"105dcf5091fab7be93812ff236c473d3d6e5e6bbd50b254420f6ce5d808d4ff0\": container with ID starting with 105dcf5091fab7be93812ff236c473d3d6e5e6bbd50b254420f6ce5d808d4ff0 not found: ID does not exist" containerID="105dcf5091fab7be93812ff236c473d3d6e5e6bbd50b254420f6ce5d808d4ff0" Jul 29 10:06:36.271400 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.271328 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"105dcf5091fab7be93812ff236c473d3d6e5e6bbd50b254420f6ce5d808d4ff0"} err="failed to get container status \"105dcf5091fab7be93812ff236c473d3d6e5e6bbd50b254420f6ce5d808d4ff0\": rpc error: code = NotFound desc = could not find container \"105dcf5091fab7be93812ff236c473d3d6e5e6bbd50b254420f6ce5d808d4ff0\": container with ID starting with 105dcf5091fab7be93812ff236c473d3d6e5e6bbd50b254420f6ce5d808d4ff0 not found: ID does not exist" Jul 29 10:06:36.271400 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.271369 2577 scope.go:117] "RemoveContainer" containerID="64151eb3b96b96df4eb091ef859d8cf114b94520910e17300c300d2c6228a786" Jul 29 10:06:36.271626 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:06:36.271596 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64151eb3b96b96df4eb091ef859d8cf114b94520910e17300c300d2c6228a786\": container with ID starting with 64151eb3b96b96df4eb091ef859d8cf114b94520910e17300c300d2c6228a786 not found: ID does not exist" containerID="64151eb3b96b96df4eb091ef859d8cf114b94520910e17300c300d2c6228a786" Jul 29 10:06:36.271706 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.271630 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64151eb3b96b96df4eb091ef859d8cf114b94520910e17300c300d2c6228a786"} err="failed to get container status \"64151eb3b96b96df4eb091ef859d8cf114b94520910e17300c300d2c6228a786\": rpc error: code = NotFound desc = could not find container \"64151eb3b96b96df4eb091ef859d8cf114b94520910e17300c300d2c6228a786\": container with ID starting with 64151eb3b96b96df4eb091ef859d8cf114b94520910e17300c300d2c6228a786 not found: ID does not exist" Jul 29 10:06:36.271706 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.271646 2577 scope.go:117] "RemoveContainer" containerID="9c733209a63da7d8c42d321404900c604569860e71b5eb63268580706d8fb2e9" Jul 29 10:06:36.271906 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:06:36.271883 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c733209a63da7d8c42d321404900c604569860e71b5eb63268580706d8fb2e9\": container with ID starting with 9c733209a63da7d8c42d321404900c604569860e71b5eb63268580706d8fb2e9 not found: ID does not exist" containerID="9c733209a63da7d8c42d321404900c604569860e71b5eb63268580706d8fb2e9" Jul 29 10:06:36.271959 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.271915 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c733209a63da7d8c42d321404900c604569860e71b5eb63268580706d8fb2e9"} err="failed to get container status \"9c733209a63da7d8c42d321404900c604569860e71b5eb63268580706d8fb2e9\": rpc error: code = NotFound desc = could not find container \"9c733209a63da7d8c42d321404900c604569860e71b5eb63268580706d8fb2e9\": container with ID starting with 9c733209a63da7d8c42d321404900c604569860e71b5eb63268580706d8fb2e9 not found: ID does not exist" Jul 29 10:06:36.271959 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.271943 2577 scope.go:117] "RemoveContainer" containerID="3d181b2fe9950ec93bfc84e9d0108741f077c9a1f9e231be8548d870f0a1fcfe" Jul 29 10:06:36.272288 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:06:36.272259 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d181b2fe9950ec93bfc84e9d0108741f077c9a1f9e231be8548d870f0a1fcfe\": container with ID starting with 3d181b2fe9950ec93bfc84e9d0108741f077c9a1f9e231be8548d870f0a1fcfe not found: ID does not exist" containerID="3d181b2fe9950ec93bfc84e9d0108741f077c9a1f9e231be8548d870f0a1fcfe" Jul 29 10:06:36.272288 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.272282 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d181b2fe9950ec93bfc84e9d0108741f077c9a1f9e231be8548d870f0a1fcfe"} err="failed to get container status \"3d181b2fe9950ec93bfc84e9d0108741f077c9a1f9e231be8548d870f0a1fcfe\": rpc error: code = NotFound desc = could not find container \"3d181b2fe9950ec93bfc84e9d0108741f077c9a1f9e231be8548d870f0a1fcfe\": container with ID starting with 3d181b2fe9950ec93bfc84e9d0108741f077c9a1f9e231be8548d870f0a1fcfe not found: ID does not exist" Jul 29 10:06:36.272419 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.272298 2577 scope.go:117] "RemoveContainer" containerID="8986cae956ad890dbcc310dec20e5b48e584c035e4b871eb8e75c65be8e341d0" Jul 29 10:06:36.272611 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:06:36.272574 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8986cae956ad890dbcc310dec20e5b48e584c035e4b871eb8e75c65be8e341d0\": container with ID starting with 8986cae956ad890dbcc310dec20e5b48e584c035e4b871eb8e75c65be8e341d0 not found: ID does not exist" containerID="8986cae956ad890dbcc310dec20e5b48e584c035e4b871eb8e75c65be8e341d0" Jul 29 10:06:36.272714 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.272617 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8986cae956ad890dbcc310dec20e5b48e584c035e4b871eb8e75c65be8e341d0"} err="failed to get container status \"8986cae956ad890dbcc310dec20e5b48e584c035e4b871eb8e75c65be8e341d0\": rpc error: code = NotFound desc = could not find container \"8986cae956ad890dbcc310dec20e5b48e584c035e4b871eb8e75c65be8e341d0\": container with ID starting with 8986cae956ad890dbcc310dec20e5b48e584c035e4b871eb8e75c65be8e341d0 not found: ID does not exist" Jul 29 10:06:36.272714 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.272639 2577 scope.go:117] "RemoveContainer" containerID="c3c2c2e1b1689159ec55a630d66f7a7467622718bbb7b2cdb5c4e9f5a30cd369" Jul 29 10:06:36.272931 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:06:36.272896 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c2c2e1b1689159ec55a630d66f7a7467622718bbb7b2cdb5c4e9f5a30cd369\": container with ID starting with c3c2c2e1b1689159ec55a630d66f7a7467622718bbb7b2cdb5c4e9f5a30cd369 not found: ID does not exist" containerID="c3c2c2e1b1689159ec55a630d66f7a7467622718bbb7b2cdb5c4e9f5a30cd369" Jul 29 10:06:36.273043 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.272925 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c2c2e1b1689159ec55a630d66f7a7467622718bbb7b2cdb5c4e9f5a30cd369"} err="failed to get container status \"c3c2c2e1b1689159ec55a630d66f7a7467622718bbb7b2cdb5c4e9f5a30cd369\": rpc error: code = NotFound desc = could not find container \"c3c2c2e1b1689159ec55a630d66f7a7467622718bbb7b2cdb5c4e9f5a30cd369\": container with ID starting with c3c2c2e1b1689159ec55a630d66f7a7467622718bbb7b2cdb5c4e9f5a30cd369 not found: ID does not exist" Jul 29 10:06:36.273043 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.272945 2577 scope.go:117] "RemoveContainer" containerID="1404c2ba78d767b0abc38aaabab1ba241e485324751b09c03c13f8849d8c9220" Jul 29 10:06:36.273277 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:06:36.273250 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1404c2ba78d767b0abc38aaabab1ba241e485324751b09c03c13f8849d8c9220\": container with ID starting with 1404c2ba78d767b0abc38aaabab1ba241e485324751b09c03c13f8849d8c9220 not found: ID does not exist" containerID="1404c2ba78d767b0abc38aaabab1ba241e485324751b09c03c13f8849d8c9220" Jul 29 10:06:36.273343 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.273283 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1404c2ba78d767b0abc38aaabab1ba241e485324751b09c03c13f8849d8c9220"} err="failed to get container status \"1404c2ba78d767b0abc38aaabab1ba241e485324751b09c03c13f8849d8c9220\": rpc error: code = NotFound desc = could not find container \"1404c2ba78d767b0abc38aaabab1ba241e485324751b09c03c13f8849d8c9220\": container with ID starting with 1404c2ba78d767b0abc38aaabab1ba241e485324751b09c03c13f8849d8c9220 not found: ID does not exist" Jul 29 10:06:36.297660 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.297637 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b5c92eb2-d130-4116-a51d-57ff2a00b804-alertmanager-main-db\") pod \"b5c92eb2-d130-4116-a51d-57ff2a00b804\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " Jul 29 10:06:36.297800 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.297672 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5c92eb2-d130-4116-a51d-57ff2a00b804-metrics-client-ca\") pod \"b5c92eb2-d130-4116-a51d-57ff2a00b804\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " Jul 29 10:06:36.297800 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.297698 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwdv5\" (UniqueName: \"kubernetes.io/projected/b5c92eb2-d130-4116-a51d-57ff2a00b804-kube-api-access-mwdv5\") pod \"b5c92eb2-d130-4116-a51d-57ff2a00b804\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " Jul 29 10:06:36.297800 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.297739 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-cluster-tls-config\") pod \"b5c92eb2-d130-4116-a51d-57ff2a00b804\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " Jul 29 10:06:36.297800 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.297794 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy\") pod \"b5c92eb2-d130-4116-a51d-57ff2a00b804\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " Jul 29 10:06:36.298015 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.297818 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-main-tls\") pod \"b5c92eb2-d130-4116-a51d-57ff2a00b804\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " Jul 29 10:06:36.298015 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.297861 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5c92eb2-d130-4116-a51d-57ff2a00b804-tls-assets\") pod \"b5c92eb2-d130-4116-a51d-57ff2a00b804\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " Jul 29 10:06:36.298015 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.297895 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-config-volume\") pod \"b5c92eb2-d130-4116-a51d-57ff2a00b804\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " Jul 29 10:06:36.298015 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.297932 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5c92eb2-d130-4116-a51d-57ff2a00b804-alertmanager-trusted-ca-bundle\") pod \"b5c92eb2-d130-4116-a51d-57ff2a00b804\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " Jul 29 10:06:36.298015 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.297969 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy-web\") pod \"b5c92eb2-d130-4116-a51d-57ff2a00b804\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " Jul 29 10:06:36.298255 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.298008 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5c92eb2-d130-4116-a51d-57ff2a00b804-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b5c92eb2-d130-4116-a51d-57ff2a00b804" (UID: "b5c92eb2-d130-4116-a51d-57ff2a00b804"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:06:36.298255 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.298043 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5c92eb2-d130-4116-a51d-57ff2a00b804-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b5c92eb2-d130-4116-a51d-57ff2a00b804" (UID: "b5c92eb2-d130-4116-a51d-57ff2a00b804"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:06:36.298255 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.298063 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-web-config\") pod \"b5c92eb2-d130-4116-a51d-57ff2a00b804\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " Jul 29 10:06:36.298422 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.298403 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5c92eb2-d130-4116-a51d-57ff2a00b804-config-out\") pod \"b5c92eb2-d130-4116-a51d-57ff2a00b804\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " Jul 29 10:06:36.298478 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.298450 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5c92eb2-d130-4116-a51d-57ff2a00b804-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b5c92eb2-d130-4116-a51d-57ff2a00b804" (UID: "b5c92eb2-d130-4116-a51d-57ff2a00b804"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:06:36.298816 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.298792 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b5c92eb2-d130-4116-a51d-57ff2a00b804-alertmanager-main-db\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:36.298908 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.298818 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5c92eb2-d130-4116-a51d-57ff2a00b804-metrics-client-ca\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:36.298908 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.298855 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5c92eb2-d130-4116-a51d-57ff2a00b804-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:36.301630 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.301594 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5c92eb2-d130-4116-a51d-57ff2a00b804-kube-api-access-mwdv5" (OuterVolumeSpecName: "kube-api-access-mwdv5") pod "b5c92eb2-d130-4116-a51d-57ff2a00b804" (UID: "b5c92eb2-d130-4116-a51d-57ff2a00b804"). InnerVolumeSpecName "kube-api-access-mwdv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:06:36.301741 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.301701 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b5c92eb2-d130-4116-a51d-57ff2a00b804" (UID: "b5c92eb2-d130-4116-a51d-57ff2a00b804"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:36.301879 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.301846 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b5c92eb2-d130-4116-a51d-57ff2a00b804" (UID: "b5c92eb2-d130-4116-a51d-57ff2a00b804"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:36.301969 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.301932 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b5c92eb2-d130-4116-a51d-57ff2a00b804" (UID: "b5c92eb2-d130-4116-a51d-57ff2a00b804"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:36.302375 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.302345 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5c92eb2-d130-4116-a51d-57ff2a00b804-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b5c92eb2-d130-4116-a51d-57ff2a00b804" (UID: "b5c92eb2-d130-4116-a51d-57ff2a00b804"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:06:36.302481 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.302456 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-config-volume" (OuterVolumeSpecName: "config-volume") pod "b5c92eb2-d130-4116-a51d-57ff2a00b804" (UID: "b5c92eb2-d130-4116-a51d-57ff2a00b804"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:36.302962 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.302941 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5c92eb2-d130-4116-a51d-57ff2a00b804-config-out" (OuterVolumeSpecName: "config-out") pod "b5c92eb2-d130-4116-a51d-57ff2a00b804" (UID: "b5c92eb2-d130-4116-a51d-57ff2a00b804"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:06:36.306114 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.305836 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b5c92eb2-d130-4116-a51d-57ff2a00b804" (UID: "b5c92eb2-d130-4116-a51d-57ff2a00b804"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:36.312198 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.312174 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-web-config" (OuterVolumeSpecName: "web-config") pod "b5c92eb2-d130-4116-a51d-57ff2a00b804" (UID: "b5c92eb2-d130-4116-a51d-57ff2a00b804"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:36.400162 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.400133 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b5c92eb2-d130-4116-a51d-57ff2a00b804\" (UID: \"b5c92eb2-d130-4116-a51d-57ff2a00b804\") " Jul 29 10:06:36.400287 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.400279 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-web-config\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:36.400326 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.400290 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5c92eb2-d130-4116-a51d-57ff2a00b804-config-out\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:36.400326 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.400298 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwdv5\" (UniqueName: \"kubernetes.io/projected/b5c92eb2-d130-4116-a51d-57ff2a00b804-kube-api-access-mwdv5\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:36.400326 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.400306 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-cluster-tls-config\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:36.400326 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.400315 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:36.400326 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.400325 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-main-tls\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:36.400481 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.400334 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5c92eb2-d130-4116-a51d-57ff2a00b804-tls-assets\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:36.400481 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.400342 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-config-volume\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:36.400481 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.400349 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:36.401913 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.401891 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b5c92eb2-d130-4116-a51d-57ff2a00b804" (UID: "b5c92eb2-d130-4116-a51d-57ff2a00b804"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:36.501347 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:36.501314 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b5c92eb2-d130-4116-a51d-57ff2a00b804-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:37.227339 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.227316 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.252324 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.252295 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:06:37.259229 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.258554 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:06:37.286519 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286495 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:06:37.286802 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286791 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="kube-rbac-proxy-metric" Jul 29 10:06:37.286846 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286804 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="kube-rbac-proxy-metric" Jul 29 10:06:37.286846 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286816 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="init-config-reloader" Jul 29 10:06:37.286846 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286822 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="init-config-reloader" Jul 29 10:06:37.286846 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286828 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="kube-rbac-proxy-web" Jul 29 10:06:37.286846 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286834 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="kube-rbac-proxy-web" Jul 29 10:06:37.286846 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286843 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6982956-2bee-4dca-b0b6-21cd95c0efb1" containerName="console" Jul 29 10:06:37.286846 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286848 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6982956-2bee-4dca-b0b6-21cd95c0efb1" containerName="console" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286854 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="config-reloader" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286859 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="config-reloader" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286869 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="kube-rbac-proxy" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286874 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="kube-rbac-proxy" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286880 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="prom-label-proxy" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286885 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="prom-label-proxy" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286894 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="alertmanager" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286899 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="alertmanager" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286938 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="alertmanager" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286945 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="kube-rbac-proxy-metric" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286951 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="kube-rbac-proxy-web" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286956 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="config-reloader" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286964 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="prom-label-proxy" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286970 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" containerName="kube-rbac-proxy" Jul 29 10:06:37.287064 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.286976 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6982956-2bee-4dca-b0b6-21cd95c0efb1" containerName="console" Jul 29 10:06:37.290513 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.290494 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.293314 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.293294 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 10:06:37.293423 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.293299 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 10:06:37.293482 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.293467 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 10:06:37.293728 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.293696 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c29xf\"" Jul 29 10:06:37.293803 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.293793 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 10:06:37.293975 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.293952 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 10:06:37.294135 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.294117 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 10:06:37.294202 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.294121 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 10:06:37.294202 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.294196 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 10:06:37.298247 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.298226 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 10:06:37.307381 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.307357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.307482 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.307391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865a895b-7531-467f-8544-4d2852d28306-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.307482 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.307407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-config-volume\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.307482 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.307439 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/865a895b-7531-467f-8544-4d2852d28306-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.307615 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.307482 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/865a895b-7531-467f-8544-4d2852d28306-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.307615 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.307562 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-web-config\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.307615 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.307598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/865a895b-7531-467f-8544-4d2852d28306-tls-assets\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.307759 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.307641 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.307759 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.307676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/865a895b-7531-467f-8544-4d2852d28306-config-out\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.307759 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.307703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.307759 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.307744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.307900 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.307771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dksm5\" (UniqueName: \"kubernetes.io/projected/865a895b-7531-467f-8544-4d2852d28306-kube-api-access-dksm5\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.307900 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.307821 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.308789 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.308772 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:06:37.409135 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.409047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-web-config\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.409135 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.409091 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/865a895b-7531-467f-8544-4d2852d28306-tls-assets\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.409135 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.409108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.409135 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.409127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/865a895b-7531-467f-8544-4d2852d28306-config-out\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.409445 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.409151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.409445 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.409189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.409445 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.409229 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dksm5\" (UniqueName: \"kubernetes.io/projected/865a895b-7531-467f-8544-4d2852d28306-kube-api-access-dksm5\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.409445 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.409270 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.410235 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.410060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.410235 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.410106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865a895b-7531-467f-8544-4d2852d28306-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.410235 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.410133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-config-volume\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.410235 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.410181 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/865a895b-7531-467f-8544-4d2852d28306-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.410235 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.410212 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/865a895b-7531-467f-8544-4d2852d28306-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.410917 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.410579 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/865a895b-7531-467f-8544-4d2852d28306-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.412171 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.412135 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/865a895b-7531-467f-8544-4d2852d28306-config-out\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.412276 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.412262 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-web-config\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.412344 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.412292 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.412344 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.412299 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/865a895b-7531-467f-8544-4d2852d28306-tls-assets\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.412569 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.412544 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.412841 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.412821 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/865a895b-7531-467f-8544-4d2852d28306-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.412917 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.412895 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.413044 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.413025 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.413153 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.413138 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865a895b-7531-467f-8544-4d2852d28306-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.413209 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.413177 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.414779 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.414763 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/865a895b-7531-467f-8544-4d2852d28306-config-volume\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.418850 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.418834 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dksm5\" (UniqueName: \"kubernetes.io/projected/865a895b-7531-467f-8544-4d2852d28306-kube-api-access-dksm5\") pod \"alertmanager-main-0\" (UID: \"865a895b-7531-467f-8544-4d2852d28306\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.496754 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.496721 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5c92eb2-d130-4116-a51d-57ff2a00b804" path="/var/lib/kubelet/pods/b5c92eb2-d130-4116-a51d-57ff2a00b804/volumes" Jul 29 10:06:37.600622 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.600595 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:06:37.738424 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:37.738397 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:06:37.740791 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:06:37.740767 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865a895b_7531_467f_8544_4d2852d28306.slice/crio-a6f640d035aba58125d305ac3e53b730bd1699090d2b54540514b4dc6e11ade5 WatchSource:0}: Error finding container a6f640d035aba58125d305ac3e53b730bd1699090d2b54540514b4dc6e11ade5: Status 404 returned error can't find the container with id a6f640d035aba58125d305ac3e53b730bd1699090d2b54540514b4dc6e11ade5 Jul 29 10:06:38.232480 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:38.232445 2577 generic.go:356] "Generic (PLEG): container finished" podID="865a895b-7531-467f-8544-4d2852d28306" containerID="df9ea9076d429e7b9ae7511a93b5159180fdb79f07ec600ed8b628c9b1aa610c" exitCode=0 Jul 29 10:06:38.232846 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:38.232497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865a895b-7531-467f-8544-4d2852d28306","Type":"ContainerDied","Data":"df9ea9076d429e7b9ae7511a93b5159180fdb79f07ec600ed8b628c9b1aa610c"} Jul 29 10:06:38.232846 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:38.232545 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865a895b-7531-467f-8544-4d2852d28306","Type":"ContainerStarted","Data":"a6f640d035aba58125d305ac3e53b730bd1699090d2b54540514b4dc6e11ade5"} Jul 29 10:06:38.982563 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:38.980994 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5"] Jul 29 10:06:38.984798 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:38.984774 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:38.988059 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:38.987746 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 29 10:06:38.988170 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:38.988065 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4nxkl\"" Jul 29 10:06:38.988304 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:38.988271 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 29 10:06:38.989129 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:38.988426 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 29 10:06:38.989129 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:38.988597 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 29 10:06:38.989282 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:38.989199 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 29 10:06:38.993367 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:38.993344 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 29 10:06:38.996290 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:38.996268 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5"] Jul 29 10:06:39.024048 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.024012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e03ea387-dd9d-41c5-8b83-7e479bf42345-serving-certs-ca-bundle\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.024182 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.024107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e03ea387-dd9d-41c5-8b83-7e479bf42345-metrics-client-ca\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.024182 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.024134 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e03ea387-dd9d-41c5-8b83-7e479bf42345-secret-telemeter-client\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.024182 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.024160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfsgv\" (UniqueName: \"kubernetes.io/projected/e03ea387-dd9d-41c5-8b83-7e479bf42345-kube-api-access-pfsgv\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.024552 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.024205 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e03ea387-dd9d-41c5-8b83-7e479bf42345-federate-client-tls\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.024552 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.024228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e03ea387-dd9d-41c5-8b83-7e479bf42345-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.024552 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.024257 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e03ea387-dd9d-41c5-8b83-7e479bf42345-telemeter-client-tls\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.024552 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.024287 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e03ea387-dd9d-41c5-8b83-7e479bf42345-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.124862 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.124828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e03ea387-dd9d-41c5-8b83-7e479bf42345-metrics-client-ca\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.124862 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.124864 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e03ea387-dd9d-41c5-8b83-7e479bf42345-secret-telemeter-client\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.125143 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.124892 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfsgv\" (UniqueName: \"kubernetes.io/projected/e03ea387-dd9d-41c5-8b83-7e479bf42345-kube-api-access-pfsgv\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.125143 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.124919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e03ea387-dd9d-41c5-8b83-7e479bf42345-federate-client-tls\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.125143 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.124938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e03ea387-dd9d-41c5-8b83-7e479bf42345-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.125327 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.125189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e03ea387-dd9d-41c5-8b83-7e479bf42345-telemeter-client-tls\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.125387 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.125325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e03ea387-dd9d-41c5-8b83-7e479bf42345-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.125437 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.125406 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e03ea387-dd9d-41c5-8b83-7e479bf42345-serving-certs-ca-bundle\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.125841 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.125819 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e03ea387-dd9d-41c5-8b83-7e479bf42345-metrics-client-ca\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.126084 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.126062 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e03ea387-dd9d-41c5-8b83-7e479bf42345-serving-certs-ca-bundle\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.126189 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.126111 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e03ea387-dd9d-41c5-8b83-7e479bf42345-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.127734 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.127702 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e03ea387-dd9d-41c5-8b83-7e479bf42345-secret-telemeter-client\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.127847 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.127755 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e03ea387-dd9d-41c5-8b83-7e479bf42345-federate-client-tls\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.127847 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.127829 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e03ea387-dd9d-41c5-8b83-7e479bf42345-telemeter-client-tls\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.128147 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.128128 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e03ea387-dd9d-41c5-8b83-7e479bf42345-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.135490 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.135468 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfsgv\" (UniqueName: \"kubernetes.io/projected/e03ea387-dd9d-41c5-8b83-7e479bf42345-kube-api-access-pfsgv\") pod \"telemeter-client-5bfc9c454b-6vdq5\" (UID: \"e03ea387-dd9d-41c5-8b83-7e479bf42345\") " pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.239270 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.239183 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865a895b-7531-467f-8544-4d2852d28306","Type":"ContainerStarted","Data":"a1f57ab49cead1028f61ca08a442fe2d39bc39c41010b59e2c6f4c1acce40340"} Jul 29 10:06:39.239270 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.239264 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865a895b-7531-467f-8544-4d2852d28306","Type":"ContainerStarted","Data":"f83e8b57350467fdd693d4818d23ed69ac9730ba862ddc6165d7b9687c87e0c1"} Jul 29 10:06:39.239677 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.239302 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865a895b-7531-467f-8544-4d2852d28306","Type":"ContainerStarted","Data":"bf3d83928e51171513b75dbd5d4a20701df3949ba2945d8541afba621bf8f410"} Jul 29 10:06:39.239677 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.239387 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865a895b-7531-467f-8544-4d2852d28306","Type":"ContainerStarted","Data":"4d80607a254f21e5d44c25f443f0f666cfe8e033177e41b12bb6aaacd0069be1"} Jul 29 10:06:39.239677 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.239420 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865a895b-7531-467f-8544-4d2852d28306","Type":"ContainerStarted","Data":"1b913ccc9818aa5676f3a60470c5857f17eff49d2ac10332c1576aa320281fa3"} Jul 29 10:06:39.239677 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.239453 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865a895b-7531-467f-8544-4d2852d28306","Type":"ContainerStarted","Data":"919835fc31c89eb46b204e21751c2430a2ddbf96b7ac277edca4fc201898fd70"} Jul 29 10:06:39.267844 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.267780 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.254479432 podStartE2EDuration="2.267762082s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.28265ms" isStatefulPod=false podCreationTimestamp="2026-07-29 10:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:06:39.266700489 +0000 UTC m=+148.387493898" watchObservedRunningTime="2026-07-29 10:06:39.267762082 +0000 UTC m=+148.388555476" Jul 29 10:06:39.298219 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.298190 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" Jul 29 10:06:39.312187 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.312160 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 10:06:39.312559 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.312512 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="thanos-sidecar" containerID="cri-o://01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997" gracePeriod=600 Jul 29 10:06:39.312559 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.312512 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="config-reloader" containerID="cri-o://1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27" gracePeriod=600 Jul 29 10:06:39.312721 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.312637 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="prometheus" containerID="cri-o://f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213" gracePeriod=600 Jul 29 10:06:39.312772 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.312690 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="kube-rbac-proxy-web" containerID="cri-o://69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9" gracePeriod=600 Jul 29 10:06:39.312879 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.312863 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6" gracePeriod=600 Jul 29 10:06:39.313017 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.312945 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="kube-rbac-proxy" containerID="cri-o://06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee" gracePeriod=600 Jul 29 10:06:39.486446 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.486411 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5"] Jul 29 10:06:39.489451 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:06:39.489399 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode03ea387_dd9d_41c5_8b83_7e479bf42345.slice/crio-cd597d8f3d86c58cb465798034f7e30c947ddd9372c0c582ff68d540c345ffe8 WatchSource:0}: Error finding container cd597d8f3d86c58cb465798034f7e30c947ddd9372c0c582ff68d540c345ffe8: Status 404 returned error can't find the container with id cd597d8f3d86c58cb465798034f7e30c947ddd9372c0c582ff68d540c345ffe8 Jul 29 10:06:39.572305 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.572277 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:39.631457 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631426 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-thanos-prometheus-http-client-file\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.631457 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631459 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-config\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.631687 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631474 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-web-config\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.631687 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631505 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-2\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.631687 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631546 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.631687 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631566 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-kubelet-serving-ca-bundle\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.631687 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631585 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-serving-certs-ca-bundle\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.631687 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631611 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-kube-rbac-proxy\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.631687 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631637 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-tls\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.631687 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631655 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27b27049-63d5-45d8-95a7-4c756f9e2c9e-config-out\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.631687 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631669 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-1\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.632197 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631698 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-0\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.632197 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631721 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-db\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.632197 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631738 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-metrics-client-certs\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.632197 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631786 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grxmv\" (UniqueName: \"kubernetes.io/projected/27b27049-63d5-45d8-95a7-4c756f9e2c9e-kube-api-access-grxmv\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.632197 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631818 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-trusted-ca-bundle\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.632197 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631856 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.632197 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631885 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-metrics-client-ca\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.632197 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.631927 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27b27049-63d5-45d8-95a7-4c756f9e2c9e-tls-assets\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.632583 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.632347 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:06:39.632583 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.632400 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-grpc-tls\") pod \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\" (UID: \"27b27049-63d5-45d8-95a7-4c756f9e2c9e\") " Jul 29 10:06:39.632583 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.632568 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:06:39.632768 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.632746 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.632821 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.632778 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.633265 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.633233 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:06:39.633868 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.633838 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:06:39.633947 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.633910 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:06:39.635192 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.634913 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:06:39.635294 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.635200 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:06:39.635294 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.635205 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:06:39.635835 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.635803 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-config" (OuterVolumeSpecName: "config") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:39.636613 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.636499 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:39.636876 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.636794 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:39.636974 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.636924 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:39.637561 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.637516 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:39.639683 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.639419 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:39.639867 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.639845 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27b27049-63d5-45d8-95a7-4c756f9e2c9e-kube-api-access-grxmv" (OuterVolumeSpecName: "kube-api-access-grxmv") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "kube-api-access-grxmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:06:39.640005 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.639878 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:39.640005 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.639908 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:39.640124 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.640097 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27b27049-63d5-45d8-95a7-4c756f9e2c9e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:06:39.640255 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.640238 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27b27049-63d5-45d8-95a7-4c756f9e2c9e-config-out" (OuterVolumeSpecName: "config-out") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:06:39.649610 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.649581 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-web-config" (OuterVolumeSpecName: "web-config") pod "27b27049-63d5-45d8-95a7-4c756f9e2c9e" (UID: "27b27049-63d5-45d8-95a7-4c756f9e2c9e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:06:39.733834 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733809 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.733834 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733831 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733843 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-kube-rbac-proxy\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733853 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733863 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27b27049-63d5-45d8-95a7-4c756f9e2c9e-config-out\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733871 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733880 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733889 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-k8s-db\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733897 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-metrics-client-certs\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733905 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grxmv\" (UniqueName: \"kubernetes.io/projected/27b27049-63d5-45d8-95a7-4c756f9e2c9e-kube-api-access-grxmv\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733913 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733921 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733929 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27b27049-63d5-45d8-95a7-4c756f9e2c9e-configmap-metrics-client-ca\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733937 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27b27049-63d5-45d8-95a7-4c756f9e2c9e-tls-assets\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733945 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-secret-grpc-tls\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733952 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733960 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-config\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:39.734001 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:39.733967 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27b27049-63d5-45d8-95a7-4c756f9e2c9e-web-config\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:06:40.245581 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.245552 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" event={"ID":"e03ea387-dd9d-41c5-8b83-7e479bf42345","Type":"ContainerStarted","Data":"cd597d8f3d86c58cb465798034f7e30c947ddd9372c0c582ff68d540c345ffe8"} Jul 29 10:06:40.248446 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248419 2577 generic.go:356] "Generic (PLEG): container finished" podID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerID="48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6" exitCode=0 Jul 29 10:06:40.248446 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248445 2577 generic.go:356] "Generic (PLEG): container finished" podID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerID="06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee" exitCode=0 Jul 29 10:06:40.248629 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248454 2577 generic.go:356] "Generic (PLEG): container finished" podID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerID="69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9" exitCode=0 Jul 29 10:06:40.248629 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248463 2577 generic.go:356] "Generic (PLEG): container finished" podID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerID="01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997" exitCode=0 Jul 29 10:06:40.248629 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248461 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerDied","Data":"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6"} Jul 29 10:06:40.248629 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248487 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.248629 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248528 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerDied","Data":"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee"} Jul 29 10:06:40.248629 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248471 2577 generic.go:356] "Generic (PLEG): container finished" podID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerID="1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27" exitCode=0 Jul 29 10:06:40.248629 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248557 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerDied","Data":"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9"} Jul 29 10:06:40.248629 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248565 2577 generic.go:356] "Generic (PLEG): container finished" podID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerID="f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213" exitCode=0 Jul 29 10:06:40.248629 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248584 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerDied","Data":"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997"} Jul 29 10:06:40.248629 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248609 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerDied","Data":"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27"} Jul 29 10:06:40.248629 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248635 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerDied","Data":"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213"} Jul 29 10:06:40.249009 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248637 2577 scope.go:117] "RemoveContainer" containerID="48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6" Jul 29 10:06:40.249009 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.248662 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27b27049-63d5-45d8-95a7-4c756f9e2c9e","Type":"ContainerDied","Data":"4d50acbfcd1cdd7cb71562ff1531f4814b07e838d9a987168a92dbfb7506ab97"} Jul 29 10:06:40.256620 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.256604 2577 scope.go:117] "RemoveContainer" containerID="06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee" Jul 29 10:06:40.263276 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.263252 2577 scope.go:117] "RemoveContainer" containerID="69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9" Jul 29 10:06:40.269658 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.269643 2577 scope.go:117] "RemoveContainer" containerID="01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997" Jul 29 10:06:40.275401 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.275379 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 10:06:40.279838 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.279811 2577 scope.go:117] "RemoveContainer" containerID="1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27" Jul 29 10:06:40.280903 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.280808 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 10:06:40.287792 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.287773 2577 scope.go:117] "RemoveContainer" containerID="f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213" Jul 29 10:06:40.296508 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.296480 2577 scope.go:117] "RemoveContainer" containerID="251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e" Jul 29 10:06:40.304571 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.304404 2577 scope.go:117] "RemoveContainer" containerID="48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6" Jul 29 10:06:40.304793 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:06:40.304769 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6\": container with ID starting with 48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6 not found: ID does not exist" containerID="48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6" Jul 29 10:06:40.304880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.304803 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6"} err="failed to get container status \"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6\": rpc error: code = NotFound desc = could not find container \"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6\": container with ID starting with 48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6 not found: ID does not exist" Jul 29 10:06:40.304880 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.304827 2577 scope.go:117] "RemoveContainer" containerID="06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee" Jul 29 10:06:40.305117 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:06:40.305094 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee\": container with ID starting with 06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee not found: ID does not exist" containerID="06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee" Jul 29 10:06:40.305221 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.305127 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee"} err="failed to get container status \"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee\": rpc error: code = NotFound desc = could not find container \"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee\": container with ID starting with 06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee not found: ID does not exist" Jul 29 10:06:40.305221 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.305158 2577 scope.go:117] "RemoveContainer" containerID="69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9" Jul 29 10:06:40.305413 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:06:40.305395 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9\": container with ID starting with 69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9 not found: ID does not exist" containerID="69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9" Jul 29 10:06:40.305460 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.305421 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9"} err="failed to get container status \"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9\": rpc error: code = NotFound desc = could not find container \"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9\": container with ID starting with 69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9 not found: ID does not exist" Jul 29 10:06:40.305460 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.305435 2577 scope.go:117] "RemoveContainer" containerID="01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997" Jul 29 10:06:40.305668 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:06:40.305652 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997\": container with ID starting with 01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997 not found: ID does not exist" containerID="01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997" Jul 29 10:06:40.305717 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.305675 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997"} err="failed to get container status \"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997\": rpc error: code = NotFound desc = could not find container \"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997\": container with ID starting with 01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997 not found: ID does not exist" Jul 29 10:06:40.305717 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.305695 2577 scope.go:117] "RemoveContainer" containerID="1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27" Jul 29 10:06:40.305977 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:06:40.305959 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27\": container with ID starting with 1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27 not found: ID does not exist" containerID="1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27" Jul 29 10:06:40.306060 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.306009 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27"} err="failed to get container status \"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27\": rpc error: code = NotFound desc = could not find container \"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27\": container with ID starting with 1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27 not found: ID does not exist" Jul 29 10:06:40.306060 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.306030 2577 scope.go:117] "RemoveContainer" containerID="f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213" Jul 29 10:06:40.306279 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:06:40.306253 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213\": container with ID starting with f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213 not found: ID does not exist" containerID="f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213" Jul 29 10:06:40.306331 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.306285 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213"} err="failed to get container status \"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213\": rpc error: code = NotFound desc = could not find container \"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213\": container with ID starting with f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213 not found: ID does not exist" Jul 29 10:06:40.306331 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.306308 2577 scope.go:117] "RemoveContainer" containerID="251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e" Jul 29 10:06:40.306576 ip-10-0-141-60 kubenswrapper[2577]: E0729 10:06:40.306555 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e\": container with ID starting with 251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e not found: ID does not exist" containerID="251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e" Jul 29 10:06:40.306707 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.306579 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e"} err="failed to get container status \"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e\": rpc error: code = NotFound desc = could not find container \"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e\": container with ID starting with 251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e not found: ID does not exist" Jul 29 10:06:40.306707 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.306597 2577 scope.go:117] "RemoveContainer" containerID="48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6" Jul 29 10:06:40.306871 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.306843 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6"} err="failed to get container status \"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6\": rpc error: code = NotFound desc = could not find container \"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6\": container with ID starting with 48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6 not found: ID does not exist" Jul 29 10:06:40.306972 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.306954 2577 scope.go:117] "RemoveContainer" containerID="06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee" Jul 29 10:06:40.307424 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.307402 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee"} err="failed to get container status \"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee\": rpc error: code = NotFound desc = could not find container \"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee\": container with ID starting with 06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee not found: ID does not exist" Jul 29 10:06:40.307581 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.307442 2577 scope.go:117] "RemoveContainer" containerID="69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9" Jul 29 10:06:40.307799 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.307769 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9"} err="failed to get container status \"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9\": rpc error: code = NotFound desc = could not find container \"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9\": container with ID starting with 69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9 not found: ID does not exist" Jul 29 10:06:40.307799 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.307794 2577 scope.go:117] "RemoveContainer" containerID="01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997" Jul 29 10:06:40.308546 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.308062 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997"} err="failed to get container status \"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997\": rpc error: code = NotFound desc = could not find container \"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997\": container with ID starting with 01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997 not found: ID does not exist" Jul 29 10:06:40.308546 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.308094 2577 scope.go:117] "RemoveContainer" containerID="1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27" Jul 29 10:06:40.308546 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.308393 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27"} err="failed to get container status \"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27\": rpc error: code = NotFound desc = could not find container \"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27\": container with ID starting with 1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27 not found: ID does not exist" Jul 29 10:06:40.308546 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.308428 2577 scope.go:117] "RemoveContainer" containerID="f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213" Jul 29 10:06:40.309198 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.309168 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213"} err="failed to get container status \"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213\": rpc error: code = NotFound desc = could not find container \"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213\": container with ID starting with f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213 not found: ID does not exist" Jul 29 10:06:40.309291 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.309203 2577 scope.go:117] "RemoveContainer" containerID="251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e" Jul 29 10:06:40.311555 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.311531 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 10:06:40.312276 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312258 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="thanos-sidecar" Jul 29 10:06:40.312359 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312280 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="thanos-sidecar" Jul 29 10:06:40.312359 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312296 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="kube-rbac-proxy-web" Jul 29 10:06:40.312359 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312305 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="kube-rbac-proxy-web" Jul 29 10:06:40.312359 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312326 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="kube-rbac-proxy-thanos" Jul 29 10:06:40.312359 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312334 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="kube-rbac-proxy-thanos" Jul 29 10:06:40.312359 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312352 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="prometheus" Jul 29 10:06:40.312359 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312360 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="prometheus" Jul 29 10:06:40.312583 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312399 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="config-reloader" Jul 29 10:06:40.312583 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312407 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="config-reloader" Jul 29 10:06:40.312583 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312429 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="kube-rbac-proxy" Jul 29 10:06:40.312583 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312438 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="kube-rbac-proxy" Jul 29 10:06:40.312583 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312451 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="init-config-reloader" Jul 29 10:06:40.312583 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312459 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="init-config-reloader" Jul 29 10:06:40.312758 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312613 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="kube-rbac-proxy-thanos" Jul 29 10:06:40.312758 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312632 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="kube-rbac-proxy" Jul 29 10:06:40.312758 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312654 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="kube-rbac-proxy-web" Jul 29 10:06:40.312758 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312662 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="config-reloader" Jul 29 10:06:40.312758 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312671 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="prometheus" Jul 29 10:06:40.312758 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.312684 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" containerName="thanos-sidecar" Jul 29 10:06:40.315785 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.315737 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e"} err="failed to get container status \"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e\": rpc error: code = NotFound desc = could not find container \"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e\": container with ID starting with 251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e not found: ID does not exist" Jul 29 10:06:40.315785 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.315767 2577 scope.go:117] "RemoveContainer" containerID="48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6" Jul 29 10:06:40.316363 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.316332 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6"} err="failed to get container status \"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6\": rpc error: code = NotFound desc = could not find container \"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6\": container with ID starting with 48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6 not found: ID does not exist" Jul 29 10:06:40.316455 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.316366 2577 scope.go:117] "RemoveContainer" containerID="06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee" Jul 29 10:06:40.317400 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.317371 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee"} err="failed to get container status \"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee\": rpc error: code = NotFound desc = could not find container \"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee\": container with ID starting with 06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee not found: ID does not exist" Jul 29 10:06:40.317487 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.317402 2577 scope.go:117] "RemoveContainer" containerID="69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9" Jul 29 10:06:40.317726 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.317660 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9"} err="failed to get container status \"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9\": rpc error: code = NotFound desc = could not find container \"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9\": container with ID starting with 69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9 not found: ID does not exist" Jul 29 10:06:40.317726 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.317686 2577 scope.go:117] "RemoveContainer" containerID="01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997" Jul 29 10:06:40.318301 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.318204 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997"} err="failed to get container status \"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997\": rpc error: code = NotFound desc = could not find container \"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997\": container with ID starting with 01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997 not found: ID does not exist" Jul 29 10:06:40.318301 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.318229 2577 scope.go:117] "RemoveContainer" containerID="1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27" Jul 29 10:06:40.318442 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.318408 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.318492 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.318469 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27"} err="failed to get container status \"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27\": rpc error: code = NotFound desc = could not find container \"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27\": container with ID starting with 1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27 not found: ID does not exist" Jul 29 10:06:40.318546 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.318491 2577 scope.go:117] "RemoveContainer" containerID="f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213" Jul 29 10:06:40.319366 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.319340 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213"} err="failed to get container status \"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213\": rpc error: code = NotFound desc = could not find container \"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213\": container with ID starting with f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213 not found: ID does not exist" Jul 29 10:06:40.319366 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.319364 2577 scope.go:117] "RemoveContainer" containerID="251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e" Jul 29 10:06:40.319785 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.319756 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e"} err="failed to get container status \"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e\": rpc error: code = NotFound desc = could not find container \"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e\": container with ID starting with 251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e not found: ID does not exist" Jul 29 10:06:40.319866 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.319786 2577 scope.go:117] "RemoveContainer" containerID="48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6" Jul 29 10:06:40.320188 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.320126 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6"} err="failed to get container status \"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6\": rpc error: code = NotFound desc = could not find container \"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6\": container with ID starting with 48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6 not found: ID does not exist" Jul 29 10:06:40.320188 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.320153 2577 scope.go:117] "RemoveContainer" containerID="06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee" Jul 29 10:06:40.320423 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.320404 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee"} err="failed to get container status \"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee\": rpc error: code = NotFound desc = could not find container \"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee\": container with ID starting with 06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee not found: ID does not exist" Jul 29 10:06:40.320482 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.320426 2577 scope.go:117] "RemoveContainer" containerID="69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9" Jul 29 10:06:40.320718 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.320693 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9"} err="failed to get container status \"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9\": rpc error: code = NotFound desc = could not find container \"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9\": container with ID starting with 69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9 not found: ID does not exist" Jul 29 10:06:40.320794 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.320719 2577 scope.go:117] "RemoveContainer" containerID="01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997" Jul 29 10:06:40.320966 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.320943 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997"} err="failed to get container status \"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997\": rpc error: code = NotFound desc = could not find container \"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997\": container with ID starting with 01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997 not found: ID does not exist" Jul 29 10:06:40.321063 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.320968 2577 scope.go:117] "RemoveContainer" containerID="1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27" Jul 29 10:06:40.321283 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.321263 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27"} err="failed to get container status \"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27\": rpc error: code = NotFound desc = could not find container \"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27\": container with ID starting with 1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27 not found: ID does not exist" Jul 29 10:06:40.321354 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.321285 2577 scope.go:117] "RemoveContainer" containerID="f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213" Jul 29 10:06:40.321496 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.321478 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213"} err="failed to get container status \"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213\": rpc error: code = NotFound desc = could not find container \"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213\": container with ID starting with f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213 not found: ID does not exist" Jul 29 10:06:40.321496 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.321495 2577 scope.go:117] "RemoveContainer" containerID="251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e" Jul 29 10:06:40.321636 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.321625 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 10:06:40.321865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.321842 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e"} err="failed to get container status \"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e\": rpc error: code = NotFound desc = could not find container \"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e\": container with ID starting with 251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e not found: ID does not exist" Jul 29 10:06:40.321865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.321865 2577 scope.go:117] "RemoveContainer" containerID="48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6" Jul 29 10:06:40.322003 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.321863 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 10:06:40.322210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322173 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 10:06:40.322210 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322184 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 10:06:40.322378 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322234 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6"} err="failed to get container status \"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6\": rpc error: code = NotFound desc = could not find container \"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6\": container with ID starting with 48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6 not found: ID does not exist" Jul 29 10:06:40.322378 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322255 2577 scope.go:117] "RemoveContainer" containerID="06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee" Jul 29 10:06:40.322493 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322449 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 10:06:40.322493 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322454 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 10:06:40.322631 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322602 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee"} err="failed to get container status \"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee\": rpc error: code = NotFound desc = could not find container \"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee\": container with ID starting with 06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee not found: ID does not exist" Jul 29 10:06:40.322631 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322627 2577 scope.go:117] "RemoveContainer" containerID="69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9" Jul 29 10:06:40.322778 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322683 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 10:06:40.322778 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322731 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 10:06:40.322778 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322742 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 10:06:40.322778 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322683 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 10:06:40.322972 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322746 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 10:06:40.322972 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322855 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 10:06:40.322972 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.322924 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-534b36ajtrki9\"" Jul 29 10:06:40.323207 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.323172 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9"} err="failed to get container status \"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9\": rpc error: code = NotFound desc = could not find container \"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9\": container with ID starting with 69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9 not found: ID does not exist" Jul 29 10:06:40.323207 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.323199 2577 scope.go:117] "RemoveContainer" containerID="01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997" Jul 29 10:06:40.323579 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.323555 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997"} err="failed to get container status \"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997\": rpc error: code = NotFound desc = could not find container \"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997\": container with ID starting with 01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997 not found: ID does not exist" Jul 29 10:06:40.323648 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.323580 2577 scope.go:117] "RemoveContainer" containerID="1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27" Jul 29 10:06:40.324072 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.323852 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z4f86\"" Jul 29 10:06:40.325347 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.325210 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27"} err="failed to get container status \"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27\": rpc error: code = NotFound desc = could not find container \"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27\": container with ID starting with 1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27 not found: ID does not exist" Jul 29 10:06:40.325347 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.325235 2577 scope.go:117] "RemoveContainer" containerID="f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213" Jul 29 10:06:40.325618 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.325590 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213"} err="failed to get container status \"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213\": rpc error: code = NotFound desc = could not find container \"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213\": container with ID starting with f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213 not found: ID does not exist" Jul 29 10:06:40.325673 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.325621 2577 scope.go:117] "RemoveContainer" containerID="251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e" Jul 29 10:06:40.325920 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.325895 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e"} err="failed to get container status \"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e\": rpc error: code = NotFound desc = could not find container \"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e\": container with ID starting with 251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e not found: ID does not exist" Jul 29 10:06:40.325920 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.325920 2577 scope.go:117] "RemoveContainer" containerID="48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6" Jul 29 10:06:40.326259 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.326241 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 10:06:40.326460 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.326400 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6"} err="failed to get container status \"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6\": rpc error: code = NotFound desc = could not find container \"48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6\": container with ID starting with 48e8565478be1c338d7667fcae2a929b8df9e68d09137803ffc34873ed6183d6 not found: ID does not exist" Jul 29 10:06:40.326460 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.326438 2577 scope.go:117] "RemoveContainer" containerID="06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee" Jul 29 10:06:40.327045 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.327010 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee"} err="failed to get container status \"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee\": rpc error: code = NotFound desc = could not find container \"06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee\": container with ID starting with 06c8b6d9acb1b8a570618dcc290ab38703264a1e25233388935d06ab78afdaee not found: ID does not exist" Jul 29 10:06:40.327045 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.327038 2577 scope.go:117] "RemoveContainer" containerID="69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9" Jul 29 10:06:40.327739 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.327306 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9"} err="failed to get container status \"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9\": rpc error: code = NotFound desc = could not find container \"69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9\": container with ID starting with 69cc49fa5df87165aa3cdb4c37fc71c96a9150b31a2726ec9cd71c00d9dc67f9 not found: ID does not exist" Jul 29 10:06:40.327739 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.327330 2577 scope.go:117] "RemoveContainer" containerID="01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997" Jul 29 10:06:40.328145 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.328031 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997"} err="failed to get container status \"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997\": rpc error: code = NotFound desc = could not find container \"01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997\": container with ID starting with 01e502e51e84145e463b8184543fe9affd50c5ab9338445f479f6f8695d81997 not found: ID does not exist" Jul 29 10:06:40.328145 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.328065 2577 scope.go:117] "RemoveContainer" containerID="1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27" Jul 29 10:06:40.328389 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.328370 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 10:06:40.328473 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.328384 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27"} err="failed to get container status \"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27\": rpc error: code = NotFound desc = could not find container \"1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27\": container with ID starting with 1ecf2a5a281e6745452f1f961c413c9bb45c9e2fe0b1fbbbbe0886dc7e61ad27 not found: ID does not exist" Jul 29 10:06:40.328473 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.328405 2577 scope.go:117] "RemoveContainer" containerID="f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213" Jul 29 10:06:40.328721 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.328692 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213"} err="failed to get container status \"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213\": rpc error: code = NotFound desc = could not find container \"f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213\": container with ID starting with f8bd1477133a271d5ac3ac6cba6df6af897302c481c4904ed80ac78326e51213 not found: ID does not exist" Jul 29 10:06:40.328810 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.328721 2577 scope.go:117] "RemoveContainer" containerID="251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e" Jul 29 10:06:40.329053 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.329029 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e"} err="failed to get container status \"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e\": rpc error: code = NotFound desc = could not find container \"251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e\": container with ID starting with 251948ad2c6d152a06c4a61ae87897d49cc2e6b21eaa1e7298a38e11de6a3f4e not found: ID does not exist" Jul 29 10:06:40.335069 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.335038 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338168 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338447 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338540 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338630 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-config\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338915 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.338956 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.339090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341749 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.339383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341749 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.339415 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341749 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.339439 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.341749 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.339464 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55gg6\" (UniqueName: \"kubernetes.io/projected/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-kube-api-access-55gg6\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.440414 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.440566 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440440 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.440566 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440475 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.440566 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.440566 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55gg6\" (UniqueName: \"kubernetes.io/projected/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-kube-api-access-55gg6\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.440831 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440573 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.440831 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.440831 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440647 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.440831 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.440831 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440718 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.440831 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.440831 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440782 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.440831 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.441940 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.441940 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440852 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.441940 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.441940 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-config\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.441940 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.440960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.441940 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.441009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.441940 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.441051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.441940 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.441081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.441940 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.441267 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.441940 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.441336 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.441940 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.441535 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.441940 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.441891 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.442666 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.442637 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.442884 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.442860 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.443598 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.443576 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.443598 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.443589 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.444048 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.444026 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.445318 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.444997 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.445318 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.445259 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.445966 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.445918 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.446558 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.446506 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.446763 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.446739 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.446864 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.446844 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.446927 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.446860 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-config\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.447370 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.447350 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.447526 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.447504 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.450393 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.450371 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55gg6\" (UniqueName: \"kubernetes.io/projected/5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e-kube-api-access-55gg6\") pod \"prometheus-k8s-0\" (UID: \"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.630770 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.630683 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:40.783850 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:40.783719 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 10:06:41.112882 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:06:41.112852 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac9ee56_94e9_4fd9_8464_0c9b6f62fd5e.slice/crio-7cfc5238953d135d577e1a7bb2d32216fa1580e7eb6ce2f8b71586b24492ddea WatchSource:0}: Error finding container 7cfc5238953d135d577e1a7bb2d32216fa1580e7eb6ce2f8b71586b24492ddea: Status 404 returned error can't find the container with id 7cfc5238953d135d577e1a7bb2d32216fa1580e7eb6ce2f8b71586b24492ddea Jul 29 10:06:41.255900 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:41.255866 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" event={"ID":"e03ea387-dd9d-41c5-8b83-7e479bf42345","Type":"ContainerStarted","Data":"ed9e6b77ed533a5c32f280400dcd5d1163a5f1e44c696c42821ded223899b9e2"} Jul 29 10:06:41.257207 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:41.257187 2577 generic.go:356] "Generic (PLEG): container finished" podID="5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e" containerID="7d8402531f61f3ba9a807cef6c0b25638809697096e997b26266fdb695a88bc1" exitCode=0 Jul 29 10:06:41.257287 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:41.257266 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e","Type":"ContainerDied","Data":"7d8402531f61f3ba9a807cef6c0b25638809697096e997b26266fdb695a88bc1"} Jul 29 10:06:41.257338 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:41.257327 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e","Type":"ContainerStarted","Data":"7cfc5238953d135d577e1a7bb2d32216fa1580e7eb6ce2f8b71586b24492ddea"} Jul 29 10:06:41.504101 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:41.504070 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27b27049-63d5-45d8-95a7-4c756f9e2c9e" path="/var/lib/kubelet/pods/27b27049-63d5-45d8-95a7-4c756f9e2c9e/volumes" Jul 29 10:06:42.263592 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:42.263554 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" event={"ID":"e03ea387-dd9d-41c5-8b83-7e479bf42345","Type":"ContainerStarted","Data":"e0d8357551943725ec818275e6002f74f8545811ffaf6603aeba87af82521747"} Jul 29 10:06:42.264038 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:42.263622 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" event={"ID":"e03ea387-dd9d-41c5-8b83-7e479bf42345","Type":"ContainerStarted","Data":"9a49ec39c674898be7929797fa694b72b94c6bb91f681517111298b0187596eb"} Jul 29 10:06:42.266742 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:42.266720 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e","Type":"ContainerStarted","Data":"72ede5ca5c524d6e0c90c71af01bfae514114c097abf8d5b9f21a82f88d4ccba"} Jul 29 10:06:42.266836 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:42.266774 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e","Type":"ContainerStarted","Data":"2f12cb9ed6556a9298601da6dd65797372f20fee288aba8bbf4e6894b3ee7c7c"} Jul 29 10:06:42.266836 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:42.266798 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e","Type":"ContainerStarted","Data":"587d6d704a01bd19cc9ef023ba5f1fcff8fb19384a8a9a469bc4e195e20923af"} Jul 29 10:06:42.266836 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:42.266822 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e","Type":"ContainerStarted","Data":"11a920bdf95ad67e61eca13417c9a990f21f386b2d5dfda85243901263f81077"} Jul 29 10:06:42.266943 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:42.266847 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e","Type":"ContainerStarted","Data":"2ed6fd30dfc445d538f62fd052fd77763139f64e00112fe4709589ad175e573f"} Jul 29 10:06:42.266943 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:42.266871 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e","Type":"ContainerStarted","Data":"ac7183e5805d9d8fbb3ddf6725ad9ca31f5c5de2e12de49372707b1ff5588973"} Jul 29 10:06:42.289476 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:42.289429 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5bfc9c454b-6vdq5" podStartSLOduration=2.629782347 podStartE2EDuration="4.28941414s" totalImagesPullingTime="1.659631793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:06:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:06:42.286158855 +0000 UTC m=+151.406952246" watchObservedRunningTime="2026-07-29 10:06:42.28941414 +0000 UTC m=+151.410207531" Jul 29 10:06:42.316410 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:42.316352 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.293201295 podStartE2EDuration="2.316339751s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.138456ms" isStatefulPod=false podCreationTimestamp="2026-07-29 10:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:06:42.315817 +0000 UTC m=+151.436610393" watchObservedRunningTime="2026-07-29 10:06:42.316339751 +0000 UTC m=+151.437133145" Jul 29 10:06:43.323182 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:43.323147 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:06:43.440596 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:43.440560 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:06:45.631086 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:45.631046 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:06:54.447765 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:54.447725 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:06:54.548464 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:54.548425 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:06:54.616593 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:06:54.616566 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:07:13.875304 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:07:13.875266 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:07:17.926458 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:07:17.926417 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:07:40.631751 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:07:40.631709 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:07:40.647006 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:07:40.646969 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:07:41.524176 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:07:41.524149 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:07:49.162137 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:07:49.162094 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:07:49.229205 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:07:49.229174 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:07:52.237056 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:07:52.237017 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:07:52.296287 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:07:52.296255 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:08:03.179681 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:08:03.179644 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:08:03.243246 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:08:03.243213 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:08:14.274139 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:08:14.274104 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:08:14.374918 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:08:14.374886 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:08:14.436711 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:08:14.436679 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:08:19.022021 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:08:19.021963 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:08:47.255554 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:08:47.255520 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:08:47.352545 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:08:47.352512 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:08:59.381193 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:08:59.381159 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:03.046205 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:03.046133 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:11.282138 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:11.282106 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 10:09:21.252317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:21.252285 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:22.051314 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:22.051280 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:24.870452 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:24.870418 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:25.010625 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:25.010590 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:26.825665 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:26.825631 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:28.491492 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:28.491459 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:28.593412 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:28.593378 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:29.038343 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:29.038309 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:29.227786 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:29.227752 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:29.867173 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:29.867132 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:29.929214 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:29.929183 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:33.174474 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.174442 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dlm28"] Jul 29 10:09:33.177533 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.177518 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dlm28" Jul 29 10:09:33.183835 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.183472 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 29 10:09:33.183835 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.183723 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-npknx\"" Jul 29 10:09:33.183975 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.183958 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 29 10:09:33.198402 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.198379 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dlm28"] Jul 29 10:09:33.343912 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.343877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e773f4d-fd7d-4735-aee4-8d84f8a342ee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dlm28\" (UID: \"5e773f4d-fd7d-4735-aee4-8d84f8a342ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dlm28" Jul 29 10:09:33.343912 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.343915 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pftbg\" (UniqueName: \"kubernetes.io/projected/5e773f4d-fd7d-4735-aee4-8d84f8a342ee-kube-api-access-pftbg\") pod \"cert-manager-cainjector-559cdd8c87-dlm28\" (UID: \"5e773f4d-fd7d-4735-aee4-8d84f8a342ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dlm28" Jul 29 10:09:33.445200 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.445167 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e773f4d-fd7d-4735-aee4-8d84f8a342ee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dlm28\" (UID: \"5e773f4d-fd7d-4735-aee4-8d84f8a342ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dlm28" Jul 29 10:09:33.445397 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.445210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pftbg\" (UniqueName: \"kubernetes.io/projected/5e773f4d-fd7d-4735-aee4-8d84f8a342ee-kube-api-access-pftbg\") pod \"cert-manager-cainjector-559cdd8c87-dlm28\" (UID: \"5e773f4d-fd7d-4735-aee4-8d84f8a342ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dlm28" Jul 29 10:09:33.457846 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.457816 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e773f4d-fd7d-4735-aee4-8d84f8a342ee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dlm28\" (UID: \"5e773f4d-fd7d-4735-aee4-8d84f8a342ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dlm28" Jul 29 10:09:33.459520 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.459501 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pftbg\" (UniqueName: \"kubernetes.io/projected/5e773f4d-fd7d-4735-aee4-8d84f8a342ee-kube-api-access-pftbg\") pod \"cert-manager-cainjector-559cdd8c87-dlm28\" (UID: \"5e773f4d-fd7d-4735-aee4-8d84f8a342ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dlm28" Jul 29 10:09:33.502158 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.502132 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dlm28" Jul 29 10:09:33.631243 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.631218 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dlm28"] Jul 29 10:09:33.633630 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:09:33.633596 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e773f4d_fd7d_4735_aee4_8d84f8a342ee.slice/crio-5fd5622881f396fbb00af2cbb605f521b20e465b7b916d015faea011c0db7fa0 WatchSource:0}: Error finding container 5fd5622881f396fbb00af2cbb605f521b20e465b7b916d015faea011c0db7fa0: Status 404 returned error can't find the container with id 5fd5622881f396fbb00af2cbb605f521b20e465b7b916d015faea011c0db7fa0 Jul 29 10:09:33.635480 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.635464 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 10:09:33.960329 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:33.960295 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dlm28" event={"ID":"5e773f4d-fd7d-4735-aee4-8d84f8a342ee","Type":"ContainerStarted","Data":"5fd5622881f396fbb00af2cbb605f521b20e465b7b916d015faea011c0db7fa0"} Jul 29 10:09:36.976443 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:36.976412 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dlm28" event={"ID":"5e773f4d-fd7d-4735-aee4-8d84f8a342ee","Type":"ContainerStarted","Data":"6ece67303dbe3cf4e5a8f046bc449e5a925b0021d5e37639a930948a0219821c"} Jul 29 10:09:36.994936 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:36.994883 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dlm28" podStartSLOduration=1.100766177 podStartE2EDuration="3.994868552s" totalImagesPullingTime="2.894102375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:09:36.993232643 +0000 UTC m=+326.114026037" watchObservedRunningTime="2026-07-29 10:09:36.994868552 +0000 UTC m=+326.115661947" Jul 29 10:09:37.234190 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.234108 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:37.330667 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.330632 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:37.414708 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.414672 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pzzm6"] Jul 29 10:09:37.418115 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.418097 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pzzm6" Jul 29 10:09:37.421526 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.421506 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2hpt6\"" Jul 29 10:09:37.428552 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.428529 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pzzm6"] Jul 29 10:09:37.579911 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.579827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0faf45d8-20ac-4f00-81ca-0b6ed51f7da2-bound-sa-token\") pod \"cert-manager-55b4d954d5-pzzm6\" (UID: \"0faf45d8-20ac-4f00-81ca-0b6ed51f7da2\") " pod="cert-manager/cert-manager-55b4d954d5-pzzm6" Jul 29 10:09:37.579911 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.579882 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x69br\" (UniqueName: \"kubernetes.io/projected/0faf45d8-20ac-4f00-81ca-0b6ed51f7da2-kube-api-access-x69br\") pod \"cert-manager-55b4d954d5-pzzm6\" (UID: \"0faf45d8-20ac-4f00-81ca-0b6ed51f7da2\") " pod="cert-manager/cert-manager-55b4d954d5-pzzm6" Jul 29 10:09:37.680828 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.680791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x69br\" (UniqueName: \"kubernetes.io/projected/0faf45d8-20ac-4f00-81ca-0b6ed51f7da2-kube-api-access-x69br\") pod \"cert-manager-55b4d954d5-pzzm6\" (UID: \"0faf45d8-20ac-4f00-81ca-0b6ed51f7da2\") " pod="cert-manager/cert-manager-55b4d954d5-pzzm6" Jul 29 10:09:37.681020 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.680906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0faf45d8-20ac-4f00-81ca-0b6ed51f7da2-bound-sa-token\") pod \"cert-manager-55b4d954d5-pzzm6\" (UID: \"0faf45d8-20ac-4f00-81ca-0b6ed51f7da2\") " pod="cert-manager/cert-manager-55b4d954d5-pzzm6" Jul 29 10:09:37.689899 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.689874 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0faf45d8-20ac-4f00-81ca-0b6ed51f7da2-bound-sa-token\") pod \"cert-manager-55b4d954d5-pzzm6\" (UID: \"0faf45d8-20ac-4f00-81ca-0b6ed51f7da2\") " pod="cert-manager/cert-manager-55b4d954d5-pzzm6" Jul 29 10:09:37.690037 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.689931 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x69br\" (UniqueName: \"kubernetes.io/projected/0faf45d8-20ac-4f00-81ca-0b6ed51f7da2-kube-api-access-x69br\") pod \"cert-manager-55b4d954d5-pzzm6\" (UID: \"0faf45d8-20ac-4f00-81ca-0b6ed51f7da2\") " pod="cert-manager/cert-manager-55b4d954d5-pzzm6" Jul 29 10:09:37.728036 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.727975 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pzzm6" Jul 29 10:09:37.855760 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.855735 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pzzm6"] Jul 29 10:09:37.982478 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.982448 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pzzm6" event={"ID":"0faf45d8-20ac-4f00-81ca-0b6ed51f7da2","Type":"ContainerStarted","Data":"aca0be27c96e1c173bec570e627efd38e1c4787b3bbafca56703d0f9e7a17d30"} Jul 29 10:09:37.982478 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:37.982487 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pzzm6" event={"ID":"0faf45d8-20ac-4f00-81ca-0b6ed51f7da2","Type":"ContainerStarted","Data":"1535939c58170216613a31c448bcee368f25fea01fb68634163f7baba69898ed"} Jul 29 10:09:38.001435 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:38.001370 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pzzm6" podStartSLOduration=1.001354457 podStartE2EDuration="1.001354457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:09:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:09:38.000368634 +0000 UTC m=+327.121162061" watchObservedRunningTime="2026-07-29 10:09:38.001354457 +0000 UTC m=+327.122147849" Jul 29 10:09:38.789911 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:38.789879 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:38.851542 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:38.851515 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:52.196342 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:52.196310 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:52.302572 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:52.302543 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:09:59.555315 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:09:59.555281 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:10:00.935507 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:10:00.935475 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:10:08.868968 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:10:08.868932 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:10:10.255834 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:10:10.255797 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:10:38.843103 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:10:38.843066 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:10:55.834600 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:10:55.834563 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:10:55.933653 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:10:55.933594 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:10:56.034509 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:10:56.034474 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:11:03.140994 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:03.140959 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:11:03.213137 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:03.213110 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:11:46.668148 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:46.668111 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:11:46.756904 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:46.756873 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:11:48.902801 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:48.902766 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:11:49.519324 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:49.519282 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:11:50.841614 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.841583 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5754bbb8bc-mnxhg"] Jul 29 10:11:50.844110 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.844091 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.846787 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.846766 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 10:11:50.848008 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.847958 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 10:11:50.848116 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.848036 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 10:11:50.848116 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.848086 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 10:11:50.848116 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.847958 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8kxqq\"" Jul 29 10:11:50.848278 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.848040 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 10:11:50.852538 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.852520 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 10:11:50.855609 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.855588 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5754bbb8bc-mnxhg"] Jul 29 10:11:50.884470 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.884444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-console-serving-cert\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.884614 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.884481 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-trusted-ca-bundle\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.884614 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.884511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-console-oauth-config\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.884614 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.884603 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-console-config\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.884755 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.884630 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-service-ca\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.884811 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.884764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-oauth-serving-cert\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.884811 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.884791 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxd6f\" (UniqueName: \"kubernetes.io/projected/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-kube-api-access-sxd6f\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.893892 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.893862 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:11:50.985653 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.985621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-oauth-serving-cert\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.985653 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.985653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxd6f\" (UniqueName: \"kubernetes.io/projected/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-kube-api-access-sxd6f\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.985890 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.985682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-console-serving-cert\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.985890 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.985707 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-trusted-ca-bundle\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.985890 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.985875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-console-oauth-config\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.986075 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.985937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-console-config\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.986205 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.986184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-service-ca\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.986486 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.986463 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-oauth-serving-cert\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.986606 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.986579 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-service-ca\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.986722 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.986621 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-console-config\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.986781 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.986726 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-trusted-ca-bundle\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.988705 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.988683 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-console-oauth-config\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.988797 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.988771 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-console-serving-cert\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.993875 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.993855 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxd6f\" (UniqueName: \"kubernetes.io/projected/ff8b69a2-8cd8-4b18-91e4-d566c78d3906-kube-api-access-sxd6f\") pod \"console-5754bbb8bc-mnxhg\" (UID: \"ff8b69a2-8cd8-4b18-91e4-d566c78d3906\") " pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:50.994392 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:50.994366 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:11:51.155557 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:51.155479 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:11:51.284756 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:51.284731 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5754bbb8bc-mnxhg"] Jul 29 10:11:51.286790 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:11:51.286762 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff8b69a2_8cd8_4b18_91e4_d566c78d3906.slice/crio-6039cff62ddcf8395eafb504133e96ff727919b600d228dfb32300d3625361f5 WatchSource:0}: Error finding container 6039cff62ddcf8395eafb504133e96ff727919b600d228dfb32300d3625361f5: Status 404 returned error can't find the container with id 6039cff62ddcf8395eafb504133e96ff727919b600d228dfb32300d3625361f5 Jul 29 10:11:51.518135 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:51.518100 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5754bbb8bc-mnxhg" event={"ID":"ff8b69a2-8cd8-4b18-91e4-d566c78d3906","Type":"ContainerStarted","Data":"f4282155ab78622ac218caed309792a834f93d02b7282bb0020949600835d658"} Jul 29 10:11:51.518269 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:51.518157 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5754bbb8bc-mnxhg" event={"ID":"ff8b69a2-8cd8-4b18-91e4-d566c78d3906","Type":"ContainerStarted","Data":"6039cff62ddcf8395eafb504133e96ff727919b600d228dfb32300d3625361f5"} Jul 29 10:11:51.538183 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:51.538137 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5754bbb8bc-mnxhg" podStartSLOduration=1.538124171 podStartE2EDuration="1.538124171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:11:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:11:51.537567684 +0000 UTC m=+460.658361078" watchObservedRunningTime="2026-07-29 10:11:51.538124171 +0000 UTC m=+460.658917565" Jul 29 10:11:53.269580 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:11:53.269546 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:12:01.155745 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:01.155712 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:12:01.156169 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:01.155808 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:12:01.160519 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:01.160497 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:12:01.560741 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:01.560713 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5754bbb8bc-mnxhg" Jul 29 10:12:01.722305 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:01.722275 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:12:01.780866 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:01.780836 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:12:01.843621 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:01.843548 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:12:10.621499 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:10.621462 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:12:10.646122 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:10.646096 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-tdphv"] Jul 29 10:12:10.649383 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:10.649363 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-tdphv" Jul 29 10:12:10.652539 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:10.652523 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 29 10:12:10.652820 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:10.652803 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sqfs6\"" Jul 29 10:12:10.652959 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:10.652947 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 29 10:12:10.662151 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:10.662131 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-tdphv"] Jul 29 10:12:10.760397 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:10.760373 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctj64\" (UniqueName: \"kubernetes.io/projected/ee70a262-c313-41c6-aa10-eef4236c6abe-kube-api-access-ctj64\") pod \"test-trainjob-workflow-node-0-0-tdphv\" (UID: \"ee70a262-c313-41c6-aa10-eef4236c6abe\") " pod="opendatahub/test-trainjob-workflow-node-0-0-tdphv" Jul 29 10:12:10.861649 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:10.861615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctj64\" (UniqueName: \"kubernetes.io/projected/ee70a262-c313-41c6-aa10-eef4236c6abe-kube-api-access-ctj64\") pod \"test-trainjob-workflow-node-0-0-tdphv\" (UID: \"ee70a262-c313-41c6-aa10-eef4236c6abe\") " pod="opendatahub/test-trainjob-workflow-node-0-0-tdphv" Jul 29 10:12:10.871916 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:10.871859 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctj64\" (UniqueName: \"kubernetes.io/projected/ee70a262-c313-41c6-aa10-eef4236c6abe-kube-api-access-ctj64\") pod \"test-trainjob-workflow-node-0-0-tdphv\" (UID: \"ee70a262-c313-41c6-aa10-eef4236c6abe\") " pod="opendatahub/test-trainjob-workflow-node-0-0-tdphv" Jul 29 10:12:10.958830 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:10.958786 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-tdphv" Jul 29 10:12:11.096848 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:11.096698 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-tdphv"] Jul 29 10:12:11.099152 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:12:11.099124 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee70a262_c313_41c6_aa10_eef4236c6abe.slice/crio-fa28d8e826ad11ea6244bc1e160c4cdd734ca839429be2ff6c95f072886f5088 WatchSource:0}: Error finding container fa28d8e826ad11ea6244bc1e160c4cdd734ca839429be2ff6c95f072886f5088: Status 404 returned error can't find the container with id fa28d8e826ad11ea6244bc1e160c4cdd734ca839429be2ff6c95f072886f5088 Jul 29 10:12:11.599073 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:11.599041 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-tdphv" event={"ID":"ee70a262-c313-41c6-aa10-eef4236c6abe","Type":"ContainerStarted","Data":"fa28d8e826ad11ea6244bc1e160c4cdd734ca839429be2ff6c95f072886f5088"} Jul 29 10:12:22.465807 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:22.465775 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:12:56.160306 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:12:56.160226 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:13:14.890928 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:14.890883 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:13:14.995083 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:14.995052 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:13:18.944139 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:18.944106 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-tdphv" event={"ID":"ee70a262-c313-41c6-aa10-eef4236c6abe","Type":"ContainerStarted","Data":"2e50292260b29d5f1b7d109f5ba684848b9e97951673e4a1c87f266748eef5b4"} Jul 29 10:13:18.963796 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:18.963736 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-tdphv" podStartSLOduration=2.209439843 podStartE2EDuration="1m8.963717426s" totalImagesPullingTime="1m6.754277583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:12:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:13:18.963167276 +0000 UTC m=+548.083960663" watchObservedRunningTime="2026-07-29 10:13:18.963717426 +0000 UTC m=+548.084510822" Jul 29 10:13:20.955744 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:20.955714 2577 generic.go:356] "Generic (PLEG): container finished" podID="ee70a262-c313-41c6-aa10-eef4236c6abe" containerID="2e50292260b29d5f1b7d109f5ba684848b9e97951673e4a1c87f266748eef5b4" exitCode=0 Jul 29 10:13:20.956149 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:20.955784 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-tdphv" event={"ID":"ee70a262-c313-41c6-aa10-eef4236c6abe","Type":"ContainerDied","Data":"2e50292260b29d5f1b7d109f5ba684848b9e97951673e4a1c87f266748eef5b4"} Jul 29 10:13:21.964899 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:21.964866 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:13:22.133124 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:22.133097 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-tdphv" Jul 29 10:13:22.263317 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:22.263239 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctj64\" (UniqueName: \"kubernetes.io/projected/ee70a262-c313-41c6-aa10-eef4236c6abe-kube-api-access-ctj64\") pod \"ee70a262-c313-41c6-aa10-eef4236c6abe\" (UID: \"ee70a262-c313-41c6-aa10-eef4236c6abe\") " Jul 29 10:13:22.265338 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:22.265312 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee70a262-c313-41c6-aa10-eef4236c6abe-kube-api-access-ctj64" (OuterVolumeSpecName: "kube-api-access-ctj64") pod "ee70a262-c313-41c6-aa10-eef4236c6abe" (UID: "ee70a262-c313-41c6-aa10-eef4236c6abe"). InnerVolumeSpecName "kube-api-access-ctj64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:13:22.364818 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:22.364786 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctj64\" (UniqueName: \"kubernetes.io/projected/ee70a262-c313-41c6-aa10-eef4236c6abe-kube-api-access-ctj64\") on node \"ip-10-0-141-60.ec2.internal\" DevicePath \"\"" Jul 29 10:13:22.965790 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:22.965766 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-tdphv" Jul 29 10:13:22.966149 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:22.965761 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-tdphv" event={"ID":"ee70a262-c313-41c6-aa10-eef4236c6abe","Type":"ContainerDied","Data":"fa28d8e826ad11ea6244bc1e160c4cdd734ca839429be2ff6c95f072886f5088"} Jul 29 10:13:22.966149 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:22.965880 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa28d8e826ad11ea6244bc1e160c4cdd734ca839429be2ff6c95f072886f5088" Jul 29 10:13:23.924286 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:23.924253 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-tdphv"] Jul 29 10:13:23.929247 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:23.929223 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-tdphv"] Jul 29 10:13:23.948829 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:23.948807 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:13:24.096679 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:24.096646 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:13:24.191624 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:24.191595 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:13:24.302176 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:24.302147 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:13:24.367086 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:24.367060 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:13:25.496591 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:25.496557 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee70a262-c313-41c6-aa10-eef4236c6abe" path="/var/lib/kubelet/pods/ee70a262-c313-41c6-aa10-eef4236c6abe/volumes" Jul 29 10:13:26.158032 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:26.157977 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:13:26.226411 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:13:26.226385 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:14:19.390136 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.390101 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:14:19.536068 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.536039 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7569k/must-gather-99p4p"] Jul 29 10:14:19.536396 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.536385 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee70a262-c313-41c6-aa10-eef4236c6abe" containerName="node" Jul 29 10:14:19.536440 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.536398 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee70a262-c313-41c6-aa10-eef4236c6abe" containerName="node" Jul 29 10:14:19.536474 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.536467 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee70a262-c313-41c6-aa10-eef4236c6abe" containerName="node" Jul 29 10:14:19.538586 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.538570 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7569k/must-gather-99p4p" Jul 29 10:14:19.541840 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.541817 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7569k\"/\"default-dockercfg-clk7g\"" Jul 29 10:14:19.542030 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.541881 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7569k\"/\"kube-root-ca.crt\"" Jul 29 10:14:19.542030 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.542023 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7569k\"/\"openshift-service-ca.crt\"" Jul 29 10:14:19.553027 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.552979 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7569k/must-gather-99p4p"] Jul 29 10:14:19.657812 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.657729 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzpnq\" (UniqueName: \"kubernetes.io/projected/853fc333-d9c5-4870-bf90-5b2fc596ffdc-kube-api-access-mzpnq\") pod \"must-gather-99p4p\" (UID: \"853fc333-d9c5-4870-bf90-5b2fc596ffdc\") " pod="openshift-must-gather-7569k/must-gather-99p4p" Jul 29 10:14:19.657812 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.657774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/853fc333-d9c5-4870-bf90-5b2fc596ffdc-must-gather-output\") pod \"must-gather-99p4p\" (UID: \"853fc333-d9c5-4870-bf90-5b2fc596ffdc\") " pod="openshift-must-gather-7569k/must-gather-99p4p" Jul 29 10:14:19.758688 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.758654 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzpnq\" (UniqueName: \"kubernetes.io/projected/853fc333-d9c5-4870-bf90-5b2fc596ffdc-kube-api-access-mzpnq\") pod \"must-gather-99p4p\" (UID: \"853fc333-d9c5-4870-bf90-5b2fc596ffdc\") " pod="openshift-must-gather-7569k/must-gather-99p4p" Jul 29 10:14:19.758863 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.758700 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/853fc333-d9c5-4870-bf90-5b2fc596ffdc-must-gather-output\") pod \"must-gather-99p4p\" (UID: \"853fc333-d9c5-4870-bf90-5b2fc596ffdc\") " pod="openshift-must-gather-7569k/must-gather-99p4p" Jul 29 10:14:19.759053 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.759027 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/853fc333-d9c5-4870-bf90-5b2fc596ffdc-must-gather-output\") pod \"must-gather-99p4p\" (UID: \"853fc333-d9c5-4870-bf90-5b2fc596ffdc\") " pod="openshift-must-gather-7569k/must-gather-99p4p" Jul 29 10:14:19.768396 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.768363 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzpnq\" (UniqueName: \"kubernetes.io/projected/853fc333-d9c5-4870-bf90-5b2fc596ffdc-kube-api-access-mzpnq\") pod \"must-gather-99p4p\" (UID: \"853fc333-d9c5-4870-bf90-5b2fc596ffdc\") " pod="openshift-must-gather-7569k/must-gather-99p4p" Jul 29 10:14:19.847513 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.847478 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7569k/must-gather-99p4p" Jul 29 10:14:19.973844 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:19.973812 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7569k/must-gather-99p4p"] Jul 29 10:14:19.976964 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:14:19.976937 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod853fc333_d9c5_4870_bf90_5b2fc596ffdc.slice/crio-72069d223cc486cea0bf74b00333d5c178b283ac557730ea7cb344a8b3cc6437 WatchSource:0}: Error finding container 72069d223cc486cea0bf74b00333d5c178b283ac557730ea7cb344a8b3cc6437: Status 404 returned error can't find the container with id 72069d223cc486cea0bf74b00333d5c178b283ac557730ea7cb344a8b3cc6437 Jul 29 10:14:20.202827 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:20.202791 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7569k/must-gather-99p4p" event={"ID":"853fc333-d9c5-4870-bf90-5b2fc596ffdc","Type":"ContainerStarted","Data":"72069d223cc486cea0bf74b00333d5c178b283ac557730ea7cb344a8b3cc6437"} Jul 29 10:14:21.046255 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:21.046223 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:14:21.210270 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:21.210237 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7569k/must-gather-99p4p" event={"ID":"853fc333-d9c5-4870-bf90-5b2fc596ffdc","Type":"ContainerStarted","Data":"b48f2ff83fff1cd368fad00508ac9b5eea7836b6ea760c7afb5510f86d8638fe"} Jul 29 10:14:21.210440 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:21.210281 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7569k/must-gather-99p4p" event={"ID":"853fc333-d9c5-4870-bf90-5b2fc596ffdc","Type":"ContainerStarted","Data":"ceafcce0bf0e0018d2d8e6c2e18ae8854f3f55b0202ca97725d4ca3b726d3dbf"} Jul 29 10:14:21.228167 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:21.228115 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7569k/must-gather-99p4p" podStartSLOduration=1.388733776 podStartE2EDuration="2.228098582s" totalImagesPullingTime="839.364806ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:14:21.226731832 +0000 UTC m=+610.347525226" watchObservedRunningTime="2026-07-29 10:14:21.228098582 +0000 UTC m=+610.348891975" Jul 29 10:14:22.337153 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:22.337128 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jp7ll_c70c9c83-ba38-4fcb-ad4e-1532b36229ed/global-pull-secret-syncer/0.log" Jul 29 10:14:22.461243 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:22.461212 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" Jul 29 10:14:22.574028 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:22.573975 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-60.ec2.internal_52a974b3871525f86872b1ca0a85018c/haproxy/0.log" Jul 29 10:14:25.013926 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:25.013890 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:14:25.082125 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:25.082089 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:14:26.218450 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.218423 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_865a895b-7531-467f-8544-4d2852d28306/alertmanager/0.log" Jul 29 10:14:26.250223 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.250192 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_865a895b-7531-467f-8544-4d2852d28306/config-reloader/0.log" Jul 29 10:14:26.279582 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.279548 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_865a895b-7531-467f-8544-4d2852d28306/kube-rbac-proxy-web/0.log" Jul 29 10:14:26.310249 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.310217 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_865a895b-7531-467f-8544-4d2852d28306/kube-rbac-proxy/0.log" Jul 29 10:14:26.340249 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.340219 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_865a895b-7531-467f-8544-4d2852d28306/kube-rbac-proxy-metric/0.log" Jul 29 10:14:26.370085 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.370064 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_865a895b-7531-467f-8544-4d2852d28306/prom-label-proxy/0.log" Jul 29 10:14:26.400491 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.400461 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_865a895b-7531-467f-8544-4d2852d28306/init-config-reloader/0.log" Jul 29 10:14:26.480041 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.479937 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-w5tkj_2fbce395-c761-480c-a1e6-e6ae4ba653df/kube-state-metrics/0.log" Jul 29 10:14:26.505952 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.505925 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-w5tkj_2fbce395-c761-480c-a1e6-e6ae4ba653df/kube-rbac-proxy-main/0.log" Jul 29 10:14:26.543005 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.542960 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-w5tkj_2fbce395-c761-480c-a1e6-e6ae4ba653df/kube-rbac-proxy-self/0.log" Jul 29 10:14:26.581657 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.581624 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-877fd99b-2hwqx_c025de3d-99a8-45ea-862e-cecd07377c52/metrics-server/0.log" Jul 29 10:14:26.611344 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.611317 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-sw4q5_044ff117-dade-48f3-bd1e-fa5de90bcddc/monitoring-plugin/0.log" Jul 29 10:14:26.727621 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.727585 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p5gkv_95855b9d-6612-4182-9ad0-8ea89de5f1c9/node-exporter/0.log" Jul 29 10:14:26.752627 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.752539 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p5gkv_95855b9d-6612-4182-9ad0-8ea89de5f1c9/kube-rbac-proxy/0.log" Jul 29 10:14:26.775888 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.775857 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p5gkv_95855b9d-6612-4182-9ad0-8ea89de5f1c9/init-textfile/0.log" Jul 29 10:14:26.886095 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.886059 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-8c9dd_b1950b4b-53df-42d5-a339-23b887bc8c5c/kube-rbac-proxy-main/0.log" Jul 29 10:14:26.910777 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.910754 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-8c9dd_b1950b4b-53df-42d5-a339-23b887bc8c5c/kube-rbac-proxy-self/0.log" Jul 29 10:14:26.938875 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.938834 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-8c9dd_b1950b4b-53df-42d5-a339-23b887bc8c5c/openshift-state-metrics/0.log" Jul 29 10:14:26.978181 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:26.978118 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e/prometheus/0.log" Jul 29 10:14:27.002365 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.002324 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e/config-reloader/0.log" Jul 29 10:14:27.027356 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.027264 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e/thanos-sidecar/0.log" Jul 29 10:14:27.055121 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.055059 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e/kube-rbac-proxy-web/0.log" Jul 29 10:14:27.086352 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.086328 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e/kube-rbac-proxy/0.log" Jul 29 10:14:27.116484 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.116459 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e/kube-rbac-proxy-thanos/0.log" Jul 29 10:14:27.143316 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.143291 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5ac9ee56-94e9-4fd9-8464-0c9b6f62fd5e/init-config-reloader/0.log" Jul 29 10:14:27.176525 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.176483 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-5wgcv_ccd18598-498a-4899-80ee-2953e1620c4b/prometheus-operator/0.log" Jul 29 10:14:27.199920 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.199893 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-5wgcv_ccd18598-498a-4899-80ee-2953e1620c4b/kube-rbac-proxy/0.log" Jul 29 10:14:27.254969 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.254926 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-jnnfz_832ec802-27e7-4f28-9971-a39fae384923/prometheus-operator-admission-webhook/0.log" Jul 29 10:14:27.312095 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.312015 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bfc9c454b-6vdq5_e03ea387-dd9d-41c5-8b83-7e479bf42345/telemeter-client/0.log" Jul 29 10:14:27.349848 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.349815 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bfc9c454b-6vdq5_e03ea387-dd9d-41c5-8b83-7e479bf42345/reload/0.log" Jul 29 10:14:27.386705 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.386661 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bfc9c454b-6vdq5_e03ea387-dd9d-41c5-8b83-7e479bf42345/kube-rbac-proxy/0.log" Jul 29 10:14:27.435289 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.435243 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d9dd7f9cb-mtvkp_19fe0bcf-51c7-4f16-af1d-1dc958d5e75c/thanos-query/0.log" Jul 29 10:14:27.469940 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.469908 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d9dd7f9cb-mtvkp_19fe0bcf-51c7-4f16-af1d-1dc958d5e75c/kube-rbac-proxy-web/0.log" Jul 29 10:14:27.503707 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.503627 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d9dd7f9cb-mtvkp_19fe0bcf-51c7-4f16-af1d-1dc958d5e75c/kube-rbac-proxy/0.log" Jul 29 10:14:27.534011 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.533962 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d9dd7f9cb-mtvkp_19fe0bcf-51c7-4f16-af1d-1dc958d5e75c/prom-label-proxy/0.log" Jul 29 10:14:27.566222 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.566154 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d9dd7f9cb-mtvkp_19fe0bcf-51c7-4f16-af1d-1dc958d5e75c/kube-rbac-proxy-rules/0.log" Jul 29 10:14:27.600836 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:27.600807 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d9dd7f9cb-mtvkp_19fe0bcf-51c7-4f16-af1d-1dc958d5e75c/kube-rbac-proxy-metrics/0.log" Jul 29 10:14:28.856417 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:28.856362 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:14:28.920144 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:28.920117 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2lmjk_b4c766cb-3afa-4166-b24f-958b9c0b3bb1/konnectivity-agent/0.log" limit=1024 Jul 29 10:14:29.766425 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.766398 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5754bbb8bc-mnxhg_ff8b69a2-8cd8-4b18-91e4-d566c78d3906/console/0.log" Jul 29 10:14:29.800859 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.800829 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-zj5jk_4272ab48-a027-4870-b2e4-36707a0caa75/download-server/0.log" Jul 29 10:14:29.836426 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.836391 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx"] Jul 29 10:14:29.841396 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.841370 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.847712 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.847680 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d3c8851-0d90-4478-a07c-fd242c27d70b-lib-modules\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.847889 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.847773 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d3c8851-0d90-4478-a07c-fd242c27d70b-sys\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.847965 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.847886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8xvx\" (UniqueName: \"kubernetes.io/projected/1d3c8851-0d90-4478-a07c-fd242c27d70b-kube-api-access-r8xvx\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.848076 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.847977 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d3c8851-0d90-4478-a07c-fd242c27d70b-podres\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.848076 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.848065 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d3c8851-0d90-4478-a07c-fd242c27d70b-proc\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.853321 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.853295 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx"] Jul 29 10:14:29.949264 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.949225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d3c8851-0d90-4478-a07c-fd242c27d70b-podres\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.949722 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.949693 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d3c8851-0d90-4478-a07c-fd242c27d70b-proc\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.949794 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.949401 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d3c8851-0d90-4478-a07c-fd242c27d70b-podres\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.949794 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.949753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d3c8851-0d90-4478-a07c-fd242c27d70b-lib-modules\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.949794 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.949788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d3c8851-0d90-4478-a07c-fd242c27d70b-sys\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.949939 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.949807 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d3c8851-0d90-4478-a07c-fd242c27d70b-proc\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.949939 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.949860 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d3c8851-0d90-4478-a07c-fd242c27d70b-sys\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.950058 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.949934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8xvx\" (UniqueName: \"kubernetes.io/projected/1d3c8851-0d90-4478-a07c-fd242c27d70b-kube-api-access-r8xvx\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.950058 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.949940 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d3c8851-0d90-4478-a07c-fd242c27d70b-lib-modules\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:29.962626 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:29.962597 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8xvx\" (UniqueName: \"kubernetes.io/projected/1d3c8851-0d90-4478-a07c-fd242c27d70b-kube-api-access-r8xvx\") pod \"perf-node-gather-daemonset-8bxvx\" (UID: \"1d3c8851-0d90-4478-a07c-fd242c27d70b\") " pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:30.155764 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:30.155665 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:30.327472 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:30.327445 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx"] Jul 29 10:14:30.330092 ip-10-0-141-60 kubenswrapper[2577]: W0729 10:14:30.330060 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1d3c8851_0d90_4478_a07c_fd242c27d70b.slice/crio-9769f3c9ef84eae45a4b2f00c8b9592dd87b3970ae334209786d534735aeb21d WatchSource:0}: Error finding container 9769f3c9ef84eae45a4b2f00c8b9592dd87b3970ae334209786d534735aeb21d: Status 404 returned error can't find the container with id 9769f3c9ef84eae45a4b2f00c8b9592dd87b3970ae334209786d534735aeb21d Jul 29 10:14:31.287619 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:31.287585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" event={"ID":"1d3c8851-0d90-4478-a07c-fd242c27d70b","Type":"ContainerStarted","Data":"fec916ef0d9d8cfc36071647bca1e0668b01417d072cd2dd50be155ac31afe56"} Jul 29 10:14:31.288049 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:31.287660 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" event={"ID":"1d3c8851-0d90-4478-a07c-fd242c27d70b","Type":"ContainerStarted","Data":"9769f3c9ef84eae45a4b2f00c8b9592dd87b3970ae334209786d534735aeb21d"} Jul 29 10:14:31.288049 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:31.287714 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:31.307236 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:31.307173 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" podStartSLOduration=2.3071533300000002 podStartE2EDuration="2.30715333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:14:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:14:31.306310143 +0000 UTC m=+620.427103559" watchObservedRunningTime="2026-07-29 10:14:31.30715333 +0000 UTC m=+620.427946725" Jul 29 10:14:31.307924 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:31.307907 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mcks8_274c70c3-bc07-45b9-a022-d22424d91ca3/dns/0.log" Jul 29 10:14:31.332747 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:31.332722 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mcks8_274c70c3-bc07-45b9-a022-d22424d91ca3/kube-rbac-proxy/0.log" Jul 29 10:14:31.434432 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:31.434400 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v2zfl_64624666-4239-467e-b6d5-cd37f39a91a0/dns-node-resolver/0.log" Jul 29 10:14:31.982336 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:31.982307 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kj6nw_8449b7fc-e9d6-4e28-ab0c-098653a0038c/node-ca/0.log" Jul 29 10:14:33.182947 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:33.182923 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vc2cq_39d85ba5-919c-4235-acb7-8f7de0f2d0b7/serve-healthcheck-canary/0.log" Jul 29 10:14:33.657513 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:33.657489 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hfdm7_f673db28-e353-4bdc-87ee-be9fee5676ca/kube-rbac-proxy/0.log" Jul 29 10:14:33.679648 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:33.679623 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hfdm7_f673db28-e353-4bdc-87ee-be9fee5676ca/exporter/0.log" Jul 29 10:14:33.701998 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:33.701958 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hfdm7_f673db28-e353-4bdc-87ee-be9fee5676ca/extractor/0.log" Jul 29 10:14:37.306310 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:37.305324 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7569k/perf-node-gather-daemonset-8bxvx" Jul 29 10:14:40.542808 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:40.542773 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8n87s_65c2029e-43db-42df-824c-8b26ae85cae5/kube-multus-additional-cni-plugins/0.log" Jul 29 10:14:40.569679 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:40.569649 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8n87s_65c2029e-43db-42df-824c-8b26ae85cae5/egress-router-binary-copy/0.log" Jul 29 10:14:40.596140 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:40.596111 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8n87s_65c2029e-43db-42df-824c-8b26ae85cae5/cni-plugins/0.log" Jul 29 10:14:40.624235 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:40.624209 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8n87s_65c2029e-43db-42df-824c-8b26ae85cae5/bond-cni-plugin/0.log" Jul 29 10:14:40.652378 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:40.652354 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8n87s_65c2029e-43db-42df-824c-8b26ae85cae5/routeoverride-cni/0.log" Jul 29 10:14:40.682587 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:40.682554 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8n87s_65c2029e-43db-42df-824c-8b26ae85cae5/whereabouts-cni-bincopy/0.log" Jul 29 10:14:40.717302 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:40.717277 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8n87s_65c2029e-43db-42df-824c-8b26ae85cae5/whereabouts-cni/0.log" Jul 29 10:14:41.211865 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:41.211838 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t9h8f_8a572133-c816-43af-a04c-8d8bfe731bf9/kube-multus/0.log" Jul 29 10:14:41.290012 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:41.289933 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bgz7n_abc91ee3-5c70-4596-b6ca-bb8778025009/network-metrics-daemon/0.log" Jul 29 10:14:41.319709 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:41.319675 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bgz7n_abc91ee3-5c70-4596-b6ca-bb8778025009/kube-rbac-proxy/0.log" Jul 29 10:14:42.118512 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:42.118484 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvfh6_696ccdd1-b3a5-41f5-938e-122bbfae3658/ovn-controller/0.log" Jul 29 10:14:42.146563 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:42.146533 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvfh6_696ccdd1-b3a5-41f5-938e-122bbfae3658/ovn-acl-logging/0.log" Jul 29 10:14:42.177190 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:42.177166 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvfh6_696ccdd1-b3a5-41f5-938e-122bbfae3658/kube-rbac-proxy-node/0.log" Jul 29 10:14:42.209136 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:42.209113 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvfh6_696ccdd1-b3a5-41f5-938e-122bbfae3658/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 10:14:42.235034 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:42.235009 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvfh6_696ccdd1-b3a5-41f5-938e-122bbfae3658/northd/0.log" Jul 29 10:14:42.265069 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:42.265046 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvfh6_696ccdd1-b3a5-41f5-938e-122bbfae3658/nbdb/0.log" Jul 29 10:14:42.300580 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:42.300555 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvfh6_696ccdd1-b3a5-41f5-938e-122bbfae3658/sbdb/0.log" Jul 29 10:14:42.360512 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:42.360468 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvfh6_696ccdd1-b3a5-41f5-938e-122bbfae3658/ovnkube-controller/0.log" Jul 29 10:14:43.903446 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:43.903420 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vff5m_89ff5119-9ac3-4530-999d-96605fafbd39/network-check-target-container/0.log" Jul 29 10:14:44.835362 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:44.835336 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-grz4x_14336764-23e1-43c3-b669-115ef1fc5d04/iptables-alerter/0.log" Jul 29 10:14:45.612040 ip-10-0-141-60 kubenswrapper[2577]: I0729 10:14:45.612013 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-sp6sg_4b0de08b-fe5a-4336-9297-5bcc90b4a169/tuned/0.log"