Jul 07 14:07:37.462698 ip-10-0-138-42 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 14:07:37.462710 ip-10-0-138-42 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 14:07:37.462719 ip-10-0-138-42 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 14:07:37.463032 ip-10-0-138-42 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 14:07:47.551095 ip-10-0-138-42 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 14:07:47.551115 ip-10-0-138-42 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 25f18ee028e54c67a9170ec80e7cec64 -- Jul 07 14:09:49.057574 ip-10-0-138-42 systemd[1]: Starting Kubernetes Kubelet... Jul 07 14:09:49.493100 ip-10-0-138-42 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:09:49.493100 ip-10-0-138-42 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 14:09:49.493100 ip-10-0-138-42 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:09:49.493100 ip-10-0-138-42 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 14:09:49.493100 ip-10-0-138-42 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:09:49.493100 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.482590 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 14:09:49.493100 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487011 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:49.493100 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487024 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:49.493100 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487028 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:49.493100 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487032 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:49.493100 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487035 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:49.493100 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487037 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:49.493100 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487042 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:49.493100 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487045 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487049 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487053 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487057 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487060 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487064 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487066 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487074 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487077 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487079 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487082 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487085 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487087 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487090 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487093 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487096 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487098 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487101 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487103 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:49.494501 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487106 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487110 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487114 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487123 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487125 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487128 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487131 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487133 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487136 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487139 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487141 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487144 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487147 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487150 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487152 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487155 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487158 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487161 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487163 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:49.495451 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487166 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487168 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487171 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487173 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487176 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487178 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487181 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487184 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487186 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487189 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487192 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487194 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487197 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487199 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487202 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487204 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487207 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487210 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487213 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:49.496012 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487215 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487218 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487220 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487239 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487244 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487249 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487253 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487256 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487259 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487262 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487265 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487267 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487271 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487274 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487276 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487279 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487282 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487284 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487287 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487289 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:49.496650 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487292 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487295 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487297 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487300 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487303 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487305 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487308 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487311 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487315 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487318 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487321 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487324 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487328 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487331 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.487334 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492320 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492337 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492344 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492350 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:49.497257 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492355 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492359 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492364 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492368 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492373 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492377 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492384 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492392 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492397 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492402 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492407 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492412 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492417 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492422 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492426 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492431 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492435 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492440 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492444 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:49.498018 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492451 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492457 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492462 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492467 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492471 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492475 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492479 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492486 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492490 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492494 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492499 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492505 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492509 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492513 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492518 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492522 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492527 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492531 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492535 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:49.498665 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492539 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492543 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492548 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492552 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492557 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492564 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492569 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492573 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492577 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492581 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492586 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492590 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492594 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492598 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492603 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492608 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492612 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492617 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492620 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492624 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:49.499256 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492629 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492633 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492637 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492641 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492651 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492656 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492661 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492666 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492670 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492674 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492679 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492683 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492687 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492691 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492695 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492701 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492705 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492709 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492713 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492718 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:49.499856 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492722 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492726 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492729 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492734 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492740 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492746 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492751 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492756 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492761 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492765 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492770 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492774 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492778 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492783 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492787 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492791 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.492811 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493430 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493439 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493443 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:49.500559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493447 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493450 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493454 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493459 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493462 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493466 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493470 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493473 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493478 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493482 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493486 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493490 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493494 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493498 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493503 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493507 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493511 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493515 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493519 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493525 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:49.501413 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493531 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493536 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493539 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493543 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493548 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493552 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493558 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493564 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493569 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493576 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493581 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493585 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493591 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493595 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493600 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493605 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493610 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493614 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493617 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493621 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:49.502420 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493625 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493629 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493633 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493637 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493642 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493646 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493650 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493654 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493659 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493664 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493667 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493671 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493675 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493679 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493683 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493687 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493692 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493696 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493700 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:49.503202 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493704 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493709 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493713 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493718 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493724 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493729 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493734 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493738 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493743 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493747 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493750 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493754 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493759 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493763 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493769 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493773 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493778 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493783 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493787 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:49.504539 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493791 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493795 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493799 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493803 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493807 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493811 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493816 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493820 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493825 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493831 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493837 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493842 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493847 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493851 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493856 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493862 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493866 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.493876 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.493999 2570 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494010 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494021 2570 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 14:09:49.505559 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494027 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494034 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494039 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494045 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494051 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494057 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494062 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494067 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494073 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494078 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494083 2570 flags.go:64] FLAG: --cgroup-root="" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494088 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494093 2570 flags.go:64] FLAG: --client-ca-file="" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494097 2570 flags.go:64] FLAG: --cloud-provider="external" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494102 2570 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494109 2570 flags.go:64] FLAG: --cluster-domain="" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494113 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494118 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494123 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494128 2570 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494134 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494139 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494144 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 14:09:49.506779 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494150 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494154 2570 flags.go:64] FLAG: --contention-profiling="false" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494159 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494167 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494173 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494178 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494185 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494190 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494195 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494200 2570 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494204 2570 flags.go:64] FLAG: --enable-server="true" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494209 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494216 2570 flags.go:64] FLAG: --event-burst="100" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494221 2570 flags.go:64] FLAG: --event-qps="50" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494240 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494245 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494250 2570 flags.go:64] FLAG: --eviction-hard="" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494256 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494260 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494265 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494269 2570 flags.go:64] FLAG: --eviction-soft="" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494274 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494278 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494283 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494287 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 14:09:49.507764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494293 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494297 2570 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494301 2570 flags.go:64] FLAG: --feature-gates="" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494307 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494312 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494317 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494322 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494327 2570 flags.go:64] FLAG: --healthz-port="10248" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494332 2570 flags.go:64] FLAG: --help="false" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494337 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-138-42.ec2.internal" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494344 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494349 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494354 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494360 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494371 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494376 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494381 2570 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494386 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494390 2570 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494395 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494400 2570 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494405 2570 flags.go:64] FLAG: --kube-reserved="" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494410 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494415 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 14:09:49.508994 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494419 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494424 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494428 2570 flags.go:64] FLAG: --lock-file="" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494432 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494437 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494442 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494451 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494456 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494461 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494465 2570 flags.go:64] FLAG: --logging-format="text" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494469 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494475 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494480 2570 flags.go:64] FLAG: --manifest-url="" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494484 2570 flags.go:64] FLAG: --manifest-url-header="" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494491 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494496 2570 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494503 2570 flags.go:64] FLAG: --max-pods="110" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494507 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494514 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494518 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494523 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494527 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494533 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494539 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494551 2570 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 14:09:49.609979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494556 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 14:09:49.561494 ip-10-0-138-42 systemd[1]: Started Kubernetes Kubelet. Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494561 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494566 2570 flags.go:64] FLAG: --pod-cidr="" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494571 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494579 2570 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494584 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494589 2570 flags.go:64] FLAG: --pods-per-core="0" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494594 2570 flags.go:64] FLAG: --port="10250" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494598 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494603 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d9c517e6ec17a350" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494608 2570 flags.go:64] FLAG: --qos-reserved="" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494613 2570 flags.go:64] FLAG: --read-only-port="10255" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494618 2570 flags.go:64] FLAG: --register-node="true" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494623 2570 flags.go:64] FLAG: --register-with-taints="" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494629 2570 flags.go:64] FLAG: --registry-burst="10" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494633 2570 flags.go:64] FLAG: --registry-qps="5" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494638 2570 flags.go:64] FLAG: --reserved-cpus="" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494643 2570 flags.go:64] FLAG: --reserved-memory="" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494649 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494654 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494659 2570 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494664 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494669 2570 flags.go:64] FLAG: --runonce="false" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494673 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494678 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 14:09:49.611778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494683 2570 flags.go:64] FLAG: --seccomp-default="false" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494690 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494695 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494700 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494706 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494710 2570 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494715 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494721 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494725 2570 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494729 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494734 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494740 2570 flags.go:64] FLAG: --system-cgroups="" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494744 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494753 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494757 2570 flags.go:64] FLAG: --tls-cert-file="" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494762 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494769 2570 flags.go:64] FLAG: --tls-min-version="" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494773 2570 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494778 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494782 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494787 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494792 2570 flags.go:64] FLAG: --v="2" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494798 2570 flags.go:64] FLAG: --version="false" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494805 2570 flags.go:64] FLAG: --vmodule="" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494811 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 14:09:49.614134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.494817 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495017 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495023 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495028 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495033 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495037 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495041 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495046 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495052 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495057 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495061 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495065 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495069 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495075 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495080 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495087 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495091 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495096 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495100 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495104 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:49.614992 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495108 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495112 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495119 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495126 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495130 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495135 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495139 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495144 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495148 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495153 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495157 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495184 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495191 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495196 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495201 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495206 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495210 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495214 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495219 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495244 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:49.615646 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495250 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495254 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495258 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495263 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495267 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495271 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495275 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495282 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495286 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495291 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495295 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495299 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495303 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495307 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495311 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495315 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495319 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495323 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495327 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495331 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:49.616311 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495336 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495342 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495348 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495353 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495358 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495363 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495368 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495373 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495377 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495382 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495386 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495390 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495396 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495401 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495405 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495412 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495417 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495422 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:49.616882 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495427 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495434 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495440 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495445 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495449 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495454 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495458 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495462 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495466 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495470 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495475 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495479 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495483 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495487 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495492 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495496 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495500 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495505 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495509 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495513 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:51.415366 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495517 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.495521 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.496576 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.505688 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.505703 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.505720 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.505730 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505833 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505849 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505854 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505859 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505864 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505871 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505878 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505884 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:51.416499 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505888 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505893 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505898 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505902 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505907 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505911 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505915 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505920 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505924 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505928 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505932 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505936 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505941 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505945 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505949 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505953 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505957 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505962 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505966 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505970 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:51.417306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505974 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505979 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505983 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505987 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505991 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.505995 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506008 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506013 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506017 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506021 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506026 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506032 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506036 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506040 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506045 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506049 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506054 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506058 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506062 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:51.418122 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506066 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506070 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506074 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506078 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506083 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506087 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506092 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506096 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506100 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506104 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506108 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506114 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506120 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506125 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506130 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506134 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506139 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506143 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506148 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:51.418927 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506152 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506164 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506169 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506173 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506178 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506182 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506187 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506191 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506195 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506199 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506203 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506208 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506212 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506216 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506220 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506242 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506246 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506251 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506255 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506259 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:51.419525 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506262 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506267 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506271 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506275 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506280 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506284 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506288 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506292 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506296 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506300 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506304 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506309 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506313 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.506321 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506563 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:51.420275 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506571 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506575 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506598 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506603 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506606 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506610 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506613 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506617 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506620 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506623 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506627 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506630 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506633 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506636 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506639 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506643 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506646 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506649 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506652 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506655 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:51.420707 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506658 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506661 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506665 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506668 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506672 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506675 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506678 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506681 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506684 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506688 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506690 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506694 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506703 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506707 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506710 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506713 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506716 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506719 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506723 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:51.421306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506727 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506732 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506736 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506740 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506744 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506752 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506756 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506760 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506764 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506769 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506773 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506777 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506781 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506785 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506789 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506793 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506797 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506801 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506805 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506812 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:51.421844 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506817 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506822 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506827 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506831 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506836 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506841 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506853 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506858 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506862 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506867 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506872 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506876 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506882 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506886 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506890 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506897 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506902 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506909 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506915 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506920 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:51.422422 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506924 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506929 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506933 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506938 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506942 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506946 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506951 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506955 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506960 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506964 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506970 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506977 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506981 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506985 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506989 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506993 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.506998 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.507002 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:51.422979 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:49.507006 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:51.423494 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.507021 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:09:51.423494 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.507190 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 14:09:51.423494 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.510030 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 14:09:51.423494 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.511444 2570 server.go:1019] "Starting client certificate rotation" Jul 07 14:09:51.423494 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.511559 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:09:51.423494 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.511604 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:09:51.423494 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.514274 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:09:51.423494 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.516252 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:09:51.423494 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.525251 2570 log.go:25] "Validated CRI v1 runtime API" Jul 07 14:09:51.423494 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.529433 2570 log.go:25] "Validated CRI v1 image API" Jul 07 14:09:51.423494 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.531178 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 14:09:51.423494 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.533891 2570 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9cf828a5-0ab6-4ab7-91a2-e28399ba0d59:/dev/nvme0n1p4 d3f58939-7f73-4e9c-8736-3a293fa03921:/dev/nvme0n1p3] Jul 07 14:09:51.423862 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.533904 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 14:09:51.423970 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.538996 2570 manager.go:216] Machine: {Timestamp:2026-07-07 14:09:49.537576841 +0000 UTC m=+0.361574703 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3116205 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec282333f8c8eb17033cfc851ae88735 SystemUUID:ec282333-f8c8-eb17-033c-fc851ae88735 BootID:25f18ee0-28e5-4c67-a917-0ec80e7cec64 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4f:9a:3f:24:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4f:9a:3f:24:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:08:68:be:eb:28 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 14:09:51.423970 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.539097 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 14:09:51.423970 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.539202 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 14:09:51.423970 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.541108 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 14:09:51.423970 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.541133 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-42.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 14:09:51.423970 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.542512 2570 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 14:09:51.423970 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.542522 2570 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 14:09:51.423970 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.542530 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.543396 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.543784 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.544673 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.549405 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.549526 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.549552 2570 kubelet.go:486] "Attempting to sync node with API server" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.549562 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.549576 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.549586 2570 kubelet.go:398] "Adding apiserver pod source" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.549596 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.549925 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.549944 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.552411 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.554348 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.554374 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.556364 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.556380 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.556386 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.556391 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.556399 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.556405 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.556412 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.556417 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.556423 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.556433 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.556446 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.556451 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.557584 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.557591 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:49.559823 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:49.560113 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.560579 2570 server.go:1268] "Started kubelet" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.560652 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.560672 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.560745 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.565816 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.567122 2570 server.go:310] "Adding debug handlers to kubelet server" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:49.567869 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 14:09:51.424595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.569568 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-42.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.574811 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.574819 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:49.574887 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.575754 2570 factory.go:55] Registering systemd factory Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.575769 2570 factory.go:223] Registration of the systemd container factory successfully Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.575989 2570 factory.go:153] Registering CRI-O factory Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.576007 2570 factory.go:223] Registration of the crio container factory successfully Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.576011 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.576013 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.576036 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.576056 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.576083 2570 factory.go:103] Registering Raw factory Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.576098 2570 manager.go:1196] Started watching for new ooms in manager Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.576116 2570 reconstruct.go:97] "Volume reconstruction finished" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.576123 2570 reconciler.go:29] "Reconciler: start to sync state" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.576459 2570 manager.go:349] Starting recovery of all containers Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.577403 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f5gdb" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:49.578973 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:49.579287 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:49.579538 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-42.ec2.internal.18c007380153d7eb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-42.ec2.internal,UID:ip-10-0-138-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-42.ec2.internal,},FirstTimestamp:2026-07-07 14:09:49.560551403 +0000 UTC m=+0.384549264,LastTimestamp:2026-07-07 14:09:49.560551403 +0000 UTC m=+0.384549264,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-42.ec2.internal,}" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.586611 2570 manager.go:354] Recovery completed Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.586862 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f5gdb" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.590916 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.592735 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.592759 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.592771 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.593245 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.593254 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.593256 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.593320 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.593920 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:51.425681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.593945 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.593957 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.594601 2570 policy_none.go:49] "None policy: Start" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.594622 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.594636 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:49.595034 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-42.ec2.internal.18c00738033f18de default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-42.ec2.internal,UID:ip-10-0-138-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-42.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-42.ec2.internal,},FirstTimestamp:2026-07-07 14:09:49.592746206 +0000 UTC m=+0.416744070,LastTimestamp:2026-07-07 14:09:49.592746206 +0000 UTC m=+0.416744070,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-42.ec2.internal,}" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.595687 2570 policy_none.go:47] "Start" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.630793 2570 manager.go:337] "Starting Device Plugin manager" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:49.630960 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.630974 2570 server.go:87] "Starting device plugin registration server" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.631208 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.631219 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.631292 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.631376 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:49.631383 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:49.631871 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:49.631926 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.336679 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.337689 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.337718 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.337733 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.337766 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.347272 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:51.347294 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-42.ec2.internal\": node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:51.358764 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.375314 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.376402 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.376438 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.376457 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:51.376488 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.378927 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:51.459798 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.476916 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal"] Jul 07 14:09:51.612867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.476987 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.478189 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.478215 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.478230 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.479671 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.479798 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.479821 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.480299 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.480322 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.480335 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.480386 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.480413 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.480424 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.482029 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.482057 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.482232 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/751654497f7f64d912e56b96725ec553-config\") pod \"kube-apiserver-proxy-ip-10-0-138-42.ec2.internal\" (UID: \"751654497f7f64d912e56b96725ec553\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.482285 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2728a1ca5982bc03a654bc9131baaf5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal\" (UID: \"b2728a1ca5982bc03a654bc9131baaf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.482317 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2728a1ca5982bc03a654bc9131baaf5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal\" (UID: \"b2728a1ca5982bc03a654bc9131baaf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.482730 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.482751 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.482765 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:51.511218 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-42.ec2.internal\" not found" node="ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:51.518731 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-42.ec2.internal\" not found" node="ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:51.560374 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:51.614228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.582662 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2728a1ca5982bc03a654bc9131baaf5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal\" (UID: \"b2728a1ca5982bc03a654bc9131baaf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.614982 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.582688 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2728a1ca5982bc03a654bc9131baaf5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal\" (UID: \"b2728a1ca5982bc03a654bc9131baaf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.614982 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.582703 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/751654497f7f64d912e56b96725ec553-config\") pod \"kube-apiserver-proxy-ip-10-0-138-42.ec2.internal\" (UID: \"751654497f7f64d912e56b96725ec553\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.614982 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.582757 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/751654497f7f64d912e56b96725ec553-config\") pod \"kube-apiserver-proxy-ip-10-0-138-42.ec2.internal\" (UID: \"751654497f7f64d912e56b96725ec553\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.614982 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.582774 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2728a1ca5982bc03a654bc9131baaf5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal\" (UID: \"b2728a1ca5982bc03a654bc9131baaf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.614982 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.582757 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2728a1ca5982bc03a654bc9131baaf5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal\" (UID: \"b2728a1ca5982bc03a654bc9131baaf5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.822773 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:51.661382 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:51.822773 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:51.762023 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:51.822773 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.814458 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Jul 07 14:09:51.822773 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:51.822394 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" Jul 07 14:09:52.010735 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:51.862401 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:52.010735 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:51.962981 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:52.173226 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:52.063670 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:52.173226 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:52.068131 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:52.173226 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:52.116379 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 14:09:52.173226 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:52.116491 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:09:52.173226 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:52.116528 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:09:52.173226 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:52.163767 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:52.276393 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:52.194020 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:04:51 +0000 UTC" deadline="2028-03-01 06:58:28.561956211 +0000 UTC" Jul 07 14:09:52.276393 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:52.194043 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14464h48m36.367916244s" Jul 07 14:09:52.276393 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:52.264055 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:52.415262 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:52.345468 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751654497f7f64d912e56b96725ec553.slice/crio-511e3ad5625847d2fff8b2903251754e7e36d7ba617d5a21a9e5331aea5cea3b WatchSource:0}: Error finding container 511e3ad5625847d2fff8b2903251754e7e36d7ba617d5a21a9e5331aea5cea3b: Status 404 returned error can't find the container with id 511e3ad5625847d2fff8b2903251754e7e36d7ba617d5a21a9e5331aea5cea3b Jul 07 14:09:52.415262 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:52.349662 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:09:52.415262 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:52.364426 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:52.415262 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:52.379364 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" event={"ID":"751654497f7f64d912e56b96725ec553","Type":"ContainerStarted","Data":"511e3ad5625847d2fff8b2903251754e7e36d7ba617d5a21a9e5331aea5cea3b"} Jul 07 14:09:52.614860 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:52.464826 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-42.ec2.internal\" not found" Jul 07 14:09:52.614860 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:52.499909 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:52.614860 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:52.580972 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" Jul 07 14:09:52.614860 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:52.596632 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:09:52.614860 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:52.597869 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" Jul 07 14:09:52.614860 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:52.610845 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:09:52.761817 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:52.753931 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2728a1ca5982bc03a654bc9131baaf5.slice/crio-e6b3e91d4c8570ae44092cf9a7356f8cdad3fe27426547fa021966d110b6edfd WatchSource:0}: Error finding container e6b3e91d4c8570ae44092cf9a7356f8cdad3fe27426547fa021966d110b6edfd: Status 404 returned error can't find the container with id e6b3e91d4c8570ae44092cf9a7356f8cdad3fe27426547fa021966d110b6edfd Jul 07 14:09:52.894477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:52.771940 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.155797 2570 apiserver.go:52] "Watching apiserver" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.164727 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.166487 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-6bvcz","openshift-network-diagnostics/network-check-target-mhkl6","openshift-ovn-kubernetes/ovnkube-node-ddpch","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5","openshift-dns/node-resolver-8lrz7","openshift-image-registry/node-ca-hwd8x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal","openshift-multus/multus-additional-cni-plugins-rln75","openshift-multus/multus-qhtwt","openshift-network-operator/iptables-alerter-f457q","kube-system/global-pull-secret-syncer-kk77l","kube-system/konnectivity-agent-h7cnd","kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8r9l7"] Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.168078 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f457q" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.169232 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.169301 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.170495 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.170496 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.170579 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-82hgx\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.170646 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.170688 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.172007 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.172864 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.173085 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.173359 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8lrz7" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.173658 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.173683 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.173696 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.173743 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.174007 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bc72n\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.174131 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.174258 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.174348 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-878h4\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.174460 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hwd8x" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.174496 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.175422 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 14:09:53.228153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.175461 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.175776 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mrvsb\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.175902 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.177339 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.179223 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.179276 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.180577 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.180578 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.180625 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.180626 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7nzhv\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.180642 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xqxzk\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.180783 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.180940 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.181005 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.181378 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.181434 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.181483 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.181434 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.181526 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z44n9\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.181657 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.181740 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.182300 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.184741 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pb54n\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.184778 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h7cnd" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.185014 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.185227 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.186788 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.186993 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kvpc9\"" Jul 07 14:09:53.229781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.187336 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 14:09:53.231350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191597 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-kubelet\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.231350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191629 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a603d868-bba3-41dd-9cc9-df6a86f21dd3-cni-binary-copy\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.231350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191655 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzk7b\" (UniqueName: \"kubernetes.io/projected/a9ec2185-a555-4ab3-b31f-3bb21d16834b-kube-api-access-rzk7b\") pod \"iptables-alerter-f457q\" (UID: \"a9ec2185-a555-4ab3-b31f-3bb21d16834b\") " pod="openshift-network-operator/iptables-alerter-f457q" Jul 07 14:09:53.231350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191680 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-lib-modules\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.231350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191701 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-var-lib-kubelet\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.231350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191724 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-multus-socket-dir-parent\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.231350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191747 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-run-netns\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.231350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191771 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-var-lib-kubelet\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.231350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191795 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btkn4\" (UniqueName: \"kubernetes.io/projected/6e310a06-3d14-41f9-a0c9-c437265aaba7-kube-api-access-btkn4\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.231350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191819 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e94d46e-1981-4a12-9f12-f69e2ff258f8-tmp\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.231350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191842 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-var-lib-openvswitch\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.231350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191866 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-node-log\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.231350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191895 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-ovn-node-metrics-cert\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.231350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191920 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-var-lib-cni-multus\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.232144 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191943 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.232144 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191966 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-device-dir\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.232144 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.191988 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-tuned\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.232144 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192011 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcbf3f4e-4994-44f6-a479-5eecb805c29e-dbus\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:53.232144 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192034 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a603d868-bba3-41dd-9cc9-df6a86f21dd3-multus-daemon-config\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.232144 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192056 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-modprobe-d\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.232144 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192081 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-run-netns\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.232144 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192102 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-etc-kubernetes\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.232144 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192136 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.232144 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192157 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.232144 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192173 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-kubernetes\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.232144 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192186 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-cni-netd\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.232144 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192216 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-cnibin\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.232928 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192240 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85hmx\" (UniqueName: \"kubernetes.io/projected/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-kube-api-access-85hmx\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.232928 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192263 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-socket-dir\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.232928 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192285 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.232928 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192300 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b566614-1557-40f7-bf9b-6b8bda043477-tmp-dir\") pod \"node-resolver-8lrz7\" (UID: \"7b566614-1557-40f7-bf9b-6b8bda043477\") " pod="openshift-dns/node-resolver-8lrz7" Jul 07 14:09:53.232928 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192318 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-run-openvswitch\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.232928 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192339 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-registration-dir\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.232928 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192360 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2215475-b6b9-4620-8be6-51d230f88ab1-serviceca\") pod \"node-ca-hwd8x\" (UID: \"e2215475-b6b9-4620-8be6-51d230f88ab1\") " pod="openshift-image-registry/node-ca-hwd8x" Jul 07 14:09:53.232928 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192375 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-log-socket\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.232928 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192390 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z465\" (UniqueName: \"kubernetes.io/projected/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-kube-api-access-8z465\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.232928 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192404 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxl65\" (UniqueName: \"kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65\") pod \"network-check-target-mhkl6\" (UID: \"1cd5ff19-488c-478e-80ff-213566b198ff\") " pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:09:53.232928 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192417 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9ec2185-a555-4ab3-b31f-3bb21d16834b-iptables-alerter-script\") pod \"iptables-alerter-f457q\" (UID: \"a9ec2185-a555-4ab3-b31f-3bb21d16834b\") " pod="openshift-network-operator/iptables-alerter-f457q" Jul 07 14:09:53.232928 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192441 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp5sb\" (UniqueName: \"kubernetes.io/projected/7b566614-1557-40f7-bf9b-6b8bda043477-kube-api-access-dp5sb\") pod \"node-resolver-8lrz7\" (UID: \"7b566614-1557-40f7-bf9b-6b8bda043477\") " pod="openshift-dns/node-resolver-8lrz7" Jul 07 14:09:53.232928 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192460 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-sysconfig\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.235303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192475 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-multus-cni-dir\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.235303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192490 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-run-multus-certs\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.235303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192503 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs\") pod \"network-metrics-daemon-6bvcz\" (UID: \"58bbe9a4-1a51-4bf4-994a-43e65007a822\") " pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:09:53.235303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192516 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-system-cni-dir\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.235303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192530 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-os-release\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.235303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192586 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-sys-fs\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.235303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192612 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9ec2185-a555-4ab3-b31f-3bb21d16834b-host-slash\") pod \"iptables-alerter-f457q\" (UID: \"a9ec2185-a555-4ab3-b31f-3bb21d16834b\") " pod="openshift-network-operator/iptables-alerter-f457q" Jul 07 14:09:53.235303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192637 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.235303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192659 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b566614-1557-40f7-bf9b-6b8bda043477-hosts-file\") pod \"node-resolver-8lrz7\" (UID: \"7b566614-1557-40f7-bf9b-6b8bda043477\") " pod="openshift-dns/node-resolver-8lrz7" Jul 07 14:09:53.235303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192680 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-system-cni-dir\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.235303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192705 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-run-k8s-cni-cncf-io\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.235303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192727 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x9v6\" (UniqueName: \"kubernetes.io/projected/e2215475-b6b9-4620-8be6-51d230f88ab1-kube-api-access-9x9v6\") pod \"node-ca-hwd8x\" (UID: \"e2215475-b6b9-4620-8be6-51d230f88ab1\") " pod="openshift-image-registry/node-ca-hwd8x" Jul 07 14:09:53.235303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192750 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-sysctl-conf\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.235303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192771 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-host\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.235731 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192800 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g994n\" (UniqueName: \"kubernetes.io/projected/6e94d46e-1981-4a12-9f12-f69e2ff258f8-kube-api-access-g994n\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.235731 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192823 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-run-ovn\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.235731 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192846 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-run-ovn-kubernetes\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.235731 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192880 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2215475-b6b9-4620-8be6-51d230f88ab1-host\") pod \"node-ca-hwd8x\" (UID: \"e2215475-b6b9-4620-8be6-51d230f88ab1\") " pod="openshift-image-registry/node-ca-hwd8x" Jul 07 14:09:53.235731 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192902 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-sysctl-d\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.235731 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192925 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-slash\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.235731 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192948 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-run-systemd\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.235731 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.192975 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.235731 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193000 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-env-overrides\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.235731 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193015 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-var-lib-cni-bin\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.235731 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193040 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-hostroot\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.235731 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193072 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-run\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.235731 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193101 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-sys\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.235731 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193135 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-systemd-units\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.236136 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193163 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-multus-conf-dir\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.236136 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193192 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qdw4\" (UniqueName: \"kubernetes.io/projected/58bbe9a4-1a51-4bf4-994a-43e65007a822-kube-api-access-9qdw4\") pod \"network-metrics-daemon-6bvcz\" (UID: \"58bbe9a4-1a51-4bf4-994a-43e65007a822\") " pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:09:53.236136 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193218 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcbf3f4e-4994-44f6-a479-5eecb805c29e-kubelet-config\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:53.236136 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193241 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:53.236136 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193262 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-etc-openvswitch\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.236136 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193283 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-ovnkube-config\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.236136 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193306 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-ovnkube-script-lib\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.236136 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193328 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqh9s\" (UniqueName: \"kubernetes.io/projected/a603d868-bba3-41dd-9cc9-df6a86f21dd3-kube-api-access-dqh9s\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.236136 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193350 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-cnibin\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.236136 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193373 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-systemd\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.236136 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193394 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-cni-bin\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.236136 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193416 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-os-release\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.236136 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.193438 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.236136 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.199522 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:09:53.236513 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.220741 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4xmql" Jul 07 14:09:53.236513 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.228166 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4xmql" Jul 07 14:09:53.282222 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.282199 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 14:09:53.293889 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.293862 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d416559-3214-42d7-aefb-b7e5c3b223e2-agent-certs\") pod \"konnectivity-agent-h7cnd\" (UID: \"0d416559-3214-42d7-aefb-b7e5c3b223e2\") " pod="kube-system/konnectivity-agent-h7cnd" Jul 07 14:09:53.293983 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.293910 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e94d46e-1981-4a12-9f12-f69e2ff258f8-tmp\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.293983 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.293938 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-var-lib-openvswitch\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.293983 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.293961 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-node-log\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.294082 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.293986 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-ovn-node-metrics-cert\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.294082 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294008 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-var-lib-cni-multus\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.294082 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294032 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.294082 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294055 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-device-dir\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.294082 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294078 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-tuned\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.294271 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294100 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcbf3f4e-4994-44f6-a479-5eecb805c29e-dbus\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:53.294271 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294123 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a603d868-bba3-41dd-9cc9-df6a86f21dd3-multus-daemon-config\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.294271 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294159 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-modprobe-d\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.294271 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294182 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-run-netns\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.294271 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294204 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-etc-kubernetes\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.294271 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294227 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.294458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294276 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.294458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294268 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 14:09:53.294458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294303 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-kubernetes\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.294458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294329 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-cni-netd\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.294458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294351 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-cnibin\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.294458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294378 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85hmx\" (UniqueName: \"kubernetes.io/projected/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-kube-api-access-85hmx\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.294458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294402 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-socket-dir\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.294458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294426 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.294458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294448 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b566614-1557-40f7-bf9b-6b8bda043477-tmp-dir\") pod \"node-resolver-8lrz7\" (UID: \"7b566614-1557-40f7-bf9b-6b8bda043477\") " pod="openshift-dns/node-resolver-8lrz7" Jul 07 14:09:53.294866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294473 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-run-openvswitch\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.294866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294495 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-registration-dir\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.294866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294519 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2215475-b6b9-4620-8be6-51d230f88ab1-serviceca\") pod \"node-ca-hwd8x\" (UID: \"e2215475-b6b9-4620-8be6-51d230f88ab1\") " pod="openshift-image-registry/node-ca-hwd8x" Jul 07 14:09:53.294866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294557 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-log-socket\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.294866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294584 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z465\" (UniqueName: \"kubernetes.io/projected/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-kube-api-access-8z465\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.294866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294608 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxl65\" (UniqueName: \"kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65\") pod \"network-check-target-mhkl6\" (UID: \"1cd5ff19-488c-478e-80ff-213566b198ff\") " pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:09:53.294866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294627 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-etc-kubernetes\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.294866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294632 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9ec2185-a555-4ab3-b31f-3bb21d16834b-iptables-alerter-script\") pod \"iptables-alerter-f457q\" (UID: \"a9ec2185-a555-4ab3-b31f-3bb21d16834b\") " pod="openshift-network-operator/iptables-alerter-f457q" Jul 07 14:09:53.294866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294684 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp5sb\" (UniqueName: \"kubernetes.io/projected/7b566614-1557-40f7-bf9b-6b8bda043477-kube-api-access-dp5sb\") pod \"node-resolver-8lrz7\" (UID: \"7b566614-1557-40f7-bf9b-6b8bda043477\") " pod="openshift-dns/node-resolver-8lrz7" Jul 07 14:09:53.294866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294715 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d416559-3214-42d7-aefb-b7e5c3b223e2-konnectivity-ca\") pod \"konnectivity-agent-h7cnd\" (UID: \"0d416559-3214-42d7-aefb-b7e5c3b223e2\") " pod="kube-system/konnectivity-agent-h7cnd" Jul 07 14:09:53.294866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294744 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-sysconfig\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.294866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294770 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-multus-cni-dir\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.294866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294795 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-run-multus-certs\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.294866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294820 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs\") pod \"network-metrics-daemon-6bvcz\" (UID: \"58bbe9a4-1a51-4bf4-994a-43e65007a822\") " pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:09:53.295477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294850 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-system-cni-dir\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.295477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294876 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-os-release\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.295477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294906 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-sys-fs\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.295477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294931 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9ec2185-a555-4ab3-b31f-3bb21d16834b-host-slash\") pod \"iptables-alerter-f457q\" (UID: \"a9ec2185-a555-4ab3-b31f-3bb21d16834b\") " pod="openshift-network-operator/iptables-alerter-f457q" Jul 07 14:09:53.295477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294955 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.295477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.294978 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b566614-1557-40f7-bf9b-6b8bda043477-hosts-file\") pod \"node-resolver-8lrz7\" (UID: \"7b566614-1557-40f7-bf9b-6b8bda043477\") " pod="openshift-dns/node-resolver-8lrz7" Jul 07 14:09:53.295477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.295002 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-system-cni-dir\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.295477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.295027 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-run-k8s-cni-cncf-io\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.295477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.295052 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x9v6\" (UniqueName: \"kubernetes.io/projected/e2215475-b6b9-4620-8be6-51d230f88ab1-kube-api-access-9x9v6\") pod \"node-ca-hwd8x\" (UID: \"e2215475-b6b9-4620-8be6-51d230f88ab1\") " pod="openshift-image-registry/node-ca-hwd8x" Jul 07 14:09:53.295477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.295076 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-sysctl-conf\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.295477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.295101 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-host\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.295477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.295125 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g994n\" (UniqueName: \"kubernetes.io/projected/6e94d46e-1981-4a12-9f12-f69e2ff258f8-kube-api-access-g994n\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.295477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.295149 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-run-ovn\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.295477 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.295174 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-run-ovn-kubernetes\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.296173 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.295201 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2215475-b6b9-4620-8be6-51d230f88ab1-host\") pod \"node-ca-hwd8x\" (UID: \"e2215475-b6b9-4620-8be6-51d230f88ab1\") " pod="openshift-image-registry/node-ca-hwd8x" Jul 07 14:09:53.296173 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.295225 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-sysctl-d\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.296173 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.295285 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-var-lib-openvswitch\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.296173 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.295616 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:53.296173 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.295707 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs podName:58bbe9a4-1a51-4bf4-994a-43e65007a822 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:53.795668326 +0000 UTC m=+3.014350058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs") pod "network-metrics-daemon-6bvcz" (UID: "58bbe9a4-1a51-4bf4-994a-43e65007a822") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:53.296173 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.295734 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b566614-1557-40f7-bf9b-6b8bda043477-tmp-dir\") pod \"node-resolver-8lrz7\" (UID: \"7b566614-1557-40f7-bf9b-6b8bda043477\") " pod="openshift-dns/node-resolver-8lrz7" Jul 07 14:09:53.296173 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.295894 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-node-log\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.296173 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.295958 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-sysctl-d\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.296173 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296003 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.296173 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296020 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.296173 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296023 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-run-openvswitch\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.296173 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296062 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-registration-dir\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.296173 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296084 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-kubernetes\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.296173 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296131 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-cni-netd\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296145 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-os-release\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296196 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-cnibin\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296246 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-sys-fs\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296289 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-host\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296338 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-sysctl-conf\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296386 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9ec2185-a555-4ab3-b31f-3bb21d16834b-host-slash\") pod \"iptables-alerter-f457q\" (UID: \"a9ec2185-a555-4ab3-b31f-3bb21d16834b\") " pod="openshift-network-operator/iptables-alerter-f457q" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296428 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296413 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2215475-b6b9-4620-8be6-51d230f88ab1-serviceca\") pod \"node-ca-hwd8x\" (UID: \"e2215475-b6b9-4620-8be6-51d230f88ab1\") " pod="openshift-image-registry/node-ca-hwd8x" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296455 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-run-ovn\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296468 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-log-socket\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296477 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b566614-1557-40f7-bf9b-6b8bda043477-hosts-file\") pod \"node-resolver-8lrz7\" (UID: \"7b566614-1557-40f7-bf9b-6b8bda043477\") " pod="openshift-dns/node-resolver-8lrz7" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296517 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-run-k8s-cni-cncf-io\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296530 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-run-ovn-kubernetes\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296564 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-slash\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.296848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296578 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296593 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-slash\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296596 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-run-systemd\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296624 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-system-cni-dir\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296627 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-run-systemd\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296636 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296666 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-env-overrides\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296664 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-system-cni-dir\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296696 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2215475-b6b9-4620-8be6-51d230f88ab1-host\") pod \"node-ca-hwd8x\" (UID: \"e2215475-b6b9-4620-8be6-51d230f88ab1\") " pod="openshift-image-registry/node-ca-hwd8x" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296801 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-var-lib-cni-bin\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296851 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-hostroot\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296875 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-run\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296882 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-sysconfig\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296898 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-sys\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296919 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-systemd-units\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.297583 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296916 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296943 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-multus-conf-dir\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296948 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-modprobe-d\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.296971 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qdw4\" (UniqueName: \"kubernetes.io/projected/58bbe9a4-1a51-4bf4-994a-43e65007a822-kube-api-access-9qdw4\") pod \"network-metrics-daemon-6bvcz\" (UID: \"58bbe9a4-1a51-4bf4-994a-43e65007a822\") " pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297086 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-socket-dir\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297117 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-hostroot\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297137 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-sys\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297172 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-var-lib-cni-multus\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297201 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-var-lib-cni-bin\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297206 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-run\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297230 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-env-overrides\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297244 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcbf3f4e-4994-44f6-a479-5eecb805c29e-kubelet-config\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297237 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e310a06-3d14-41f9-a0c9-c437265aaba7-device-dir\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297271 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297295 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-etc-openvswitch\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.298298 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297319 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-ovnkube-config\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297341 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-ovnkube-script-lib\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297367 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297369 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqh9s\" (UniqueName: \"kubernetes.io/projected/a603d868-bba3-41dd-9cc9-df6a86f21dd3-kube-api-access-dqh9s\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297406 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-cnibin\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297453 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-systemd\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297481 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-cni-bin\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297482 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-run-netns\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297512 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-os-release\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297584 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a603d868-bba3-41dd-9cc9-df6a86f21dd3-multus-daemon-config\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297587 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-os-release\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297623 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-cnibin\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297669 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-systemd\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297736 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297805 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-cni-bin\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.299011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297864 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcbf3f4e-4994-44f6-a479-5eecb805c29e-kubelet-config\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297912 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcbf3f4e-4994-44f6-a479-5eecb805c29e-dbus\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297915 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-multus-cni-dir\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297948 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-multus-conf-dir\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.297981 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-run-multus-certs\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298049 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-etc-openvswitch\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298089 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-kubelet\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298117 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a603d868-bba3-41dd-9cc9-df6a86f21dd3-cni-binary-copy\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298143 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzk7b\" (UniqueName: \"kubernetes.io/projected/a9ec2185-a555-4ab3-b31f-3bb21d16834b-kube-api-access-rzk7b\") pod \"iptables-alerter-f457q\" (UID: \"a9ec2185-a555-4ab3-b31f-3bb21d16834b\") " pod="openshift-network-operator/iptables-alerter-f457q" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298174 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-systemd-units\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298229 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-host-kubelet\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298355 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-lib-modules\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298387 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-var-lib-kubelet\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298412 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-multus-socket-dir-parent\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298417 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-ovnkube-config\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.299713 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298460 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-run-netns\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.300406 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298487 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-var-lib-kubelet\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.300406 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298504 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-lib-modules\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.300406 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298510 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btkn4\" (UniqueName: \"kubernetes.io/projected/6e310a06-3d14-41f9-a0c9-c437265aaba7-kube-api-access-btkn4\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.300406 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.298614 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:53.300406 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298620 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-multus-socket-dir-parent\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.300406 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.298675 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret podName:dcbf3f4e-4994-44f6-a479-5eecb805c29e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:53.798658841 +0000 UTC m=+3.017340561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret") pod "global-pull-secret-syncer-kk77l" (UID: "dcbf3f4e-4994-44f6-a479-5eecb805c29e") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:53.300406 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298684 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a603d868-bba3-41dd-9cc9-df6a86f21dd3-cni-binary-copy\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.300406 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298750 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-run-netns\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.300406 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298751 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e94d46e-1981-4a12-9f12-f69e2ff258f8-var-lib-kubelet\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.300406 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298781 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-ovn-node-metrics-cert\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.300406 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298782 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a603d868-bba3-41dd-9cc9-df6a86f21dd3-host-var-lib-kubelet\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.300406 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.298811 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-ovnkube-script-lib\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.300406 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.299042 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.300406 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.299210 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e94d46e-1981-4a12-9f12-f69e2ff258f8-tmp\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.301086 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.299216 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a9ec2185-a555-4ab3-b31f-3bb21d16834b-iptables-alerter-script\") pod \"iptables-alerter-f457q\" (UID: \"a9ec2185-a555-4ab3-b31f-3bb21d16834b\") " pod="openshift-network-operator/iptables-alerter-f457q" Jul 07 14:09:53.301086 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.300335 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e94d46e-1981-4a12-9f12-f69e2ff258f8-etc-tuned\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.313861 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.313569 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:53.313861 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.313594 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:53.313861 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.313607 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fxl65 for pod openshift-network-diagnostics/network-check-target-mhkl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:53.313861 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.313666 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65 podName:1cd5ff19-488c-478e-80ff-213566b198ff nodeName:}" failed. No retries permitted until 2026-07-07 14:09:53.81364852 +0000 UTC m=+3.032330254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fxl65" (UniqueName: "kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65") pod "network-check-target-mhkl6" (UID: "1cd5ff19-488c-478e-80ff-213566b198ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:53.316167 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.316142 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btkn4\" (UniqueName: \"kubernetes.io/projected/6e310a06-3d14-41f9-a0c9-c437265aaba7-kube-api-access-btkn4\") pod \"aws-ebs-csi-driver-node-bzzf5\" (UID: \"6e310a06-3d14-41f9-a0c9-c437265aaba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.316511 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.316465 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g994n\" (UniqueName: \"kubernetes.io/projected/6e94d46e-1981-4a12-9f12-f69e2ff258f8-kube-api-access-g994n\") pod \"tuned-8r9l7\" (UID: \"6e94d46e-1981-4a12-9f12-f69e2ff258f8\") " pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.320096 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.319702 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzk7b\" (UniqueName: \"kubernetes.io/projected/a9ec2185-a555-4ab3-b31f-3bb21d16834b-kube-api-access-rzk7b\") pod \"iptables-alerter-f457q\" (UID: \"a9ec2185-a555-4ab3-b31f-3bb21d16834b\") " pod="openshift-network-operator/iptables-alerter-f457q" Jul 07 14:09:53.323294 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.323269 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqh9s\" (UniqueName: \"kubernetes.io/projected/a603d868-bba3-41dd-9cc9-df6a86f21dd3-kube-api-access-dqh9s\") pod \"multus-qhtwt\" (UID: \"a603d868-bba3-41dd-9cc9-df6a86f21dd3\") " pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.324341 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.324316 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85hmx\" (UniqueName: \"kubernetes.io/projected/385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1-kube-api-access-85hmx\") pod \"multus-additional-cni-plugins-rln75\" (UID: \"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1\") " pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.324440 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.324381 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp5sb\" (UniqueName: \"kubernetes.io/projected/7b566614-1557-40f7-bf9b-6b8bda043477-kube-api-access-dp5sb\") pod \"node-resolver-8lrz7\" (UID: \"7b566614-1557-40f7-bf9b-6b8bda043477\") " pod="openshift-dns/node-resolver-8lrz7" Jul 07 14:09:53.324500 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.324437 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qdw4\" (UniqueName: \"kubernetes.io/projected/58bbe9a4-1a51-4bf4-994a-43e65007a822-kube-api-access-9qdw4\") pod \"network-metrics-daemon-6bvcz\" (UID: \"58bbe9a4-1a51-4bf4-994a-43e65007a822\") " pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:09:53.326025 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.325993 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x9v6\" (UniqueName: \"kubernetes.io/projected/e2215475-b6b9-4620-8be6-51d230f88ab1-kube-api-access-9x9v6\") pod \"node-ca-hwd8x\" (UID: \"e2215475-b6b9-4620-8be6-51d230f88ab1\") " pod="openshift-image-registry/node-ca-hwd8x" Jul 07 14:09:53.326228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.326207 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z465\" (UniqueName: \"kubernetes.io/projected/b1c041a8-93a4-4e88-a374-7e3b96aa4af3-kube-api-access-8z465\") pod \"ovnkube-node-ddpch\" (UID: \"b1c041a8-93a4-4e88-a374-7e3b96aa4af3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.337766 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.337750 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rln75" Jul 07 14:09:53.346036 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:53.346012 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod385dbecc_18c8_4eb6_aea1_dfdaff0dc7e1.slice/crio-49e9a23617546e01ce7f4030df1785fa9baafb3e0e6807b5934ec880261c43e3 WatchSource:0}: Error finding container 49e9a23617546e01ce7f4030df1785fa9baafb3e0e6807b5934ec880261c43e3: Status 404 returned error can't find the container with id 49e9a23617546e01ce7f4030df1785fa9baafb3e0e6807b5934ec880261c43e3 Jul 07 14:09:53.381328 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.381288 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rln75" event={"ID":"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1","Type":"ContainerStarted","Data":"49e9a23617546e01ce7f4030df1785fa9baafb3e0e6807b5934ec880261c43e3"} Jul 07 14:09:53.382475 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.382442 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" event={"ID":"b2728a1ca5982bc03a654bc9131baaf5","Type":"ContainerStarted","Data":"e6b3e91d4c8570ae44092cf9a7356f8cdad3fe27426547fa021966d110b6edfd"} Jul 07 14:09:53.398975 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.398930 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d416559-3214-42d7-aefb-b7e5c3b223e2-konnectivity-ca\") pod \"konnectivity-agent-h7cnd\" (UID: \"0d416559-3214-42d7-aefb-b7e5c3b223e2\") " pod="kube-system/konnectivity-agent-h7cnd" Jul 07 14:09:53.399099 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.399088 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d416559-3214-42d7-aefb-b7e5c3b223e2-agent-certs\") pod \"konnectivity-agent-h7cnd\" (UID: \"0d416559-3214-42d7-aefb-b7e5c3b223e2\") " pod="kube-system/konnectivity-agent-h7cnd" Jul 07 14:09:53.399750 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.399726 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d416559-3214-42d7-aefb-b7e5c3b223e2-konnectivity-ca\") pod \"konnectivity-agent-h7cnd\" (UID: \"0d416559-3214-42d7-aefb-b7e5c3b223e2\") " pod="kube-system/konnectivity-agent-h7cnd" Jul 07 14:09:53.401718 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.401698 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d416559-3214-42d7-aefb-b7e5c3b223e2-agent-certs\") pod \"konnectivity-agent-h7cnd\" (UID: \"0d416559-3214-42d7-aefb-b7e5c3b223e2\") " pod="kube-system/konnectivity-agent-h7cnd" Jul 07 14:09:53.556658 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.556577 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f457q" Jul 07 14:09:53.566238 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:53.566199 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ec2185_a555_4ab3_b31f_3bb21d16834b.slice/crio-9afe8d33b3f492a84dc5338dfe8f7d6ec9a4079b900efed7eb7b33b19ac127a6 WatchSource:0}: Error finding container 9afe8d33b3f492a84dc5338dfe8f7d6ec9a4079b900efed7eb7b33b19ac127a6: Status 404 returned error can't find the container with id 9afe8d33b3f492a84dc5338dfe8f7d6ec9a4079b900efed7eb7b33b19ac127a6 Jul 07 14:09:53.566894 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.566870 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:09:53.574516 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.574493 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" Jul 07 14:09:53.575951 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:53.575923 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c041a8_93a4_4e88_a374_7e3b96aa4af3.slice/crio-f319c5cf8117976fde7be3b5e5d1cda7a8f7b31be76e0814d68abba32329ac32 WatchSource:0}: Error finding container f319c5cf8117976fde7be3b5e5d1cda7a8f7b31be76e0814d68abba32329ac32: Status 404 returned error can't find the container with id f319c5cf8117976fde7be3b5e5d1cda7a8f7b31be76e0814d68abba32329ac32 Jul 07 14:09:53.581435 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.581409 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8lrz7" Jul 07 14:09:53.584055 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:53.584024 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e310a06_3d14_41f9_a0c9_c437265aaba7.slice/crio-8b82f4e84970b1f8855de8157ed061e69c6a1031134064cc0c4a37265cbe8d0f WatchSource:0}: Error finding container 8b82f4e84970b1f8855de8157ed061e69c6a1031134064cc0c4a37265cbe8d0f: Status 404 returned error can't find the container with id 8b82f4e84970b1f8855de8157ed061e69c6a1031134064cc0c4a37265cbe8d0f Jul 07 14:09:53.590031 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.590001 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hwd8x" Jul 07 14:09:53.590306 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:53.590281 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b566614_1557_40f7_bf9b_6b8bda043477.slice/crio-3817ad76e7ad8a133c11bcd558050a35f1ac6a13cae7b7dfc535602f534fd2dd WatchSource:0}: Error finding container 3817ad76e7ad8a133c11bcd558050a35f1ac6a13cae7b7dfc535602f534fd2dd: Status 404 returned error can't find the container with id 3817ad76e7ad8a133c11bcd558050a35f1ac6a13cae7b7dfc535602f534fd2dd Jul 07 14:09:53.599583 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:53.599560 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2215475_b6b9_4620_8be6_51d230f88ab1.slice/crio-e9697791e8ec1b72df17171f05f8ee94b48240a1eaf7318dc1e758d527aafddc WatchSource:0}: Error finding container e9697791e8ec1b72df17171f05f8ee94b48240a1eaf7318dc1e758d527aafddc: Status 404 returned error can't find the container with id e9697791e8ec1b72df17171f05f8ee94b48240a1eaf7318dc1e758d527aafddc Jul 07 14:09:53.601088 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.600948 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qhtwt" Jul 07 14:09:53.610137 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:53.610111 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda603d868_bba3_41dd_9cc9_df6a86f21dd3.slice/crio-fc0dcb3cbdd50d3eb740429cf4620c10fcc290545926df04de6f8803f77018c3 WatchSource:0}: Error finding container fc0dcb3cbdd50d3eb740429cf4620c10fcc290545926df04de6f8803f77018c3: Status 404 returned error can't find the container with id fc0dcb3cbdd50d3eb740429cf4620c10fcc290545926df04de6f8803f77018c3 Jul 07 14:09:53.614683 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.614662 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" Jul 07 14:09:53.623983 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:53.623955 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e94d46e_1981_4a12_9f12_f69e2ff258f8.slice/crio-115a13ac617342fa57fb6b709a6ef12183ac34b3d3e61a1a5e7b79b67bed7ad1 WatchSource:0}: Error finding container 115a13ac617342fa57fb6b709a6ef12183ac34b3d3e61a1a5e7b79b67bed7ad1: Status 404 returned error can't find the container with id 115a13ac617342fa57fb6b709a6ef12183ac34b3d3e61a1a5e7b79b67bed7ad1 Jul 07 14:09:53.644924 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.644893 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h7cnd" Jul 07 14:09:53.652101 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.652082 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:53.801412 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.801379 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs\") pod \"network-metrics-daemon-6bvcz\" (UID: \"58bbe9a4-1a51-4bf4-994a-43e65007a822\") " pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:09:53.801574 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.801435 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:53.801574 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.801533 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:53.801574 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.801561 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:53.801714 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.801620 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs podName:58bbe9a4-1a51-4bf4-994a-43e65007a822 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:54.801598171 +0000 UTC m=+4.020279888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs") pod "network-metrics-daemon-6bvcz" (UID: "58bbe9a4-1a51-4bf4-994a-43e65007a822") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:53.801714 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.801643 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret podName:dcbf3f4e-4994-44f6-a479-5eecb805c29e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:54.801632745 +0000 UTC m=+4.020314462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret") pod "global-pull-secret-syncer-kk77l" (UID: "dcbf3f4e-4994-44f6-a479-5eecb805c29e") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:53.902716 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:53.902634 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxl65\" (UniqueName: \"kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65\") pod \"network-check-target-mhkl6\" (UID: \"1cd5ff19-488c-478e-80ff-213566b198ff\") " pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:09:53.902873 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.902798 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:53.902873 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.902821 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:53.902873 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.902837 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fxl65 for pod openshift-network-diagnostics/network-check-target-mhkl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:53.903027 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:53.902896 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65 podName:1cd5ff19-488c-478e-80ff-213566b198ff nodeName:}" failed. No retries permitted until 2026-07-07 14:09:54.902877808 +0000 UTC m=+4.121559538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxl65" (UniqueName: "kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65") pod "network-check-target-mhkl6" (UID: "1cd5ff19-488c-478e-80ff-213566b198ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:54.229965 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:54.229882 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:04:53 +0000 UTC" deadline="2028-03-17 23:33:36.25885888 +0000 UTC" Jul 07 14:09:54.229965 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:54.229917 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14865h23m42.028948898s" Jul 07 14:09:54.279623 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:54.279589 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:54.385368 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:54.385324 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" event={"ID":"6e94d46e-1981-4a12-9f12-f69e2ff258f8","Type":"ContainerStarted","Data":"115a13ac617342fa57fb6b709a6ef12183ac34b3d3e61a1a5e7b79b67bed7ad1"} Jul 07 14:09:54.386489 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:54.386455 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qhtwt" event={"ID":"a603d868-bba3-41dd-9cc9-df6a86f21dd3","Type":"ContainerStarted","Data":"fc0dcb3cbdd50d3eb740429cf4620c10fcc290545926df04de6f8803f77018c3"} Jul 07 14:09:54.387702 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:54.387673 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hwd8x" event={"ID":"e2215475-b6b9-4620-8be6-51d230f88ab1","Type":"ContainerStarted","Data":"e9697791e8ec1b72df17171f05f8ee94b48240a1eaf7318dc1e758d527aafddc"} Jul 07 14:09:54.388848 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:54.388820 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8lrz7" event={"ID":"7b566614-1557-40f7-bf9b-6b8bda043477","Type":"ContainerStarted","Data":"3817ad76e7ad8a133c11bcd558050a35f1ac6a13cae7b7dfc535602f534fd2dd"} Jul 07 14:09:54.389906 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:54.389883 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" event={"ID":"b1c041a8-93a4-4e88-a374-7e3b96aa4af3","Type":"ContainerStarted","Data":"f319c5cf8117976fde7be3b5e5d1cda7a8f7b31be76e0814d68abba32329ac32"} Jul 07 14:09:54.390906 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:54.390881 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" event={"ID":"6e310a06-3d14-41f9-a0c9-c437265aaba7","Type":"ContainerStarted","Data":"8b82f4e84970b1f8855de8157ed061e69c6a1031134064cc0c4a37265cbe8d0f"} Jul 07 14:09:54.392021 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:54.392001 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f457q" event={"ID":"a9ec2185-a555-4ab3-b31f-3bb21d16834b","Type":"ContainerStarted","Data":"9afe8d33b3f492a84dc5338dfe8f7d6ec9a4079b900efed7eb7b33b19ac127a6"} Jul 07 14:09:54.811076 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:54.810424 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs\") pod \"network-metrics-daemon-6bvcz\" (UID: \"58bbe9a4-1a51-4bf4-994a-43e65007a822\") " pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:09:54.811076 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:54.810489 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:54.811076 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:54.810644 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:54.811076 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:54.810704 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret podName:dcbf3f4e-4994-44f6-a479-5eecb805c29e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:56.810686326 +0000 UTC m=+6.029368046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret") pod "global-pull-secret-syncer-kk77l" (UID: "dcbf3f4e-4994-44f6-a479-5eecb805c29e") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:54.811076 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:54.810989 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:54.811076 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:54.811049 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs podName:58bbe9a4-1a51-4bf4-994a-43e65007a822 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:56.811031311 +0000 UTC m=+6.029713029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs") pod "network-metrics-daemon-6bvcz" (UID: "58bbe9a4-1a51-4bf4-994a-43e65007a822") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:54.876622 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:09:54.876410 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d416559_3214_42d7_aefb_b7e5c3b223e2.slice/crio-eca8549a470089d431d0c4e39ca10d318409ae2f62a6fe529c0e3a5aa88f4d29 WatchSource:0}: Error finding container eca8549a470089d431d0c4e39ca10d318409ae2f62a6fe529c0e3a5aa88f4d29: Status 404 returned error can't find the container with id eca8549a470089d431d0c4e39ca10d318409ae2f62a6fe529c0e3a5aa88f4d29 Jul 07 14:09:54.912163 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:54.911587 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxl65\" (UniqueName: \"kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65\") pod \"network-check-target-mhkl6\" (UID: \"1cd5ff19-488c-478e-80ff-213566b198ff\") " pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:09:54.912163 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:54.911784 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:54.912163 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:54.911801 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:54.912163 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:54.911813 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fxl65 for pod openshift-network-diagnostics/network-check-target-mhkl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:54.912163 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:54.911866 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65 podName:1cd5ff19-488c-478e-80ff-213566b198ff nodeName:}" failed. No retries permitted until 2026-07-07 14:09:56.911845587 +0000 UTC m=+6.130527315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxl65" (UniqueName: "kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65") pod "network-check-target-mhkl6" (UID: "1cd5ff19-488c-478e-80ff-213566b198ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:55.233171 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:55.233103 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:04:53 +0000 UTC" deadline="2028-01-07 06:07:47.46947532 +0000 UTC" Jul 07 14:09:55.233171 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:55.233167 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13167h57m52.23631208s" Jul 07 14:09:55.379938 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:55.379907 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:55.380126 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:55.380038 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:09:55.380441 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:55.380414 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:09:55.380535 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:55.380510 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:09:55.380609 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:55.380600 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:09:55.380713 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:55.380694 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:09:55.418288 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:55.418255 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h7cnd" event={"ID":"0d416559-3214-42d7-aefb-b7e5c3b223e2","Type":"ContainerStarted","Data":"eca8549a470089d431d0c4e39ca10d318409ae2f62a6fe529c0e3a5aa88f4d29"} Jul 07 14:09:55.422657 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:55.422626 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" event={"ID":"751654497f7f64d912e56b96725ec553","Type":"ContainerStarted","Data":"3f824e3a85bd2a72fd906ea03ff893f6619ac6ff308eda1d31e00b08eaa3f567"} Jul 07 14:09:56.442170 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:56.442133 2570 generic.go:356] "Generic (PLEG): container finished" podID="b2728a1ca5982bc03a654bc9131baaf5" containerID="42e6d774845a3adeed1a86a022fdfe820555b82e0c416b99f69d15d3ae7a0ed1" exitCode=0 Jul 07 14:09:56.442690 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:56.442668 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" event={"ID":"b2728a1ca5982bc03a654bc9131baaf5","Type":"ContainerDied","Data":"42e6d774845a3adeed1a86a022fdfe820555b82e0c416b99f69d15d3ae7a0ed1"} Jul 07 14:09:56.460153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:56.459007 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-42.ec2.internal" podStartSLOduration=4.458986652 podStartE2EDuration="4.458986652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:55.439621051 +0000 UTC m=+4.658302791" watchObservedRunningTime="2026-07-07 14:09:56.458986652 +0000 UTC m=+5.677668391" Jul 07 14:09:56.837867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:56.837065 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs\") pod \"network-metrics-daemon-6bvcz\" (UID: \"58bbe9a4-1a51-4bf4-994a-43e65007a822\") " pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:09:56.837867 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:56.837135 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:56.837867 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:56.837269 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:56.837867 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:56.837330 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret podName:dcbf3f4e-4994-44f6-a479-5eecb805c29e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:00.837312586 +0000 UTC m=+10.055994305 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret") pod "global-pull-secret-syncer-kk77l" (UID: "dcbf3f4e-4994-44f6-a479-5eecb805c29e") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:56.837867 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:56.837735 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:56.837867 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:56.837783 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs podName:58bbe9a4-1a51-4bf4-994a-43e65007a822 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:00.837768192 +0000 UTC m=+10.056449911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs") pod "network-metrics-daemon-6bvcz" (UID: "58bbe9a4-1a51-4bf4-994a-43e65007a822") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:56.938255 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:56.938218 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxl65\" (UniqueName: \"kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65\") pod \"network-check-target-mhkl6\" (UID: \"1cd5ff19-488c-478e-80ff-213566b198ff\") " pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:09:56.938473 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:56.938456 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:56.938533 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:56.938484 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:56.938533 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:56.938498 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fxl65 for pod openshift-network-diagnostics/network-check-target-mhkl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:56.938667 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:56.938568 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65 podName:1cd5ff19-488c-478e-80ff-213566b198ff nodeName:}" failed. No retries permitted until 2026-07-07 14:10:00.938535288 +0000 UTC m=+10.157217010 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxl65" (UniqueName: "kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65") pod "network-check-target-mhkl6" (UID: "1cd5ff19-488c-478e-80ff-213566b198ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:57.387668 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:57.386657 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:57.387668 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:57.386826 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:09:57.387668 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:57.387268 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:09:57.387668 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:57.387390 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:09:57.387668 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:57.387475 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:09:57.387668 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:57.387616 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:09:59.377424 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:59.377260 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:09:59.377424 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:59.377394 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:09:59.377424 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:59.377275 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:09:59.377976 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:59.377487 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:09:59.377976 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:09:59.377512 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:09:59.377976 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:09:59.377610 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:10:00.869763 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:00.869733 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs\") pod \"network-metrics-daemon-6bvcz\" (UID: \"58bbe9a4-1a51-4bf4-994a-43e65007a822\") " pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:00.870188 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:00.869781 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:00.870188 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:00.869877 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:00.870188 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:00.869886 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:00.870188 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:00.869934 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret podName:dcbf3f4e-4994-44f6-a479-5eecb805c29e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:08.869921062 +0000 UTC m=+18.088602779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret") pod "global-pull-secret-syncer-kk77l" (UID: "dcbf3f4e-4994-44f6-a479-5eecb805c29e") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:00.870188 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:00.869953 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs podName:58bbe9a4-1a51-4bf4-994a-43e65007a822 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:08.869942962 +0000 UTC m=+18.088624678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs") pod "network-metrics-daemon-6bvcz" (UID: "58bbe9a4-1a51-4bf4-994a-43e65007a822") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:00.970425 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:00.970383 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxl65\" (UniqueName: \"kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65\") pod \"network-check-target-mhkl6\" (UID: \"1cd5ff19-488c-478e-80ff-213566b198ff\") " pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:00.970609 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:00.970593 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:10:00.970671 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:00.970622 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:10:00.970671 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:00.970635 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fxl65 for pod openshift-network-diagnostics/network-check-target-mhkl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:00.970774 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:00.970692 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65 podName:1cd5ff19-488c-478e-80ff-213566b198ff nodeName:}" failed. No retries permitted until 2026-07-07 14:10:08.970673125 +0000 UTC m=+18.189354853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxl65" (UniqueName: "kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65") pod "network-check-target-mhkl6" (UID: "1cd5ff19-488c-478e-80ff-213566b198ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:01.377992 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:01.377626 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:01.377992 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:01.377720 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:10:01.377992 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:01.377926 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:01.378346 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:01.378052 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:10:01.378346 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:01.378071 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:01.378346 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:01.378186 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:10:03.377299 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:03.377259 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:03.377758 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:03.377259 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:03.377758 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:03.377402 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:10:03.377758 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:03.377261 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:03.377758 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:03.377492 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:10:03.377758 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:03.377573 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:10:05.377777 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:05.377737 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:05.377777 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:05.377775 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:05.378323 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:05.377737 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:05.378323 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:05.377873 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:10:05.378323 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:05.377946 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:10:05.378323 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:05.378032 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:10:07.376887 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:07.376848 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:07.377376 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:07.376852 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:07.377376 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:07.376991 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:07.377376 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:07.376991 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:10:07.377376 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:07.377081 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:10:07.377376 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:07.377193 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:10:08.935618 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:08.935586 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:08.935990 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:08.935644 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs\") pod \"network-metrics-daemon-6bvcz\" (UID: \"58bbe9a4-1a51-4bf4-994a-43e65007a822\") " pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:08.935990 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:08.935729 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:08.935990 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:08.935732 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:08.935990 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:08.935779 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs podName:58bbe9a4-1a51-4bf4-994a-43e65007a822 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:24.935764314 +0000 UTC m=+34.154446031 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs") pod "network-metrics-daemon-6bvcz" (UID: "58bbe9a4-1a51-4bf4-994a-43e65007a822") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:08.935990 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:08.935791 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret podName:dcbf3f4e-4994-44f6-a479-5eecb805c29e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:24.935785226 +0000 UTC m=+34.154466943 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret") pod "global-pull-secret-syncer-kk77l" (UID: "dcbf3f4e-4994-44f6-a479-5eecb805c29e") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:09.035928 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:09.035895 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxl65\" (UniqueName: \"kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65\") pod \"network-check-target-mhkl6\" (UID: \"1cd5ff19-488c-478e-80ff-213566b198ff\") " pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:09.036069 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:09.036057 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:10:09.036107 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:09.036077 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:10:09.036107 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:09.036087 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fxl65 for pod openshift-network-diagnostics/network-check-target-mhkl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:09.036190 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:09.036139 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65 podName:1cd5ff19-488c-478e-80ff-213566b198ff nodeName:}" failed. No retries permitted until 2026-07-07 14:10:25.036121508 +0000 UTC m=+34.254803244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxl65" (UniqueName: "kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65") pod "network-check-target-mhkl6" (UID: "1cd5ff19-488c-478e-80ff-213566b198ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:09.377738 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:09.377696 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:09.377903 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:09.377711 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:09.377903 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:09.377819 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:10:09.378010 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:09.377914 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:10:09.378010 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:09.377711 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:09.378010 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:09.378006 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:10:11.379825 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:11.379791 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:11.380250 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:11.379791 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:11.380250 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:11.379914 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:10:11.380250 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:11.379803 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:11.380250 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:11.380001 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:10:11.380250 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:11.380091 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:10:13.377926 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.377639 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:13.378769 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:13.378027 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:10:13.378769 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.378091 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:13.378769 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.378115 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:13.378769 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:13.378164 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:10:13.378769 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:13.378254 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:10:13.480743 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.480714 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h7cnd" event={"ID":"0d416559-3214-42d7-aefb-b7e5c3b223e2","Type":"ContainerStarted","Data":"7ca6797c1c2060e06741bc807b278b538629f4e6024c08e4fc207d6d5404912d"} Jul 07 14:10:13.482268 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.482247 2570 generic.go:356] "Generic (PLEG): container finished" podID="385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1" containerID="7d7ec4e0f59cd0ffa7f21b73471c439b3944d7bc7b6fb1fb68e74bed0e81458e" exitCode=0 Jul 07 14:10:13.482342 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.482298 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rln75" event={"ID":"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1","Type":"ContainerDied","Data":"7d7ec4e0f59cd0ffa7f21b73471c439b3944d7bc7b6fb1fb68e74bed0e81458e"} Jul 07 14:10:13.483897 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.483873 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" event={"ID":"6e310a06-3d14-41f9-a0c9-c437265aaba7","Type":"ContainerStarted","Data":"803f1e864bef09cd10748a4bc9622798df07828281a9f2b052177fcd27834f3a"} Jul 07 14:10:13.485671 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.485650 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" event={"ID":"b2728a1ca5982bc03a654bc9131baaf5","Type":"ContainerStarted","Data":"65dee5300caf43755634ec18e0ce087397a183593aa105544f93773d05195571"} Jul 07 14:10:13.487389 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.487353 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" event={"ID":"6e94d46e-1981-4a12-9f12-f69e2ff258f8","Type":"ContainerStarted","Data":"7d3078f0d5ced00ec19e4e2cc20061f7c1093ee212ed1e038720a943ed00d94b"} Jul 07 14:10:13.488835 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.488813 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qhtwt" event={"ID":"a603d868-bba3-41dd-9cc9-df6a86f21dd3","Type":"ContainerStarted","Data":"dea9cf8097b0e6432f42bbb0e2479aee56564009e97eda9b43f5368d1028d83a"} Jul 07 14:10:13.489973 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.489954 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hwd8x" event={"ID":"e2215475-b6b9-4620-8be6-51d230f88ab1","Type":"ContainerStarted","Data":"40fbefd7fcb05ed44c217d18eae52abf6aebfb85174f2402de06f181b61fc5fe"} Jul 07 14:10:13.491362 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.491337 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8lrz7" event={"ID":"7b566614-1557-40f7-bf9b-6b8bda043477","Type":"ContainerStarted","Data":"2a9d452370a187468e5bbe97779052015747436b888af715c5040f2f33c66cb8"} Jul 07 14:10:13.493207 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.493185 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" event={"ID":"b1c041a8-93a4-4e88-a374-7e3b96aa4af3","Type":"ContainerStarted","Data":"2aa29e0d2ee8c48979c16c52ec791bca860bac198089213f5fa4104389817009"} Jul 07 14:10:13.493270 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.493258 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" event={"ID":"b1c041a8-93a4-4e88-a374-7e3b96aa4af3","Type":"ContainerStarted","Data":"f911ddea94b7cedde75d7c08201712118f48b2d083fb0fa8a70107aac7bcfd3e"} Jul 07 14:10:13.493321 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.493308 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" event={"ID":"b1c041a8-93a4-4e88-a374-7e3b96aa4af3","Type":"ContainerStarted","Data":"078f55f2eb37b54a5241717c11ba20b52bdd8254ab301a6c02373d1e3d0eeccd"} Jul 07 14:10:13.527535 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.527496 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h7cnd" podStartSLOduration=4.358153859 podStartE2EDuration="22.52746932s" totalImagesPullingTime="18.169315461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:13.502644286 +0000 UTC m=+22.721326027" watchObservedRunningTime="2026-07-07 14:10:13.52746932 +0000 UTC m=+22.746151057" Jul 07 14:10:13.546606 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.546565 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-42.ec2.internal" podStartSLOduration=21.546537455 podStartE2EDuration="21.546537455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:13.54632911 +0000 UTC m=+22.765010848" watchObservedRunningTime="2026-07-07 14:10:13.546537455 +0000 UTC m=+22.765219193" Jul 07 14:10:13.572599 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.572537 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8lrz7" podStartSLOduration=3.106697563 podStartE2EDuration="22.57252205s" totalImagesPullingTime="19.465824487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:13.572332731 +0000 UTC m=+22.791014452" watchObservedRunningTime="2026-07-07 14:10:13.57252205 +0000 UTC m=+22.791203788" Jul 07 14:10:13.613044 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.613007 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hwd8x" podStartSLOduration=3.167120623 podStartE2EDuration="22.612992688s" totalImagesPullingTime="19.445872065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:13.593138603 +0000 UTC m=+22.811820338" watchObservedRunningTime="2026-07-07 14:10:13.612992688 +0000 UTC m=+22.831674427" Jul 07 14:10:13.613199 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.613180 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qhtwt" podStartSLOduration=3.101623637 podStartE2EDuration="22.613173747s" totalImagesPullingTime="19.51155011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:13.612772087 +0000 UTC m=+22.831453826" watchObservedRunningTime="2026-07-07 14:10:13.613173747 +0000 UTC m=+22.831855493" Jul 07 14:10:13.635671 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:13.635624 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8r9l7" podStartSLOduration=3.200654287 podStartE2EDuration="22.635609104s" totalImagesPullingTime="19.434954817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:13.635310531 +0000 UTC m=+22.853992269" watchObservedRunningTime="2026-07-07 14:10:13.635609104 +0000 UTC m=+22.854290944" Jul 07 14:10:14.501980 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:14.501939 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" event={"ID":"b1c041a8-93a4-4e88-a374-7e3b96aa4af3","Type":"ContainerStarted","Data":"ffbb8fb5cd355dcd51bb2979103860c5da48d149677d47bbeec58abfc7d61dbb"} Jul 07 14:10:14.502680 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:14.502074 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" event={"ID":"b1c041a8-93a4-4e88-a374-7e3b96aa4af3","Type":"ContainerStarted","Data":"ad9975d3d0f35d5d91e36ce3576031603acbd445c6843c1c0d6aa355db563059"} Jul 07 14:10:14.502680 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:14.502107 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" event={"ID":"b1c041a8-93a4-4e88-a374-7e3b96aa4af3","Type":"ContainerStarted","Data":"16da52dcae211f27802109cb95b21a43c10a6e3c9de660d7e0ba92b2f1e5bbac"} Jul 07 14:10:15.377147 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:15.377118 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:15.377374 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:15.377118 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:15.377374 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:15.377239 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:10:15.377374 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:15.377320 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:10:15.377374 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:15.377118 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:15.377605 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:15.377406 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:10:15.505578 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:15.505524 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f457q" event={"ID":"a9ec2185-a555-4ab3-b31f-3bb21d16834b","Type":"ContainerStarted","Data":"d43c119187d865101fd62eea1c84c47cd8a3680b2eae06aa601da78d2b96b274"} Jul 07 14:10:15.524985 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:15.524936 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f457q" podStartSLOduration=5.066771875 podStartE2EDuration="24.524917644s" totalImagesPullingTime="19.458145769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:15.52399994 +0000 UTC m=+24.742681681" watchObservedRunningTime="2026-07-07 14:10:15.524917644 +0000 UTC m=+24.743599384" Jul 07 14:10:17.377355 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:17.377319 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:17.377783 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:17.377322 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:17.377783 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:17.377460 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:10:17.377783 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:17.377322 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:17.377783 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:17.377512 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:10:17.377783 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:17.377633 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:10:17.796722 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:17.796648 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h7cnd" Jul 07 14:10:17.797177 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:17.797157 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h7cnd" Jul 07 14:10:18.026792 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:18.026489 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 14:10:18.251772 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:18.251656 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T14:10:18.026719126Z","UUID":"ff59dd11-81d6-4de2-9868-eb6c8c346a05","Handler":null,"Name":"","Endpoint":""} Jul 07 14:10:18.253228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:18.253193 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 14:10:18.253349 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:18.253237 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 14:10:18.515217 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:18.515136 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" event={"ID":"b1c041a8-93a4-4e88-a374-7e3b96aa4af3","Type":"ContainerStarted","Data":"7045aa7bd635f35f41c9f07c54b487f8bd6a9e401398430e90e52c192b24e0ba"} Jul 07 14:10:18.516765 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:18.516745 2570 generic.go:356] "Generic (PLEG): container finished" podID="385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1" containerID="d73f655cc5b108dc9c605fd01e64c768539c02c74fb3fef363dce924b3238d9a" exitCode=0 Jul 07 14:10:18.516882 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:18.516773 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rln75" event={"ID":"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1","Type":"ContainerDied","Data":"d73f655cc5b108dc9c605fd01e64c768539c02c74fb3fef363dce924b3238d9a"} Jul 07 14:10:18.518644 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:18.518625 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" event={"ID":"6e310a06-3d14-41f9-a0c9-c437265aaba7","Type":"ContainerStarted","Data":"5833c45336cebc8cd9562f10a105fc926b921485faa37380acdf89f953a54227"} Jul 07 14:10:18.518840 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:18.518824 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h7cnd" Jul 07 14:10:18.519221 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:18.519205 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h7cnd" Jul 07 14:10:19.377738 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:19.377659 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:19.377902 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:19.377664 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:19.377902 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:19.377762 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:10:19.377902 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:19.377668 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:19.377902 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:19.377855 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:10:19.378088 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:19.377940 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:10:20.526432 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:20.526223 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" event={"ID":"b1c041a8-93a4-4e88-a374-7e3b96aa4af3","Type":"ContainerStarted","Data":"4ff2ade46f683f0b37933f94f33e08b63596963bbc3f581eeb50bac1d02f6f1f"} Jul 07 14:10:20.527054 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:20.526526 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:10:20.528509 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:20.528483 2570 generic.go:356] "Generic (PLEG): container finished" podID="385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1" containerID="d93a9bd43c7eee4234cbcbf24ce42730726a3a32be63a9776fbc99b59c914df8" exitCode=0 Jul 07 14:10:20.528625 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:20.528565 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rln75" event={"ID":"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1","Type":"ContainerDied","Data":"d93a9bd43c7eee4234cbcbf24ce42730726a3a32be63a9776fbc99b59c914df8"} Jul 07 14:10:20.530797 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:20.530773 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" event={"ID":"6e310a06-3d14-41f9-a0c9-c437265aaba7","Type":"ContainerStarted","Data":"842f9a1ea98c724dc591e44e0b87b443381e25295f6b70ab2c283e45ddd6dc5d"} Jul 07 14:10:20.542906 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:20.542889 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:10:20.559217 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:20.559168 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" podStartSLOduration=10.014855822 podStartE2EDuration="29.559155101s" totalImagesPullingTime="19.544299279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:20.55885822 +0000 UTC m=+29.777539959" watchObservedRunningTime="2026-07-07 14:10:20.559155101 +0000 UTC m=+29.777836875" Jul 07 14:10:20.586053 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:20.586013 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzzf5" podStartSLOduration=3.519504463 podStartE2EDuration="29.586003726s" totalImagesPullingTime="26.066499263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:20.585858679 +0000 UTC m=+29.804540417" watchObservedRunningTime="2026-07-07 14:10:20.586003726 +0000 UTC m=+29.804685465" Jul 07 14:10:21.379262 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:21.379226 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:21.379533 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:21.379229 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:21.380668 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:21.380590 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:21.380784 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:21.380707 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:10:21.381007 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:21.380976 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:10:21.381186 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:21.381166 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:10:21.533294 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:21.533267 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:10:21.533601 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:21.533351 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:10:21.547873 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:21.547853 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:10:22.537697 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:22.537520 2570 generic.go:356] "Generic (PLEG): container finished" podID="385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1" containerID="1907def7a8874f35290ddb1e02966c30708cd248d895442f925b07db772b07e1" exitCode=0 Jul 07 14:10:22.538050 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:22.537575 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rln75" event={"ID":"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1","Type":"ContainerDied","Data":"1907def7a8874f35290ddb1e02966c30708cd248d895442f925b07db772b07e1"} Jul 07 14:10:22.594914 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:22.594882 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mhkl6"] Jul 07 14:10:22.595081 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:22.594982 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:22.595081 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:22.595064 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:10:22.598030 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:22.597988 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kk77l"] Jul 07 14:10:22.598143 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:22.598077 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:22.598196 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:22.598175 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:10:22.598649 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:22.598622 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6bvcz"] Jul 07 14:10:22.598754 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:22.598705 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:22.598823 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:22.598798 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:10:23.463510 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:23.463435 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8lrz7_7b566614-1557-40f7-bf9b-6b8bda043477/dns-node-resolver/0.log" Jul 07 14:10:24.377295 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:24.377244 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:24.377710 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:24.377257 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:24.377710 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:24.377408 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bvcz" podUID="58bbe9a4-1a51-4bf4-994a-43e65007a822" Jul 07 14:10:24.377710 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:24.377260 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:24.377710 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:24.377451 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kk77l" podUID="dcbf3f4e-4994-44f6-a479-5eecb805c29e" Jul 07 14:10:24.377710 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:24.377507 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhkl6" podUID="1cd5ff19-488c-478e-80ff-213566b198ff" Jul 07 14:10:24.436007 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:24.435977 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hwd8x_e2215475-b6b9-4620-8be6-51d230f88ab1/node-ca/0.log" Jul 07 14:10:24.943356 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:24.943321 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs\") pod \"network-metrics-daemon-6bvcz\" (UID: \"58bbe9a4-1a51-4bf4-994a-43e65007a822\") " pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:24.943604 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:24.943386 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:24.943604 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:24.943452 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:24.943604 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:24.943504 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:24.943604 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:24.943533 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs podName:58bbe9a4-1a51-4bf4-994a-43e65007a822 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:56.943512202 +0000 UTC m=+66.162193923 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs") pod "network-metrics-daemon-6bvcz" (UID: "58bbe9a4-1a51-4bf4-994a-43e65007a822") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:10:24.943604 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:24.943579 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret podName:dcbf3f4e-4994-44f6-a479-5eecb805c29e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:56.943567307 +0000 UTC m=+66.162249032 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret") pod "global-pull-secret-syncer-kk77l" (UID: "dcbf3f4e-4994-44f6-a479-5eecb805c29e") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:10:25.043971 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:25.043933 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxl65\" (UniqueName: \"kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65\") pod \"network-check-target-mhkl6\" (UID: \"1cd5ff19-488c-478e-80ff-213566b198ff\") " pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:25.044145 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:25.044126 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:10:25.044233 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:25.044153 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:10:25.044233 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:25.044162 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fxl65 for pod openshift-network-diagnostics/network-check-target-mhkl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:25.044233 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:10:25.044217 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65 podName:1cd5ff19-488c-478e-80ff-213566b198ff nodeName:}" failed. No retries permitted until 2026-07-07 14:10:57.0442025 +0000 UTC m=+66.262884220 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxl65" (UniqueName: "kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65") pod "network-check-target-mhkl6" (UID: "1cd5ff19-488c-478e-80ff-213566b198ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:10:26.087338 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:26.087253 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-42.ec2.internal" event="NodeReady" Jul 07 14:10:26.087965 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:26.087402 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 14:10:26.377075 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:26.376994 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:26.377297 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:26.376994 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:26.377297 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:26.376994 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:26.380579 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:26.380522 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:10:26.380694 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:26.380605 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:10:26.380694 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:26.380532 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:10:26.381602 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:26.381582 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:10:26.381712 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:26.381619 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-66bkv\"" Jul 07 14:10:26.381712 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:26.381694 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8zlrf\"" Jul 07 14:10:27.555319 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:27.555284 2570 generic.go:356] "Generic (PLEG): container finished" podID="385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1" containerID="3858e85625dad10d72eaca7fad80d36cd109db4095aeedc5e99a24ef72b32124" exitCode=0 Jul 07 14:10:27.555784 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:27.555349 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rln75" event={"ID":"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1","Type":"ContainerDied","Data":"3858e85625dad10d72eaca7fad80d36cd109db4095aeedc5e99a24ef72b32124"} Jul 07 14:10:28.560506 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:28.560472 2570 generic.go:356] "Generic (PLEG): container finished" podID="385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1" containerID="cea749eec45d6285de8a33e9f3c7ec9b0685ab7cc158ec7aaa1350889124ab78" exitCode=0 Jul 07 14:10:28.561111 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:28.560529 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rln75" event={"ID":"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1","Type":"ContainerDied","Data":"cea749eec45d6285de8a33e9f3c7ec9b0685ab7cc158ec7aaa1350889124ab78"} Jul 07 14:10:29.565682 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:29.565652 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rln75" event={"ID":"385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1","Type":"ContainerStarted","Data":"fc401f3f038490e41a7156c5bcd43553f8b5d1abd8d84ff121af1f5d3d7833f1"} Jul 07 14:10:50.059492 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.059286 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rln75" podStartSLOduration=28.510228438 podStartE2EDuration="59.059270281s" totalImagesPullingTime="30.549041843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:29.602271465 +0000 UTC m=+38.820953206" watchObservedRunningTime="2026-07-07 14:10:50.059270281 +0000 UTC m=+59.277952020" Jul 07 14:10:50.060054 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.059843 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2cf8g"] Jul 07 14:10:50.084655 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.084619 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2cf8g" Jul 07 14:10:50.085307 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.085290 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wf6rz"] Jul 07 14:10:50.090617 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.087977 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 14:10:50.090617 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.088946 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mdv2p\"" Jul 07 14:10:50.097004 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.096983 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2cf8g"] Jul 07 14:10:50.097093 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.097069 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wf6rz" Jul 07 14:10:50.101907 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.101882 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 14:10:50.102010 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.101913 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 14:10:50.102010 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.101995 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2bzq9\"" Jul 07 14:10:50.104314 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.104295 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 14:10:50.113993 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.113967 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wf6rz"] Jul 07 14:10:50.142943 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.142905 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6hs5p"] Jul 07 14:10:50.161658 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.161631 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:50.162031 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.162009 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6hs5p"] Jul 07 14:10:50.164249 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.164230 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 14:10:50.164358 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.164291 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 14:10:50.164443 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.164428 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-njxhm\"" Jul 07 14:10:50.170558 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.170519 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jd5qx"] Jul 07 14:10:50.194207 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.194178 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-594cc4b499-jst28"] Jul 07 14:10:50.194380 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.194312 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.197885 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.197861 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 14:10:50.198032 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.198015 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 14:10:50.198342 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.198326 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xhpqs\"" Jul 07 14:10:50.198581 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.198567 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 14:10:50.198666 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.198634 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 14:10:50.212684 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.212655 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgzpm\" (UniqueName: \"kubernetes.io/projected/ecef2f02-f123-48b2-aaac-c6caea96a16c-kube-api-access-jgzpm\") pod \"ingress-canary-wf6rz\" (UID: \"ecef2f02-f123-48b2-aaac-c6caea96a16c\") " pod="openshift-ingress-canary/ingress-canary-wf6rz" Jul 07 14:10:50.212801 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.212711 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d86488e8-f762-4b0a-a60a-0fb101cbf94a-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2cf8g\" (UID: \"d86488e8-f762-4b0a-a60a-0fb101cbf94a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2cf8g" Jul 07 14:10:50.212801 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.212777 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecef2f02-f123-48b2-aaac-c6caea96a16c-cert\") pod \"ingress-canary-wf6rz\" (UID: \"ecef2f02-f123-48b2-aaac-c6caea96a16c\") " pod="openshift-ingress-canary/ingress-canary-wf6rz" Jul 07 14:10:50.218105 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.218089 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jd5qx"] Jul 07 14:10:50.218151 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.218124 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-594cc4b499-jst28"] Jul 07 14:10:50.218208 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.218195 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.220861 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.220668 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 14:10:50.221142 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.221126 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bstgj\"" Jul 07 14:10:50.221203 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.221178 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 14:10:50.221775 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.221750 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 14:10:50.228418 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.228402 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 14:10:50.314105 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314029 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08753bf9-ebff-40ef-84a3-104117a47f7f-metrics-tls\") pod \"dns-default-6hs5p\" (UID: \"08753bf9-ebff-40ef-84a3-104117a47f7f\") " pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:50.314105 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314063 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08753bf9-ebff-40ef-84a3-104117a47f7f-tmp-dir\") pod \"dns-default-6hs5p\" (UID: \"08753bf9-ebff-40ef-84a3-104117a47f7f\") " pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:50.314105 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314084 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbds5\" (UniqueName: \"kubernetes.io/projected/08753bf9-ebff-40ef-84a3-104117a47f7f-kube-api-access-jbds5\") pod \"dns-default-6hs5p\" (UID: \"08753bf9-ebff-40ef-84a3-104117a47f7f\") " pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:50.314320 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314110 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-ca-trust-extracted\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.314320 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314133 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-installation-pull-secrets\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.314320 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314194 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/496706ae-5f0b-43e0-b97f-2c7e7bf78543-crio-socket\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.314320 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314211 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/496706ae-5f0b-43e0-b97f-2c7e7bf78543-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.314320 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314226 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-bound-sa-token\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.314320 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314267 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgzpm\" (UniqueName: \"kubernetes.io/projected/ecef2f02-f123-48b2-aaac-c6caea96a16c-kube-api-access-jgzpm\") pod \"ingress-canary-wf6rz\" (UID: \"ecef2f02-f123-48b2-aaac-c6caea96a16c\") " pod="openshift-ingress-canary/ingress-canary-wf6rz" Jul 07 14:10:50.314507 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314318 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/496706ae-5f0b-43e0-b97f-2c7e7bf78543-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.314507 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314348 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-image-registry-private-configuration\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.314507 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314369 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-trusted-ca\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.314507 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314396 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d86488e8-f762-4b0a-a60a-0fb101cbf94a-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2cf8g\" (UID: \"d86488e8-f762-4b0a-a60a-0fb101cbf94a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2cf8g" Jul 07 14:10:50.314507 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314412 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08753bf9-ebff-40ef-84a3-104117a47f7f-config-volume\") pod \"dns-default-6hs5p\" (UID: \"08753bf9-ebff-40ef-84a3-104117a47f7f\") " pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:50.314507 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314498 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttvd9\" (UniqueName: \"kubernetes.io/projected/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-kube-api-access-ttvd9\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.314764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314518 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecef2f02-f123-48b2-aaac-c6caea96a16c-cert\") pod \"ingress-canary-wf6rz\" (UID: \"ecef2f02-f123-48b2-aaac-c6caea96a16c\") " pod="openshift-ingress-canary/ingress-canary-wf6rz" Jul 07 14:10:50.314764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314537 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/496706ae-5f0b-43e0-b97f-2c7e7bf78543-data-volume\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.314764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314585 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7rhq\" (UniqueName: \"kubernetes.io/projected/496706ae-5f0b-43e0-b97f-2c7e7bf78543-kube-api-access-r7rhq\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.314764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314604 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-registry-tls\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.314764 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.314631 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-registry-certificates\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.318299 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.318273 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d86488e8-f762-4b0a-a60a-0fb101cbf94a-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2cf8g\" (UID: \"d86488e8-f762-4b0a-a60a-0fb101cbf94a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2cf8g" Jul 07 14:10:50.318299 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.318299 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecef2f02-f123-48b2-aaac-c6caea96a16c-cert\") pod \"ingress-canary-wf6rz\" (UID: \"ecef2f02-f123-48b2-aaac-c6caea96a16c\") " pod="openshift-ingress-canary/ingress-canary-wf6rz" Jul 07 14:10:50.324360 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.324334 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgzpm\" (UniqueName: \"kubernetes.io/projected/ecef2f02-f123-48b2-aaac-c6caea96a16c-kube-api-access-jgzpm\") pod \"ingress-canary-wf6rz\" (UID: \"ecef2f02-f123-48b2-aaac-c6caea96a16c\") " pod="openshift-ingress-canary/ingress-canary-wf6rz" Jul 07 14:10:50.397858 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.397819 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2cf8g" Jul 07 14:10:50.404608 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.404589 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wf6rz" Jul 07 14:10:50.415884 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.415862 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08753bf9-ebff-40ef-84a3-104117a47f7f-config-volume\") pod \"dns-default-6hs5p\" (UID: \"08753bf9-ebff-40ef-84a3-104117a47f7f\") " pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:50.415979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.415888 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttvd9\" (UniqueName: \"kubernetes.io/projected/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-kube-api-access-ttvd9\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.415979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.415913 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/496706ae-5f0b-43e0-b97f-2c7e7bf78543-data-volume\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.415979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.415941 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7rhq\" (UniqueName: \"kubernetes.io/projected/496706ae-5f0b-43e0-b97f-2c7e7bf78543-kube-api-access-r7rhq\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.415979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.415964 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-registry-tls\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.416156 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416006 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-registry-certificates\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.416156 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416044 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08753bf9-ebff-40ef-84a3-104117a47f7f-metrics-tls\") pod \"dns-default-6hs5p\" (UID: \"08753bf9-ebff-40ef-84a3-104117a47f7f\") " pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:50.416261 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416154 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08753bf9-ebff-40ef-84a3-104117a47f7f-tmp-dir\") pod \"dns-default-6hs5p\" (UID: \"08753bf9-ebff-40ef-84a3-104117a47f7f\") " pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:50.416261 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416195 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbds5\" (UniqueName: \"kubernetes.io/projected/08753bf9-ebff-40ef-84a3-104117a47f7f-kube-api-access-jbds5\") pod \"dns-default-6hs5p\" (UID: \"08753bf9-ebff-40ef-84a3-104117a47f7f\") " pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:50.416261 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416222 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-ca-trust-extracted\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.416261 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416249 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-installation-pull-secrets\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.416444 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416273 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/496706ae-5f0b-43e0-b97f-2c7e7bf78543-data-volume\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.416767 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416333 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/496706ae-5f0b-43e0-b97f-2c7e7bf78543-crio-socket\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.416857 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416803 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/496706ae-5f0b-43e0-b97f-2c7e7bf78543-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.416857 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416848 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-bound-sa-token\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.416951 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416910 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/496706ae-5f0b-43e0-b97f-2c7e7bf78543-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.417003 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416951 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-image-registry-private-configuration\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.417003 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416984 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-ca-trust-extracted\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.417003 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416993 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-trusted-ca\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.417147 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416996 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08753bf9-ebff-40ef-84a3-104117a47f7f-config-volume\") pod \"dns-default-6hs5p\" (UID: \"08753bf9-ebff-40ef-84a3-104117a47f7f\") " pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:50.417293 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.416800 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08753bf9-ebff-40ef-84a3-104117a47f7f-tmp-dir\") pod \"dns-default-6hs5p\" (UID: \"08753bf9-ebff-40ef-84a3-104117a47f7f\") " pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:50.417422 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.417403 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/496706ae-5f0b-43e0-b97f-2c7e7bf78543-crio-socket\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.417519 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.417442 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-registry-certificates\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.417664 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.417601 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/496706ae-5f0b-43e0-b97f-2c7e7bf78543-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.419349 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.419277 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-trusted-ca\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.420118 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.419691 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-installation-pull-secrets\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.420118 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.419812 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08753bf9-ebff-40ef-84a3-104117a47f7f-metrics-tls\") pod \"dns-default-6hs5p\" (UID: \"08753bf9-ebff-40ef-84a3-104117a47f7f\") " pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:50.420118 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.419851 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-image-registry-private-configuration\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.423053 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.423029 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-registry-tls\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.424462 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.424439 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/496706ae-5f0b-43e0-b97f-2c7e7bf78543-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.465972 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.465941 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttvd9\" (UniqueName: \"kubernetes.io/projected/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-kube-api-access-ttvd9\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.484165 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.484135 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbds5\" (UniqueName: \"kubernetes.io/projected/08753bf9-ebff-40ef-84a3-104117a47f7f-kube-api-access-jbds5\") pod \"dns-default-6hs5p\" (UID: \"08753bf9-ebff-40ef-84a3-104117a47f7f\") " pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:50.484165 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.484158 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7rhq\" (UniqueName: \"kubernetes.io/projected/496706ae-5f0b-43e0-b97f-2c7e7bf78543-kube-api-access-r7rhq\") pod \"insights-runtime-extractor-jd5qx\" (UID: \"496706ae-5f0b-43e0-b97f-2c7e7bf78543\") " pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.484492 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.484476 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57ee1633-4c59-4fbd-a0b5-53da29e3d2e3-bound-sa-token\") pod \"image-registry-594cc4b499-jst28\" (UID: \"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3\") " pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.503660 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.503572 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jd5qx" Jul 07 14:10:50.526950 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.526914 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:50.592414 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.592386 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wf6rz"] Jul 07 14:10:50.597124 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:10:50.597086 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecef2f02_f123_48b2_aaac_c6caea96a16c.slice/crio-689d6db3177deac38463358e1a6e2984181cd53d0b8f50cd2c27dc0254ac882c WatchSource:0}: Error finding container 689d6db3177deac38463358e1a6e2984181cd53d0b8f50cd2c27dc0254ac882c: Status 404 returned error can't find the container with id 689d6db3177deac38463358e1a6e2984181cd53d0b8f50cd2c27dc0254ac882c Jul 07 14:10:50.615639 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.615520 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wf6rz" event={"ID":"ecef2f02-f123-48b2-aaac-c6caea96a16c","Type":"ContainerStarted","Data":"689d6db3177deac38463358e1a6e2984181cd53d0b8f50cd2c27dc0254ac882c"} Jul 07 14:10:50.631458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.631133 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2cf8g"] Jul 07 14:10:50.631760 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:10:50.631718 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd86488e8_f762_4b0a_a60a_0fb101cbf94a.slice/crio-3697d84f454650f5773cae5825e9ee1b87277366424389e43a3a80f335c64315 WatchSource:0}: Error finding container 3697d84f454650f5773cae5825e9ee1b87277366424389e43a3a80f335c64315: Status 404 returned error can't find the container with id 3697d84f454650f5773cae5825e9ee1b87277366424389e43a3a80f335c64315 Jul 07 14:10:50.673263 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.673233 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jd5qx"] Jul 07 14:10:50.676385 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:10:50.676360 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496706ae_5f0b_43e0_b97f_2c7e7bf78543.slice/crio-8b99d268a049c34b5c7d2311d0c521ddd2759bfd0c29d11a4e3604e6c91da72d WatchSource:0}: Error finding container 8b99d268a049c34b5c7d2311d0c521ddd2759bfd0c29d11a4e3604e6c91da72d: Status 404 returned error can't find the container with id 8b99d268a049c34b5c7d2311d0c521ddd2759bfd0c29d11a4e3604e6c91da72d Jul 07 14:10:50.692383 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.692360 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-594cc4b499-jst28"] Jul 07 14:10:50.695310 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:10:50.695287 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ee1633_4c59_4fbd_a0b5_53da29e3d2e3.slice/crio-78967b2e5e209bec527a09ba1eaf9778b0956e988e1ecba603af0c8b24f522f2 WatchSource:0}: Error finding container 78967b2e5e209bec527a09ba1eaf9778b0956e988e1ecba603af0c8b24f522f2: Status 404 returned error can't find the container with id 78967b2e5e209bec527a09ba1eaf9778b0956e988e1ecba603af0c8b24f522f2 Jul 07 14:10:50.771777 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.771750 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:50.908651 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:50.908620 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6hs5p"] Jul 07 14:10:50.912143 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:10:50.912111 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08753bf9_ebff_40ef_84a3_104117a47f7f.slice/crio-840d2c31cd73fe3e2fff8f6e052d7ba64f667a5a884960f7e24bb8833f3b0b75 WatchSource:0}: Error finding container 840d2c31cd73fe3e2fff8f6e052d7ba64f667a5a884960f7e24bb8833f3b0b75: Status 404 returned error can't find the container with id 840d2c31cd73fe3e2fff8f6e052d7ba64f667a5a884960f7e24bb8833f3b0b75 Jul 07 14:10:51.626674 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:51.626627 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2cf8g" event={"ID":"d86488e8-f762-4b0a-a60a-0fb101cbf94a","Type":"ContainerStarted","Data":"3697d84f454650f5773cae5825e9ee1b87277366424389e43a3a80f335c64315"} Jul 07 14:10:51.631421 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:51.630198 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594cc4b499-jst28" event={"ID":"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3","Type":"ContainerStarted","Data":"666c97d1e6af97a5fc0f62e0ed6329c97b712a60c03081c02e0f108fe3813ad4"} Jul 07 14:10:51.631421 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:51.630247 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594cc4b499-jst28" event={"ID":"57ee1633-4c59-4fbd-a0b5-53da29e3d2e3","Type":"ContainerStarted","Data":"78967b2e5e209bec527a09ba1eaf9778b0956e988e1ecba603af0c8b24f522f2"} Jul 07 14:10:51.631421 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:51.631022 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:10:51.633389 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:51.633316 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hs5p" event={"ID":"08753bf9-ebff-40ef-84a3-104117a47f7f","Type":"ContainerStarted","Data":"840d2c31cd73fe3e2fff8f6e052d7ba64f667a5a884960f7e24bb8833f3b0b75"} Jul 07 14:10:51.635933 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:51.635682 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jd5qx" event={"ID":"496706ae-5f0b-43e0-b97f-2c7e7bf78543","Type":"ContainerStarted","Data":"8b99d268a049c34b5c7d2311d0c521ddd2759bfd0c29d11a4e3604e6c91da72d"} Jul 07 14:10:51.682762 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:51.682698 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-594cc4b499-jst28" podStartSLOduration=1.682675536 podStartE2EDuration="1.682675536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:51.672011248 +0000 UTC m=+60.890692988" watchObservedRunningTime="2026-07-07 14:10:51.682675536 +0000 UTC m=+60.901357277" Jul 07 14:10:52.640257 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:52.640223 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2cf8g" event={"ID":"d86488e8-f762-4b0a-a60a-0fb101cbf94a","Type":"ContainerStarted","Data":"e8532b143429a9e534f0e9b13f6e8ec6bdc08900e47b71341b09683d11514ffa"} Jul 07 14:10:52.661698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:52.661622 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2cf8g" podStartSLOduration=0.769770424 podStartE2EDuration="2.661601287s" totalImagesPullingTime="1.891830863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:52.660289349 +0000 UTC m=+61.878971090" watchObservedRunningTime="2026-07-07 14:10:52.661601287 +0000 UTC m=+61.880283028" Jul 07 14:10:53.552484 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:53.552458 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ddpch" Jul 07 14:10:53.643728 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:53.643697 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2cf8g" Jul 07 14:10:53.649116 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:53.649050 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2cf8g" Jul 07 14:10:53.936825 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:53.936735 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7"] Jul 07 14:10:53.950684 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:53.950654 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" Jul 07 14:10:53.966806 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:53.966042 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 14:10:53.966806 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:53.966298 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 07 14:10:53.966806 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:53.966522 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 14:10:53.967676 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:53.967607 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 07 14:10:53.967676 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:53.967618 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 14:10:53.975295 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:53.975274 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-f2gds\"" Jul 07 14:10:54.003235 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:54.003204 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7"] Jul 07 14:10:54.052971 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:54.052934 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68b3270e-fc59-4d1e-9c22-dbc4d5960f82-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-qzrj7\" (UID: \"68b3270e-fc59-4d1e-9c22-dbc4d5960f82\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" Jul 07 14:10:54.052971 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:54.052967 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68b3270e-fc59-4d1e-9c22-dbc4d5960f82-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-qzrj7\" (UID: \"68b3270e-fc59-4d1e-9c22-dbc4d5960f82\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" Jul 07 14:10:54.053210 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:54.052993 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g96qn\" (UniqueName: \"kubernetes.io/projected/68b3270e-fc59-4d1e-9c22-dbc4d5960f82-kube-api-access-g96qn\") pod \"prometheus-operator-567f7b8b7c-qzrj7\" (UID: \"68b3270e-fc59-4d1e-9c22-dbc4d5960f82\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" Jul 07 14:10:54.053210 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:54.053018 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/68b3270e-fc59-4d1e-9c22-dbc4d5960f82-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-qzrj7\" (UID: \"68b3270e-fc59-4d1e-9c22-dbc4d5960f82\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" Jul 07 14:10:54.153991 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:54.153959 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68b3270e-fc59-4d1e-9c22-dbc4d5960f82-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-qzrj7\" (UID: \"68b3270e-fc59-4d1e-9c22-dbc4d5960f82\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" Jul 07 14:10:54.154170 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:54.154120 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68b3270e-fc59-4d1e-9c22-dbc4d5960f82-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-qzrj7\" (UID: \"68b3270e-fc59-4d1e-9c22-dbc4d5960f82\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" Jul 07 14:10:54.154234 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:54.154169 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g96qn\" (UniqueName: \"kubernetes.io/projected/68b3270e-fc59-4d1e-9c22-dbc4d5960f82-kube-api-access-g96qn\") pod \"prometheus-operator-567f7b8b7c-qzrj7\" (UID: \"68b3270e-fc59-4d1e-9c22-dbc4d5960f82\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" Jul 07 14:10:54.154234 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:54.154219 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/68b3270e-fc59-4d1e-9c22-dbc4d5960f82-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-qzrj7\" (UID: \"68b3270e-fc59-4d1e-9c22-dbc4d5960f82\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" Jul 07 14:10:54.155096 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:54.154894 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68b3270e-fc59-4d1e-9c22-dbc4d5960f82-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-qzrj7\" (UID: \"68b3270e-fc59-4d1e-9c22-dbc4d5960f82\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" Jul 07 14:10:54.156708 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:54.156682 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68b3270e-fc59-4d1e-9c22-dbc4d5960f82-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-qzrj7\" (UID: \"68b3270e-fc59-4d1e-9c22-dbc4d5960f82\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" Jul 07 14:10:54.156925 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:54.156902 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/68b3270e-fc59-4d1e-9c22-dbc4d5960f82-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-qzrj7\" (UID: \"68b3270e-fc59-4d1e-9c22-dbc4d5960f82\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" Jul 07 14:10:54.180228 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:54.180182 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g96qn\" (UniqueName: \"kubernetes.io/projected/68b3270e-fc59-4d1e-9c22-dbc4d5960f82-kube-api-access-g96qn\") pod \"prometheus-operator-567f7b8b7c-qzrj7\" (UID: \"68b3270e-fc59-4d1e-9c22-dbc4d5960f82\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" Jul 07 14:10:54.261097 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:54.261061 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" Jul 07 14:10:56.068110 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.068072 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7"] Jul 07 14:10:56.074537 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:10:56.074500 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68b3270e_fc59_4d1e_9c22_dbc4d5960f82.slice/crio-9c8d636b2c9c8bf024f947ae8709a037109bb21547a40db9961da55de8ef16a9 WatchSource:0}: Error finding container 9c8d636b2c9c8bf024f947ae8709a037109bb21547a40db9961da55de8ef16a9: Status 404 returned error can't find the container with id 9c8d636b2c9c8bf024f947ae8709a037109bb21547a40db9961da55de8ef16a9 Jul 07 14:10:56.655051 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.654986 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hs5p" event={"ID":"08753bf9-ebff-40ef-84a3-104117a47f7f","Type":"ContainerStarted","Data":"7eecdcd631a6528bacb26db9e4991e5951c6024741ccbf25222b9b6921bc1e8d"} Jul 07 14:10:56.655051 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.655049 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hs5p" event={"ID":"08753bf9-ebff-40ef-84a3-104117a47f7f","Type":"ContainerStarted","Data":"67d78b90b57c9b910bdc77c07d85cfd1f1594e48c925aa3427e4e8052f36945a"} Jul 07 14:10:56.655301 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.655117 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6hs5p" Jul 07 14:10:56.658840 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.658811 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jd5qx" event={"ID":"496706ae-5f0b-43e0-b97f-2c7e7bf78543","Type":"ContainerStarted","Data":"dd170169097382f7524e288d85e6139caa9a0882ffd2fd3b176f9edee5f766a2"} Jul 07 14:10:56.660124 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.660095 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" event={"ID":"68b3270e-fc59-4d1e-9c22-dbc4d5960f82","Type":"ContainerStarted","Data":"9c8d636b2c9c8bf024f947ae8709a037109bb21547a40db9961da55de8ef16a9"} Jul 07 14:10:56.662192 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.662046 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wf6rz" event={"ID":"ecef2f02-f123-48b2-aaac-c6caea96a16c","Type":"ContainerStarted","Data":"6455befd38329f00a4c1dbadb29fa671f0fdfd4bce92287a9c2d6991525d2eae"} Jul 07 14:10:56.732756 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.732703 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6hs5p" podStartSLOduration=1.7243149610000001 podStartE2EDuration="6.732682116s" totalImagesPullingTime="5.008367155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:56.689497878 +0000 UTC m=+65.908179617" watchObservedRunningTime="2026-07-07 14:10:56.732682116 +0000 UTC m=+65.951363851" Jul 07 14:10:56.733104 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.733074 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wf6rz" podStartSLOduration=1.408764116 podStartE2EDuration="6.733063067s" totalImagesPullingTime="5.324298951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:56.73282888 +0000 UTC m=+65.951510610" watchObservedRunningTime="2026-07-07 14:10:56.733063067 +0000 UTC m=+65.951744807" Jul 07 14:10:56.976422 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.976394 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs\") pod \"network-metrics-daemon-6bvcz\" (UID: \"58bbe9a4-1a51-4bf4-994a-43e65007a822\") " pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:56.976650 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.976442 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:56.979113 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.979095 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:10:56.979177 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.979130 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:10:56.989414 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.989384 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcbf3f4e-4994-44f6-a479-5eecb805c29e-original-pull-secret\") pod \"global-pull-secret-syncer-kk77l\" (UID: \"dcbf3f4e-4994-44f6-a479-5eecb805c29e\") " pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:56.989526 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:56.989393 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58bbe9a4-1a51-4bf4-994a-43e65007a822-metrics-certs\") pod \"network-metrics-daemon-6bvcz\" (UID: \"58bbe9a4-1a51-4bf4-994a-43e65007a822\") " pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:57.003929 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.003906 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-66bkv\"" Jul 07 14:10:57.012107 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.012086 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bvcz" Jul 07 14:10:57.077945 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.077890 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxl65\" (UniqueName: \"kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65\") pod \"network-check-target-mhkl6\" (UID: \"1cd5ff19-488c-478e-80ff-213566b198ff\") " pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:57.081056 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.080848 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:10:57.092660 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.092630 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:10:57.101672 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.101650 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxl65\" (UniqueName: \"kubernetes.io/projected/1cd5ff19-488c-478e-80ff-213566b198ff-kube-api-access-fxl65\") pod \"network-check-target-mhkl6\" (UID: \"1cd5ff19-488c-478e-80ff-213566b198ff\") " pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:57.269788 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.269755 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6bvcz"] Jul 07 14:10:57.272596 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:10:57.272563 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58bbe9a4_1a51_4bf4_994a_43e65007a822.slice/crio-915c268577c61deb73171d6123b3c262ea24967bbd145a3eabd1ff00a1013b31 WatchSource:0}: Error finding container 915c268577c61deb73171d6123b3c262ea24967bbd145a3eabd1ff00a1013b31: Status 404 returned error can't find the container with id 915c268577c61deb73171d6123b3c262ea24967bbd145a3eabd1ff00a1013b31 Jul 07 14:10:57.289415 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.289392 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kk77l" Jul 07 14:10:57.299193 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.299168 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8zlrf\"" Jul 07 14:10:57.306765 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.306746 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:10:57.440877 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.440848 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kk77l"] Jul 07 14:10:57.444557 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:10:57.444511 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcbf3f4e_4994_44f6_a479_5eecb805c29e.slice/crio-66abc4ae604055a6e24a2174017d69234c514931f0d461c792612fd1ee839a69 WatchSource:0}: Error finding container 66abc4ae604055a6e24a2174017d69234c514931f0d461c792612fd1ee839a69: Status 404 returned error can't find the container with id 66abc4ae604055a6e24a2174017d69234c514931f0d461c792612fd1ee839a69 Jul 07 14:10:57.465456 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.465429 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mhkl6"] Jul 07 14:10:57.469070 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:10:57.469042 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd5ff19_488c_478e_80ff_213566b198ff.slice/crio-ecf71b438155c36bbbd1ab357b259425866e13a7bfbef5777591fc12809f0c37 WatchSource:0}: Error finding container ecf71b438155c36bbbd1ab357b259425866e13a7bfbef5777591fc12809f0c37: Status 404 returned error can't find the container with id ecf71b438155c36bbbd1ab357b259425866e13a7bfbef5777591fc12809f0c37 Jul 07 14:10:57.669783 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.669684 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jd5qx" event={"ID":"496706ae-5f0b-43e0-b97f-2c7e7bf78543","Type":"ContainerStarted","Data":"2620ff2a86e53dd08a9cb0cdadb31309a3c45bb8b0936bec6ce520235ae03773"} Jul 07 14:10:57.671044 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.670990 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mhkl6" event={"ID":"1cd5ff19-488c-478e-80ff-213566b198ff","Type":"ContainerStarted","Data":"ecf71b438155c36bbbd1ab357b259425866e13a7bfbef5777591fc12809f0c37"} Jul 07 14:10:57.672501 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.672478 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6bvcz" event={"ID":"58bbe9a4-1a51-4bf4-994a-43e65007a822","Type":"ContainerStarted","Data":"915c268577c61deb73171d6123b3c262ea24967bbd145a3eabd1ff00a1013b31"} Jul 07 14:10:57.674019 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:57.673998 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kk77l" event={"ID":"dcbf3f4e-4994-44f6-a479-5eecb805c29e","Type":"ContainerStarted","Data":"66abc4ae604055a6e24a2174017d69234c514931f0d461c792612fd1ee839a69"} Jul 07 14:10:58.682593 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:58.682536 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" event={"ID":"68b3270e-fc59-4d1e-9c22-dbc4d5960f82","Type":"ContainerStarted","Data":"212dd62ce01fd9306d06f68dc0dd741bab9ae93f5c62c7aa33fda3adfb469cac"} Jul 07 14:10:58.683069 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:58.682629 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" event={"ID":"68b3270e-fc59-4d1e-9c22-dbc4d5960f82","Type":"ContainerStarted","Data":"31b05a551a91c67ef9f2129c5b0b85fd93cca67c9b13bd49c7b4387fae8bf967"} Jul 07 14:10:58.710342 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:58.710102 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qzrj7" podStartSLOduration=3.752242176 podStartE2EDuration="5.710077879s" totalImagesPullingTime="1.957835703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:58.708851325 +0000 UTC m=+67.927533065" watchObservedRunningTime="2026-07-07 14:10:58.710077879 +0000 UTC m=+67.928759611" Jul 07 14:10:59.690416 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:59.690337 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6bvcz" event={"ID":"58bbe9a4-1a51-4bf4-994a-43e65007a822","Type":"ContainerStarted","Data":"24feee22deda5ed80aa62ded7f4e947dc58e5b21b52f0513eb9d1109afa52509"} Jul 07 14:10:59.690416 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:59.690388 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6bvcz" event={"ID":"58bbe9a4-1a51-4bf4-994a-43e65007a822","Type":"ContainerStarted","Data":"695c4bdfb080a0fa7a4dbf7952a0baf97fef8cb2291290085e3609073831bfa8"} Jul 07 14:10:59.713708 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:10:59.712399 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6bvcz" podStartSLOduration=66.856883396 podStartE2EDuration="1m8.712378901s" totalImagesPullingTime="1.855495505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:59.711618052 +0000 UTC m=+68.930299792" watchObservedRunningTime="2026-07-07 14:10:59.712378901 +0000 UTC m=+68.931060640" Jul 07 14:11:00.620025 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.619977 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb"] Jul 07 14:11:00.628693 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.628664 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:00.635178 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.635132 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 07 14:11:00.635353 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.635132 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 07 14:11:00.635353 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.635234 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vvdqf\"" Jul 07 14:11:00.643094 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.643068 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wlkfd"] Jul 07 14:11:00.646739 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.646717 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.651753 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.651590 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 14:11:00.651753 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.651609 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 14:11:00.655885 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.655664 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb"] Jul 07 14:11:00.662625 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.662605 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cf95v\"" Jul 07 14:11:00.662736 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.662605 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 14:11:00.682962 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.682930 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl"] Jul 07 14:11:00.685419 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.685400 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.689790 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.689766 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 07 14:11:00.690322 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.690043 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 07 14:11:00.690322 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.690085 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jgm5h\"" Jul 07 14:11:00.690322 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.690155 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 07 14:11:00.709735 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.709710 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.709850 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.709745 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3222ded-830b-4a91-ab23-bd3d71c998fb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-dgxnb\" (UID: \"c3222ded-830b-4a91-ab23-bd3d71c998fb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:00.709850 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.709777 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.709850 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.709803 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3222ded-830b-4a91-ab23-bd3d71c998fb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dgxnb\" (UID: \"c3222ded-830b-4a91-ab23-bd3d71c998fb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:00.709976 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.709879 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.709976 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.709912 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50cb0949-74af-4386-95e3-681c2c379b15-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.709976 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.709933 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-root\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.709976 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.709955 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/50cb0949-74af-4386-95e3-681c2c379b15-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.710168 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.709983 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-sys\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.710168 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.710003 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-metrics-client-ca\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.710168 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.710021 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.710168 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.710106 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-textfile\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.710168 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.710145 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-accelerators-collector-config\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.710391 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.710195 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg8cn\" (UniqueName: \"kubernetes.io/projected/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-kube-api-access-lg8cn\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.710391 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.710219 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-wtmp\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.710391 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.710246 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r52wc\" (UniqueName: \"kubernetes.io/projected/c3222ded-830b-4a91-ab23-bd3d71c998fb-kube-api-access-r52wc\") pod \"openshift-state-metrics-54cf96dfcf-dgxnb\" (UID: \"c3222ded-830b-4a91-ab23-bd3d71c998fb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:00.710391 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.710298 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn89x\" (UniqueName: \"kubernetes.io/projected/50cb0949-74af-4386-95e3-681c2c379b15-kube-api-access-sn89x\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.710391 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.710336 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3222ded-830b-4a91-ab23-bd3d71c998fb-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-dgxnb\" (UID: \"c3222ded-830b-4a91-ab23-bd3d71c998fb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:00.710391 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.710373 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-tls\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.714021 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.713997 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl"] Jul 07 14:11:00.810750 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.810712 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg8cn\" (UniqueName: \"kubernetes.io/projected/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-kube-api-access-lg8cn\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.810938 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.810760 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-wtmp\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.810938 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.810847 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r52wc\" (UniqueName: \"kubernetes.io/projected/c3222ded-830b-4a91-ab23-bd3d71c998fb-kube-api-access-r52wc\") pod \"openshift-state-metrics-54cf96dfcf-dgxnb\" (UID: \"c3222ded-830b-4a91-ab23-bd3d71c998fb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:00.810938 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.810889 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn89x\" (UniqueName: \"kubernetes.io/projected/50cb0949-74af-4386-95e3-681c2c379b15-kube-api-access-sn89x\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.810938 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.810898 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-wtmp\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.810938 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.810918 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3222ded-830b-4a91-ab23-bd3d71c998fb-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-dgxnb\" (UID: \"c3222ded-830b-4a91-ab23-bd3d71c998fb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:00.811196 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.810951 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-tls\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.811196 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811009 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.811196 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811038 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3222ded-830b-4a91-ab23-bd3d71c998fb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-dgxnb\" (UID: \"c3222ded-830b-4a91-ab23-bd3d71c998fb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:00.811196 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811075 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.811196 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811101 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3222ded-830b-4a91-ab23-bd3d71c998fb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dgxnb\" (UID: \"c3222ded-830b-4a91-ab23-bd3d71c998fb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:00.811196 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:11:00.811106 2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 14:11:00.811196 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811146 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.811196 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:11:00.811165 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-tls podName:585e14f6-c40c-4fa1-9b56-bb3a17e6bd11 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:01.311143208 +0000 UTC m=+70.529824939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-tls") pod "node-exporter-wlkfd" (UID: "585e14f6-c40c-4fa1-9b56-bb3a17e6bd11") : secret "node-exporter-tls" not found Jul 07 14:11:00.811605 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:11:00.811342 2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 07 14:11:00.811605 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:11:00.811424 2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 07 14:11:00.811605 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:11:00.811443 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3222ded-830b-4a91-ab23-bd3d71c998fb-openshift-state-metrics-tls podName:c3222ded-830b-4a91-ab23-bd3d71c998fb nodeName:}" failed. No retries permitted until 2026-07-07 14:11:01.311425926 +0000 UTC m=+70.530107655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c3222ded-830b-4a91-ab23-bd3d71c998fb-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-dgxnb" (UID: "c3222ded-830b-4a91-ab23-bd3d71c998fb") : secret "openshift-state-metrics-tls" not found Jul 07 14:11:00.811605 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:11:00.811468 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-tls podName:50cb0949-74af-4386-95e3-681c2c379b15 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:01.311453566 +0000 UTC m=+70.530135300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-rq7nl" (UID: "50cb0949-74af-4386-95e3-681c2c379b15") : secret "kube-state-metrics-tls" not found Jul 07 14:11:00.811605 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811517 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50cb0949-74af-4386-95e3-681c2c379b15-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.811605 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811577 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3222ded-830b-4a91-ab23-bd3d71c998fb-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-dgxnb\" (UID: \"c3222ded-830b-4a91-ab23-bd3d71c998fb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:00.811605 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811585 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-root\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.811995 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811630 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-root\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.811995 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811633 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/50cb0949-74af-4386-95e3-681c2c379b15-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.811995 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811668 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-sys\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.811995 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811700 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-metrics-client-ca\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.811995 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811724 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.811995 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811758 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-textfile\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.811995 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811786 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-accelerators-collector-config\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.811995 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811866 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.811995 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811887 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/50cb0949-74af-4386-95e3-681c2c379b15-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.811995 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.811929 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-sys\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.812603 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.812218 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-textfile\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.812603 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.812347 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50cb0949-74af-4386-95e3-681c2c379b15-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.812603 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.812370 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-accelerators-collector-config\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.812603 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.812430 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-metrics-client-ca\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.814382 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.814355 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.814491 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.814454 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.814635 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.814620 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3222ded-830b-4a91-ab23-bd3d71c998fb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-dgxnb\" (UID: \"c3222ded-830b-4a91-ab23-bd3d71c998fb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:00.826932 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.826903 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn89x\" (UniqueName: \"kubernetes.io/projected/50cb0949-74af-4386-95e3-681c2c379b15-kube-api-access-sn89x\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:00.828416 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.828391 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg8cn\" (UniqueName: \"kubernetes.io/projected/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-kube-api-access-lg8cn\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:00.828845 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:00.828825 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r52wc\" (UniqueName: \"kubernetes.io/projected/c3222ded-830b-4a91-ab23-bd3d71c998fb-kube-api-access-r52wc\") pod \"openshift-state-metrics-54cf96dfcf-dgxnb\" (UID: \"c3222ded-830b-4a91-ab23-bd3d71c998fb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:01.316604 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.316564 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-tls\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:01.316789 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.316634 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:01.316789 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.316662 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3222ded-830b-4a91-ab23-bd3d71c998fb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dgxnb\" (UID: \"c3222ded-830b-4a91-ab23-bd3d71c998fb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:01.316886 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:11:01.316821 2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 07 14:11:01.316923 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:11:01.316907 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-tls podName:50cb0949-74af-4386-95e3-681c2c379b15 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:02.316885723 +0000 UTC m=+71.535567446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-rq7nl" (UID: "50cb0949-74af-4386-95e3-681c2c379b15") : secret "kube-state-metrics-tls" not found Jul 07 14:11:01.319229 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.319205 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/585e14f6-c40c-4fa1-9b56-bb3a17e6bd11-node-exporter-tls\") pod \"node-exporter-wlkfd\" (UID: \"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11\") " pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:01.319379 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.319303 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3222ded-830b-4a91-ab23-bd3d71c998fb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dgxnb\" (UID: \"c3222ded-830b-4a91-ab23-bd3d71c998fb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:01.540221 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.540178 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" Jul 07 14:11:01.558935 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.558902 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wlkfd" Jul 07 14:11:01.668425 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.668318 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:11:01.671363 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.671341 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.677472 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.677372 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 14:11:01.678409 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.678380 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 14:11:01.678537 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.678499 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sr4x2\"" Jul 07 14:11:01.679035 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.679014 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 14:11:01.679185 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.679044 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 14:11:01.679565 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.679416 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 14:11:01.679565 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.679528 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 14:11:01.680526 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.680505 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 14:11:01.680646 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.680593 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 14:11:01.689190 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.689170 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 14:11:01.696385 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.696355 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:11:01.720756 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.720728 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.720904 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.720764 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-web-config\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.720904 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.720796 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.720904 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.720831 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/403ba728-1b32-42dd-a5fb-ced8934c9154-tls-assets\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.720904 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.720864 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-config-volume\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.720904 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.720888 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.721087 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.720911 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/403ba728-1b32-42dd-a5fb-ced8934c9154-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.721087 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.720963 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/403ba728-1b32-42dd-a5fb-ced8934c9154-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.721087 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.721007 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.721087 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.721065 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.721237 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.721094 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403ba728-1b32-42dd-a5fb-ced8934c9154-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.721237 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.721133 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n49hf\" (UniqueName: \"kubernetes.io/projected/403ba728-1b32-42dd-a5fb-ced8934c9154-kube-api-access-n49hf\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.721237 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.721198 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/403ba728-1b32-42dd-a5fb-ced8934c9154-config-out\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.822627 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.822589 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.822785 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.822650 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/403ba728-1b32-42dd-a5fb-ced8934c9154-tls-assets\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.822785 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.822687 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-config-volume\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.822785 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.822716 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.822785 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.822745 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/403ba728-1b32-42dd-a5fb-ced8934c9154-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.822785 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.822780 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/403ba728-1b32-42dd-a5fb-ced8934c9154-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.823040 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.822809 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.823040 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.822867 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.823040 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.822893 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403ba728-1b32-42dd-a5fb-ced8934c9154-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.823040 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.822924 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n49hf\" (UniqueName: \"kubernetes.io/projected/403ba728-1b32-42dd-a5fb-ced8934c9154-kube-api-access-n49hf\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.823040 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.822958 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/403ba728-1b32-42dd-a5fb-ced8934c9154-config-out\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.823040 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.822992 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.823040 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.823026 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-web-config\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.824197 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.823831 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/403ba728-1b32-42dd-a5fb-ced8934c9154-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.824452 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.824422 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403ba728-1b32-42dd-a5fb-ced8934c9154-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.825095 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.825068 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/403ba728-1b32-42dd-a5fb-ced8934c9154-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.826214 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.826171 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/403ba728-1b32-42dd-a5fb-ced8934c9154-tls-assets\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.826784 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.826742 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.827189 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.827165 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/403ba728-1b32-42dd-a5fb-ced8934c9154-config-out\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.827507 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.827452 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.827650 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.827628 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-config-volume\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.827729 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.827676 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.827729 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.827701 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-web-config\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.828390 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.828107 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.828874 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.828853 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.840230 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.840201 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n49hf\" (UniqueName: \"kubernetes.io/projected/403ba728-1b32-42dd-a5fb-ced8934c9154-kube-api-access-n49hf\") pod \"alertmanager-main-0\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:01.983724 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:01.983689 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:11:02.327903 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:02.327825 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:02.330409 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:02.330381 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/50cb0949-74af-4386-95e3-681c2c379b15-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-rq7nl\" (UID: \"50cb0949-74af-4386-95e3-681c2c379b15\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:02.496078 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:02.496039 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" Jul 07 14:11:03.315188 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:11:03.315156 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585e14f6_c40c_4fa1_9b56_bb3a17e6bd11.slice/crio-ded6ab2018c2568523bd40fb677ca327ad61615d9cb34e38e0030bc80d28fbce WatchSource:0}: Error finding container ded6ab2018c2568523bd40fb677ca327ad61615d9cb34e38e0030bc80d28fbce: Status 404 returned error can't find the container with id ded6ab2018c2568523bd40fb677ca327ad61615d9cb34e38e0030bc80d28fbce Jul 07 14:11:03.541653 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.541558 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:11:03.545864 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:11:03.545824 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod403ba728_1b32_42dd_a5fb_ced8934c9154.slice/crio-1c4f00801d5fbe67fb0523308d23ecbaf6df7267c221416c4adf25f56e6affdb WatchSource:0}: Error finding container 1c4f00801d5fbe67fb0523308d23ecbaf6df7267c221416c4adf25f56e6affdb: Status 404 returned error can't find the container with id 1c4f00801d5fbe67fb0523308d23ecbaf6df7267c221416c4adf25f56e6affdb Jul 07 14:11:03.711888 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.711851 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jd5qx" event={"ID":"496706ae-5f0b-43e0-b97f-2c7e7bf78543","Type":"ContainerStarted","Data":"2ea4ffffa4d7c566d7fe134e3278724c37b64373a79644faf765e8cac83d1b26"} Jul 07 14:11:03.713067 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.713038 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerStarted","Data":"1c4f00801d5fbe67fb0523308d23ecbaf6df7267c221416c4adf25f56e6affdb"} Jul 07 14:11:03.714413 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.714389 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mhkl6" event={"ID":"1cd5ff19-488c-478e-80ff-213566b198ff","Type":"ContainerStarted","Data":"33e029c3d635f04a40a7f95677b8432965df9a95b20b98f71f2db2bf84724e5c"} Jul 07 14:11:03.714509 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.714439 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:11:03.715563 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.715525 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wlkfd" event={"ID":"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11","Type":"ContainerStarted","Data":"ded6ab2018c2568523bd40fb677ca327ad61615d9cb34e38e0030bc80d28fbce"} Jul 07 14:11:03.716858 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.716837 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kk77l" event={"ID":"dcbf3f4e-4994-44f6-a479-5eecb805c29e","Type":"ContainerStarted","Data":"3bedeb725c404d71068f677e9c4c2f75886d8700c6f9c25b26d8f1f01bd3229e"} Jul 07 14:11:03.718759 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.718741 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl"] Jul 07 14:11:03.726367 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:11:03.726346 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50cb0949_74af_4386_95e3_681c2c379b15.slice/crio-8cede4507a89a1da759fe71e84397a967914afba9b35e1955ff72d59100ab5da WatchSource:0}: Error finding container 8cede4507a89a1da759fe71e84397a967914afba9b35e1955ff72d59100ab5da: Status 404 returned error can't find the container with id 8cede4507a89a1da759fe71e84397a967914afba9b35e1955ff72d59100ab5da Jul 07 14:11:03.749337 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.748697 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66dcd899c7-rdxsk"] Jul 07 14:11:03.752478 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.752458 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb"] Jul 07 14:11:03.752593 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.752577 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.753261 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:11:03.753244 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3222ded_830b_4a91_ab23_bd3d71c998fb.slice/crio-d917f676a87c70b733e5bf218d5a5ff0d62525f10186bea28d4f52ce6d41f4e7 WatchSource:0}: Error finding container d917f676a87c70b733e5bf218d5a5ff0d62525f10186bea28d4f52ce6d41f4e7: Status 404 returned error can't find the container with id d917f676a87c70b733e5bf218d5a5ff0d62525f10186bea28d4f52ce6d41f4e7 Jul 07 14:11:03.758516 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.758494 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kdntl\"" Jul 07 14:11:03.758643 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.758619 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 14:11:03.758709 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.758658 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eqnt19tgnh3ok\"" Jul 07 14:11:03.759147 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.759034 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 14:11:03.759438 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.759421 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 14:11:03.760042 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.760027 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 14:11:03.762103 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.762084 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 14:11:03.787141 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.787088 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jd5qx" podStartSLOduration=1.349861063 podStartE2EDuration="13.787067774s" totalImagesPullingTime="12.437206711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:10:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:03.786008325 +0000 UTC m=+73.004690065" watchObservedRunningTime="2026-07-07 14:11:03.787067774 +0000 UTC m=+73.005749512" Jul 07 14:11:03.789502 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.789479 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66dcd899c7-rdxsk"] Jul 07 14:11:03.839537 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.839504 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.839804 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.839560 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.839804 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.839691 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gr8d\" (UniqueName: \"kubernetes.io/projected/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-kube-api-access-9gr8d\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.839804 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.839762 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-metrics-client-ca\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.839804 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.839791 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.839979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.839819 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.839979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.839874 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-grpc-tls\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.839979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.839955 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-tls\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.845102 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.845049 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mhkl6" podStartSLOduration=67.00181891 podStartE2EDuration="1m12.845028934s" totalImagesPullingTime="5.843210024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:03.843420466 +0000 UTC m=+73.062102205" watchObservedRunningTime="2026-07-07 14:11:03.845028934 +0000 UTC m=+73.063710675" Jul 07 14:11:03.903866 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.903805 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kk77l" podStartSLOduration=67.033326417 podStartE2EDuration="1m12.903790055s" totalImagesPullingTime="5.870463638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:03.903641246 +0000 UTC m=+73.122322985" watchObservedRunningTime="2026-07-07 14:11:03.903790055 +0000 UTC m=+73.122471791" Jul 07 14:11:03.940412 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.940372 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.940618 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.940420 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.940618 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.940457 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gr8d\" (UniqueName: \"kubernetes.io/projected/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-kube-api-access-9gr8d\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.940618 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.940501 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-metrics-client-ca\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.940618 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.940530 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.940797 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.940621 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.940797 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.940670 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-grpc-tls\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.940797 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.940727 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-tls\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.941484 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.941424 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-metrics-client-ca\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.943613 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.943537 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.943613 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.943587 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.944127 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.944102 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.944240 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.944130 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-tls\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.944240 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.944104 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.944378 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.944359 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-secret-grpc-tls\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:03.974787 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:03.974757 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gr8d\" (UniqueName: \"kubernetes.io/projected/ed4623a1-c6e6-4b65-90ea-3ccc63612c1b-kube-api-access-9gr8d\") pod \"thanos-querier-66dcd899c7-rdxsk\" (UID: \"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b\") " pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:04.061490 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:04.061406 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:04.358424 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:04.358337 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66dcd899c7-rdxsk"] Jul 07 14:11:04.468341 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:11:04.468311 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4623a1_c6e6_4b65_90ea_3ccc63612c1b.slice/crio-a34c8e6808c72cb3ad4943c8bbb836a3a05b4a63389cdd7946b14d3c37c65c42 WatchSource:0}: Error finding container a34c8e6808c72cb3ad4943c8bbb836a3a05b4a63389cdd7946b14d3c37c65c42: Status 404 returned error can't find the container with id a34c8e6808c72cb3ad4943c8bbb836a3a05b4a63389cdd7946b14d3c37c65c42 Jul 07 14:11:04.723520 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:04.723486 2570 generic.go:356] "Generic (PLEG): container finished" podID="585e14f6-c40c-4fa1-9b56-bb3a17e6bd11" containerID="186f8a932596be0a1e14c3293de0568500506a25948ecd58fbe90d21e8657c0f" exitCode=0 Jul 07 14:11:04.723710 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:04.723577 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wlkfd" event={"ID":"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11","Type":"ContainerDied","Data":"186f8a932596be0a1e14c3293de0568500506a25948ecd58fbe90d21e8657c0f"} Jul 07 14:11:04.725132 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:04.725104 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" event={"ID":"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b","Type":"ContainerStarted","Data":"a34c8e6808c72cb3ad4943c8bbb836a3a05b4a63389cdd7946b14d3c37c65c42"} Jul 07 14:11:04.727376 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:04.727248 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" event={"ID":"c3222ded-830b-4a91-ab23-bd3d71c998fb","Type":"ContainerStarted","Data":"e2669b0dd1f1271523f58b686925477073d08427230d3c0986f84075c61cbf9e"} Jul 07 14:11:04.727376 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:04.727317 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" event={"ID":"c3222ded-830b-4a91-ab23-bd3d71c998fb","Type":"ContainerStarted","Data":"6cff7c6321ba2f5aa784eb9af971c3cf26fe8ffa767adbacd406d994371f1140"} Jul 07 14:11:04.727376 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:04.727346 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" event={"ID":"c3222ded-830b-4a91-ab23-bd3d71c998fb","Type":"ContainerStarted","Data":"d917f676a87c70b733e5bf218d5a5ff0d62525f10186bea28d4f52ce6d41f4e7"} Jul 07 14:11:04.728591 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:04.728567 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" event={"ID":"50cb0949-74af-4386-95e3-681c2c379b15","Type":"ContainerStarted","Data":"8cede4507a89a1da759fe71e84397a967914afba9b35e1955ff72d59100ab5da"} Jul 07 14:11:05.267737 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.267705 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-859664664b-cqsgx"] Jul 07 14:11:05.269849 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.269830 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n"] Jul 07 14:11:05.269963 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.269945 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.272051 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.272031 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n" Jul 07 14:11:05.276134 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.276114 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 14:11:05.276394 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.276378 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-knx4q\"" Jul 07 14:11:05.276486 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.276439 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 14:11:05.282500 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.282236 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-o8kts2h0u9j1\"" Jul 07 14:11:05.283959 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.282694 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 14:11:05.284200 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.284177 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hnwgn\"" Jul 07 14:11:05.284356 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.284339 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 14:11:05.287116 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.287090 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 14:11:05.293418 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.293393 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n"] Jul 07 14:11:05.303683 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.303662 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-859664664b-cqsgx"] Jul 07 14:11:05.353389 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.353347 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df002840-32e8-49b4-a487-83cbfac99ab2-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lbz9n\" (UID: \"df002840-32e8-49b4-a487-83cbfac99ab2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n" Jul 07 14:11:05.353389 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.353392 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bb5442dc-f0df-4427-b97b-f0a331303eca-secret-metrics-server-tls\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.353617 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.353422 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bb5442dc-f0df-4427-b97b-f0a331303eca-audit-log\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.353617 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.353446 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdv2x\" (UniqueName: \"kubernetes.io/projected/df002840-32e8-49b4-a487-83cbfac99ab2-kube-api-access-vdv2x\") pod \"monitoring-plugin-d5dcff7cf-lbz9n\" (UID: \"df002840-32e8-49b4-a487-83cbfac99ab2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n" Jul 07 14:11:05.353617 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.353525 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb5442dc-f0df-4427-b97b-f0a331303eca-client-ca-bundle\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.353617 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.353586 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bb5442dc-f0df-4427-b97b-f0a331303eca-metrics-server-audit-profiles\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.353809 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.353679 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bb5442dc-f0df-4427-b97b-f0a331303eca-secret-metrics-server-client-certs\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.353809 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.353715 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb5442dc-f0df-4427-b97b-f0a331303eca-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.353809 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.353746 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprns\" (UniqueName: \"kubernetes.io/projected/bb5442dc-f0df-4427-b97b-f0a331303eca-kube-api-access-hprns\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.455101 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.455066 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb5442dc-f0df-4427-b97b-f0a331303eca-client-ca-bundle\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.455595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.455117 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bb5442dc-f0df-4427-b97b-f0a331303eca-metrics-server-audit-profiles\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.455595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.455155 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bb5442dc-f0df-4427-b97b-f0a331303eca-secret-metrics-server-client-certs\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.455595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.455188 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb5442dc-f0df-4427-b97b-f0a331303eca-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.455595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.455211 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hprns\" (UniqueName: \"kubernetes.io/projected/bb5442dc-f0df-4427-b97b-f0a331303eca-kube-api-access-hprns\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.455595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.455288 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df002840-32e8-49b4-a487-83cbfac99ab2-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lbz9n\" (UID: \"df002840-32e8-49b4-a487-83cbfac99ab2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n" Jul 07 14:11:05.455595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.455315 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bb5442dc-f0df-4427-b97b-f0a331303eca-secret-metrics-server-tls\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.455595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.455341 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bb5442dc-f0df-4427-b97b-f0a331303eca-audit-log\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.455595 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.455365 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdv2x\" (UniqueName: \"kubernetes.io/projected/df002840-32e8-49b4-a487-83cbfac99ab2-kube-api-access-vdv2x\") pod \"monitoring-plugin-d5dcff7cf-lbz9n\" (UID: \"df002840-32e8-49b4-a487-83cbfac99ab2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n" Jul 07 14:11:05.456668 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.456394 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bb5442dc-f0df-4427-b97b-f0a331303eca-metrics-server-audit-profiles\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.456806 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.456766 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb5442dc-f0df-4427-b97b-f0a331303eca-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.457041 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.456965 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bb5442dc-f0df-4427-b97b-f0a331303eca-audit-log\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.459577 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.458762 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df002840-32e8-49b4-a487-83cbfac99ab2-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lbz9n\" (UID: \"df002840-32e8-49b4-a487-83cbfac99ab2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n" Jul 07 14:11:05.459577 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.459189 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bb5442dc-f0df-4427-b97b-f0a331303eca-secret-metrics-server-tls\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.459954 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.459933 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb5442dc-f0df-4427-b97b-f0a331303eca-client-ca-bundle\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.461423 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.461402 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bb5442dc-f0df-4427-b97b-f0a331303eca-secret-metrics-server-client-certs\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.477846 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.477815 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprns\" (UniqueName: \"kubernetes.io/projected/bb5442dc-f0df-4427-b97b-f0a331303eca-kube-api-access-hprns\") pod \"metrics-server-859664664b-cqsgx\" (UID: \"bb5442dc-f0df-4427-b97b-f0a331303eca\") " pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.477972 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.477866 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdv2x\" (UniqueName: \"kubernetes.io/projected/df002840-32e8-49b4-a487-83cbfac99ab2-kube-api-access-vdv2x\") pod \"monitoring-plugin-d5dcff7cf-lbz9n\" (UID: \"df002840-32e8-49b4-a487-83cbfac99ab2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n" Jul 07 14:11:05.580362 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.580275 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:05.590154 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.590130 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n" Jul 07 14:11:05.743916 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.743024 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wlkfd" event={"ID":"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11","Type":"ContainerStarted","Data":"177dd21aec010752c764c0c80a54a86c0b7f25d8c00f66f8f83356d6cbe1df94"} Jul 07 14:11:05.743916 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.743089 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wlkfd" event={"ID":"585e14f6-c40c-4fa1-9b56-bb3a17e6bd11","Type":"ContainerStarted","Data":"d7b99bed619a47855d560e3b37132d774aa2c1565ec3eb63ded78acbe2c0acfd"} Jul 07 14:11:05.747794 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.747127 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" event={"ID":"c3222ded-830b-4a91-ab23-bd3d71c998fb","Type":"ContainerStarted","Data":"229bfad9113ad472abd9662c1f05392db8e7c8617c741cda0d3185628ff23004"} Jul 07 14:11:05.765615 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.765583 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-859664664b-cqsgx"] Jul 07 14:11:05.774008 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.773946 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n"] Jul 07 14:11:05.778437 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.778390 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wlkfd" podStartSLOduration=4.535375194 podStartE2EDuration="5.778367972s" totalImagesPullingTime="1.17761719s" totalInitContainerRuntime="65.375588ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:05.777948096 +0000 UTC m=+74.996629835" watchObservedRunningTime="2026-07-07 14:11:05.778367972 +0000 UTC m=+74.997049712" Jul 07 14:11:05.809073 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:05.808988 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dgxnb" podStartSLOduration=4.397577758 podStartE2EDuration="5.808966415s" totalImagesPullingTime="1.411388657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:05.808601784 +0000 UTC m=+75.027283524" watchObservedRunningTime="2026-07-07 14:11:05.808966415 +0000 UTC m=+75.027648160" Jul 07 14:11:06.042931 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:11:06.042897 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5442dc_f0df_4427_b97b_f0a331303eca.slice/crio-6361368aed6a21fc80d98949ee7a6d5773a1f65c36923eaf59771a0493e162aa WatchSource:0}: Error finding container 6361368aed6a21fc80d98949ee7a6d5773a1f65c36923eaf59771a0493e162aa: Status 404 returned error can't find the container with id 6361368aed6a21fc80d98949ee7a6d5773a1f65c36923eaf59771a0493e162aa Jul 07 14:11:06.294834 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:11:06.294723 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf002840_32e8_49b4_a487_83cbfac99ab2.slice/crio-a058707e5855d93b8a740b3b3988a5cf80ae6a9d22740524b54ca5cba2ae1560 WatchSource:0}: Error finding container a058707e5855d93b8a740b3b3988a5cf80ae6a9d22740524b54ca5cba2ae1560: Status 404 returned error can't find the container with id a058707e5855d93b8a740b3b3988a5cf80ae6a9d22740524b54ca5cba2ae1560 Jul 07 14:11:06.677307 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:06.677272 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6hs5p" Jul 07 14:11:06.753784 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:06.753748 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-859664664b-cqsgx" event={"ID":"bb5442dc-f0df-4427-b97b-f0a331303eca","Type":"ContainerStarted","Data":"6361368aed6a21fc80d98949ee7a6d5773a1f65c36923eaf59771a0493e162aa"} Jul 07 14:11:06.755746 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:06.755710 2570 generic.go:356] "Generic (PLEG): container finished" podID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerID="fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d" exitCode=0 Jul 07 14:11:06.755905 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:06.755797 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerDied","Data":"fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d"} Jul 07 14:11:06.758702 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:06.758579 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" event={"ID":"50cb0949-74af-4386-95e3-681c2c379b15","Type":"ContainerStarted","Data":"abb72a5569413f9702fd86a5c997a1b99421ede4b94609c2bdcb2ebf369167da"} Jul 07 14:11:06.758702 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:06.758637 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" event={"ID":"50cb0949-74af-4386-95e3-681c2c379b15","Type":"ContainerStarted","Data":"c1715217c22a7ce0e9203b2a0d5653ae44da5bcf2e26e574059ed7235ade57a1"} Jul 07 14:11:06.758702 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:06.758662 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" event={"ID":"50cb0949-74af-4386-95e3-681c2c379b15","Type":"ContainerStarted","Data":"26785ee4c7033de936737da2847028e2ad5684becff4256028f666a24118f64e"} Jul 07 14:11:06.760004 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:06.759980 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n" event={"ID":"df002840-32e8-49b4-a487-83cbfac99ab2","Type":"ContainerStarted","Data":"a058707e5855d93b8a740b3b3988a5cf80ae6a9d22740524b54ca5cba2ae1560"} Jul 07 14:11:06.865289 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:06.865131 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rq7nl" podStartSLOduration=4.266955361 podStartE2EDuration="6.865113347s" totalImagesPullingTime="2.598157986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:06.865067105 +0000 UTC m=+76.083748842" watchObservedRunningTime="2026-07-07 14:11:06.865113347 +0000 UTC m=+76.083795085" Jul 07 14:11:07.274822 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.274781 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-hrrz8"] Jul 07 14:11:07.277825 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.277806 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-hrrz8" Jul 07 14:11:07.287360 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.287339 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8vj25\"" Jul 07 14:11:07.287533 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.287387 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 14:11:07.287680 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.287657 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 14:11:07.301296 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.301264 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-hrrz8"] Jul 07 14:11:07.376279 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.376243 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj8cw\" (UniqueName: \"kubernetes.io/projected/eab7fad4-03a5-4f76-bba9-b96fc67541b1-kube-api-access-xj8cw\") pod \"downloads-685bfb5f64-hrrz8\" (UID: \"eab7fad4-03a5-4f76-bba9-b96fc67541b1\") " pod="openshift-console/downloads-685bfb5f64-hrrz8" Jul 07 14:11:07.477515 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.477373 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj8cw\" (UniqueName: \"kubernetes.io/projected/eab7fad4-03a5-4f76-bba9-b96fc67541b1-kube-api-access-xj8cw\") pod \"downloads-685bfb5f64-hrrz8\" (UID: \"eab7fad4-03a5-4f76-bba9-b96fc67541b1\") " pod="openshift-console/downloads-685bfb5f64-hrrz8" Jul 07 14:11:07.501995 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.501926 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj8cw\" (UniqueName: \"kubernetes.io/projected/eab7fad4-03a5-4f76-bba9-b96fc67541b1-kube-api-access-xj8cw\") pod \"downloads-685bfb5f64-hrrz8\" (UID: \"eab7fad4-03a5-4f76-bba9-b96fc67541b1\") " pod="openshift-console/downloads-685bfb5f64-hrrz8" Jul 07 14:11:07.588285 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.587935 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-hrrz8" Jul 07 14:11:07.662749 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.660415 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:11:07.664271 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.664248 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.677418 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.676906 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 14:11:07.677901 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.677496 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 14:11:07.677901 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.677736 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 14:11:07.678022 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.677959 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 14:11:07.678403 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.678217 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 14:11:07.678403 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.678224 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 14:11:07.678403 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.678293 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 14:11:07.678403 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.678309 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-uhkojf6b0dtp\"" Jul 07 14:11:07.687491 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.687468 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 14:11:07.689961 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.689938 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 14:11:07.698093 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.698047 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 14:11:07.698093 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.698047 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-59q9d\"" Jul 07 14:11:07.698261 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.698115 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 14:11:07.698661 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.698491 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 14:11:07.699656 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.699636 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 14:11:07.710354 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.710330 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 14:11:07.721573 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.721527 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:11:07.779193 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779162 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779473 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779207 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779473 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779239 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44012832-9bdb-4133-babb-5873dfa08b0b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779473 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779327 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779473 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779425 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779473 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779452 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzcpr\" (UniqueName: \"kubernetes.io/projected/44012832-9bdb-4133-babb-5873dfa08b0b-kube-api-access-bzcpr\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779500 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779525 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779569 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779590 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-web-config\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779615 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779650 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779676 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779697 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779720 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779758 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779783 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-config\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779803 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44012832-9bdb-4133-babb-5873dfa08b0b-config-out\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.779829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779825 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.780349 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.779855 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.881415 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.881290 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44012832-9bdb-4133-babb-5873dfa08b0b-config-out\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.881415 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.881351 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.881415 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.881398 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.881829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.881431 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.881829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.881462 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.881829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.881496 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44012832-9bdb-4133-babb-5873dfa08b0b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.881829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.881521 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.881829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.881745 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.881829 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.881778 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzcpr\" (UniqueName: \"kubernetes.io/projected/44012832-9bdb-4133-babb-5873dfa08b0b-kube-api-access-bzcpr\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.883080 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.883051 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.883483 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.883413 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.885356 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.885313 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.886232 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.885705 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.886232 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.885747 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.886232 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.885799 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.886232 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.885829 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-web-config\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.886232 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.885857 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.886232 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.885909 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.886232 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.885915 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.886232 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.885965 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.886232 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.885992 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.886232 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.886016 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.886232 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.886061 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.886232 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.886092 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-config\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.887186 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.887081 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.887841 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.887729 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.887931 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.887844 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44012832-9bdb-4133-babb-5873dfa08b0b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.888308 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.888288 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.889241 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.888832 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44012832-9bdb-4133-babb-5873dfa08b0b-config-out\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.889241 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.889054 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.889241 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.889110 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-config\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.889847 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.889772 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.889847 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.889781 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.890338 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.890293 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.890935 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.890912 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.892100 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.892054 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.892653 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.892475 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-web-config\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.894091 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.894069 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.894744 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.894717 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.903325 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.903297 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzcpr\" (UniqueName: \"kubernetes.io/projected/44012832-9bdb-4133-babb-5873dfa08b0b-kube-api-access-bzcpr\") pod \"prometheus-k8s-0\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:07.981869 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:07.981691 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:08.939654 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:08.939623 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-hrrz8"] Jul 07 14:11:08.945069 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:11:08.945020 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab7fad4_03a5_4f76_bba9_b96fc67541b1.slice/crio-f5b635891f2dd8650602cb976fe19df0c774e16a6d37b781d9df55600d644d70 WatchSource:0}: Error finding container f5b635891f2dd8650602cb976fe19df0c774e16a6d37b781d9df55600d644d70: Status 404 returned error can't find the container with id f5b635891f2dd8650602cb976fe19df0c774e16a6d37b781d9df55600d644d70 Jul 07 14:11:09.000673 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:09.000632 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:11:09.002657 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:11:09.002624 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44012832_9bdb_4133_babb_5873dfa08b0b.slice/crio-c2f7cd4b14f060b5c7705c6890f596edd9eea80e43b8411169c2ffc42192980d WatchSource:0}: Error finding container c2f7cd4b14f060b5c7705c6890f596edd9eea80e43b8411169c2ffc42192980d: Status 404 returned error can't find the container with id c2f7cd4b14f060b5c7705c6890f596edd9eea80e43b8411169c2ffc42192980d Jul 07 14:11:09.779929 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:09.779888 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n" event={"ID":"df002840-32e8-49b4-a487-83cbfac99ab2","Type":"ContainerStarted","Data":"0a56f8a12600b773158d1c107445c71c26d461dd53a9dac7e1648c1faa3c3a14"} Jul 07 14:11:09.780103 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:09.780059 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n" Jul 07 14:11:09.781505 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:09.781477 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-hrrz8" event={"ID":"eab7fad4-03a5-4f76-bba9-b96fc67541b1","Type":"ContainerStarted","Data":"f5b635891f2dd8650602cb976fe19df0c774e16a6d37b781d9df55600d644d70"} Jul 07 14:11:09.783658 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:09.783608 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-859664664b-cqsgx" event={"ID":"bb5442dc-f0df-4427-b97b-f0a331303eca","Type":"ContainerStarted","Data":"c346679fa6c3b0d351ec703b9ec3f8ad9e75368b80a56834a5559f199d980d8c"} Jul 07 14:11:09.786567 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:09.786448 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n" Jul 07 14:11:09.786952 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:09.786774 2570 generic.go:356] "Generic (PLEG): container finished" podID="44012832-9bdb-4133-babb-5873dfa08b0b" containerID="d5a77d84f8331b438b93b5e35e656df3d814edc2012a68d9912e8133dc2018b9" exitCode=0 Jul 07 14:11:09.786952 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:09.786856 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerDied","Data":"d5a77d84f8331b438b93b5e35e656df3d814edc2012a68d9912e8133dc2018b9"} Jul 07 14:11:09.786952 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:09.786927 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerStarted","Data":"c2f7cd4b14f060b5c7705c6890f596edd9eea80e43b8411169c2ffc42192980d"} Jul 07 14:11:09.789455 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:09.789426 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" event={"ID":"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b","Type":"ContainerStarted","Data":"c486829fab39b67a3d2c1e7d3d2fec46be95cdebb4fd3788750947f879af01f7"} Jul 07 14:11:09.789557 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:09.789504 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" event={"ID":"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b","Type":"ContainerStarted","Data":"2a3a7e3f9b63915b2ef1741f7d2a686589d13a7dadba456e38a316162a5243b3"} Jul 07 14:11:09.789613 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:09.789572 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" event={"ID":"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b","Type":"ContainerStarted","Data":"e7ddd260634e007c07ea10cdcbf1d5e096a93ef2ba158d93b0d9e1d6332537af"} Jul 07 14:11:09.825903 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:09.825844 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lbz9n" podStartSLOduration=2.407469131 podStartE2EDuration="4.825826265s" totalImagesPullingTime="2.418357134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:09.825472176 +0000 UTC m=+79.044153915" watchObservedRunningTime="2026-07-07 14:11:09.825826265 +0000 UTC m=+79.044507986" Jul 07 14:11:09.860894 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:09.860836 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-859664664b-cqsgx" podStartSLOduration=2.169886149 podStartE2EDuration="4.860819102s" totalImagesPullingTime="2.690932953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:09.860114185 +0000 UTC m=+79.078795926" watchObservedRunningTime="2026-07-07 14:11:09.860819102 +0000 UTC m=+79.079500841" Jul 07 14:11:10.797062 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:10.797027 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" event={"ID":"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b","Type":"ContainerStarted","Data":"d3f182a3e5fd9085f79cbdb15f0dd218832a3a4799e106f1898733c2673a1dc3"} Jul 07 14:11:10.802524 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:10.802467 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerStarted","Data":"b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9"} Jul 07 14:11:10.802650 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:10.802575 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerStarted","Data":"126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc"} Jul 07 14:11:10.802650 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:10.802624 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerStarted","Data":"7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e"} Jul 07 14:11:10.802755 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:10.802665 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerStarted","Data":"eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3"} Jul 07 14:11:10.802755 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:10.802708 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerStarted","Data":"70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2"} Jul 07 14:11:11.812253 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:11.812211 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" event={"ID":"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b","Type":"ContainerStarted","Data":"ea48447ec4c6461d8160f8f6aa5f9b126960b5b3b6836b8703387ec8c5c0573c"} Jul 07 14:11:11.812732 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:11.812300 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" event={"ID":"ed4623a1-c6e6-4b65-90ea-3ccc63612c1b","Type":"ContainerStarted","Data":"2cf9bc2ff4220b1dc52858ae5ca701c7274b833603250c8e7855ba43b0563bb8"} Jul 07 14:11:11.812807 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:11.812774 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:11.817333 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:11.817208 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerStarted","Data":"0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37"} Jul 07 14:11:11.846825 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:11.846766 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" podStartSLOduration=2.898391418 podStartE2EDuration="8.846749669s" totalImagesPullingTime="5.948358251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:11.845158419 +0000 UTC m=+81.063840159" watchObservedRunningTime="2026-07-07 14:11:11.846749669 +0000 UTC m=+81.065431407" Jul 07 14:11:11.891132 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:11.891066 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.467985464 podStartE2EDuration="10.891043153s" totalImagesPullingTime="6.399859533s" totalInitContainerRuntime="23.198156ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:11.888490823 +0000 UTC m=+81.107172566" watchObservedRunningTime="2026-07-07 14:11:11.891043153 +0000 UTC m=+81.109724929" Jul 07 14:11:13.649644 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:13.649361 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-594cc4b499-jst28" Jul 07 14:11:14.838768 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:14.838677 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerStarted","Data":"08e99020158c37b0a9a106f03527dbafcb27ae639cb8d9421138f9033561a281"} Jul 07 14:11:14.838768 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:14.838749 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerStarted","Data":"5fb19ae0e1e38915a8284d50aa5c2192394d37f585216ee443680e8788e99416"} Jul 07 14:11:14.839221 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:14.838790 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerStarted","Data":"80b051d9b8a3c2b66d1c45c84c8599e0b33faca5c14ce93aa4d5b54fa35fb80a"} Jul 07 14:11:14.839221 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:14.838830 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerStarted","Data":"7234043e80986fe78df52bc6a4775bf2a665473cd4ff22c744e84f125dd13719"} Jul 07 14:11:14.839221 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:14.838869 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerStarted","Data":"7bf5f6ec598bf3f9c59e18801015c95c76593a14847121497b7f2bcd54b28a6d"} Jul 07 14:11:14.839221 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:14.838909 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerStarted","Data":"8aaca9a0ec17376f95b2103c876d7f148d62c9c683d5d180f0de7e0b279b8894"} Jul 07 14:11:14.899868 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:14.899802 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.416362816 podStartE2EDuration="7.899780694s" totalImagesPullingTime="4.464699923s" totalInitContainerRuntime="18.717955ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:14.899179478 +0000 UTC m=+84.117861218" watchObservedRunningTime="2026-07-07 14:11:14.899780694 +0000 UTC m=+84.118462491" Jul 07 14:11:17.829474 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:17.829445 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66dcd899c7-rdxsk" Jul 07 14:11:17.982677 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:17.982634 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:11:25.581140 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:25.581100 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:25.581735 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:25.581171 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:27.903078 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:27.903043 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-hrrz8" event={"ID":"eab7fad4-03a5-4f76-bba9-b96fc67541b1","Type":"ContainerStarted","Data":"a8dd22440ba580fa43a80529c5071bb97c0575e9cee6f60773a0669b054ee229"} Jul 07 14:11:27.903559 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:27.903260 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-hrrz8" Jul 07 14:11:27.904722 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:27.904692 2570 patch_prober.go:28] interesting pod/downloads-685bfb5f64-hrrz8 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.18:8080/\": dial tcp 10.134.0.18:8080: connect: connection refused" start-of-body= Jul 07 14:11:27.904781 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:27.904737 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-hrrz8" podUID="eab7fad4-03a5-4f76-bba9-b96fc67541b1" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.18:8080/\": dial tcp 10.134.0.18:8080: connect: connection refused" Jul 07 14:11:27.925697 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:27.925601 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-hrrz8" podStartSLOduration=2.203483501 podStartE2EDuration="20.925584394s" totalImagesPullingTime="18.722100893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:27.924248339 +0000 UTC m=+97.142930079" watchObservedRunningTime="2026-07-07 14:11:27.925584394 +0000 UTC m=+97.144266138" Jul 07 14:11:28.921763 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:28.921729 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-hrrz8" Jul 07 14:11:34.731241 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:34.731203 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mhkl6" Jul 07 14:11:45.586248 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:45.586216 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:11:45.590050 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:11:45.590026 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-859664664b-cqsgx" Jul 07 14:12:07.982741 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:07.982705 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:08.043939 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:08.043904 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:08.094722 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:08.094698 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:21.615370 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:21.615334 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:12:21.615865 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:21.615746 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="alertmanager" containerID="cri-o://70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2" gracePeriod=120 Jul 07 14:12:21.615865 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:21.615800 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="kube-rbac-proxy-metric" containerID="cri-o://b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9" gracePeriod=120 Jul 07 14:12:21.615865 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:21.615814 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="kube-rbac-proxy-web" containerID="cri-o://7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e" gracePeriod=120 Jul 07 14:12:21.616027 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:21.615888 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="prom-label-proxy" containerID="cri-o://0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37" gracePeriod=120 Jul 07 14:12:21.616027 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:21.615889 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="kube-rbac-proxy" containerID="cri-o://126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc" gracePeriod=120 Jul 07 14:12:21.616027 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:21.615842 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="config-reloader" containerID="cri-o://eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3" gracePeriod=120 Jul 07 14:12:22.133558 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.133514 2570 generic.go:356] "Generic (PLEG): container finished" podID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerID="0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37" exitCode=0 Jul 07 14:12:22.133558 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.133553 2570 generic.go:356] "Generic (PLEG): container finished" podID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerID="126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc" exitCode=0 Jul 07 14:12:22.133777 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.133567 2570 generic.go:356] "Generic (PLEG): container finished" podID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerID="eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3" exitCode=0 Jul 07 14:12:22.133777 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.133577 2570 generic.go:356] "Generic (PLEG): container finished" podID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerID="70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2" exitCode=0 Jul 07 14:12:22.133777 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.133570 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerDied","Data":"0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37"} Jul 07 14:12:22.133777 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.133632 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerDied","Data":"126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc"} Jul 07 14:12:22.133777 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.133659 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerDied","Data":"eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3"} Jul 07 14:12:22.133777 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.133683 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerDied","Data":"70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2"} Jul 07 14:12:22.869588 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.869563 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:22.975681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.975653 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/403ba728-1b32-42dd-a5fb-ced8934c9154-alertmanager-main-db\") pod \"403ba728-1b32-42dd-a5fb-ced8934c9154\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " Jul 07 14:12:22.975831 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.975702 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy-metric\") pod \"403ba728-1b32-42dd-a5fb-ced8934c9154\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " Jul 07 14:12:22.975831 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.975734 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/403ba728-1b32-42dd-a5fb-ced8934c9154-metrics-client-ca\") pod \"403ba728-1b32-42dd-a5fb-ced8934c9154\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " Jul 07 14:12:22.975831 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.975756 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-config-volume\") pod \"403ba728-1b32-42dd-a5fb-ced8934c9154\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " Jul 07 14:12:22.975831 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.975781 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/403ba728-1b32-42dd-a5fb-ced8934c9154-config-out\") pod \"403ba728-1b32-42dd-a5fb-ced8934c9154\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " Jul 07 14:12:22.975831 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.975800 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/403ba728-1b32-42dd-a5fb-ced8934c9154-tls-assets\") pod \"403ba728-1b32-42dd-a5fb-ced8934c9154\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " Jul 07 14:12:22.976094 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.975921 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-main-tls\") pod \"403ba728-1b32-42dd-a5fb-ced8934c9154\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " Jul 07 14:12:22.976094 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.975962 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-cluster-tls-config\") pod \"403ba728-1b32-42dd-a5fb-ced8934c9154\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " Jul 07 14:12:22.976094 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.976001 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403ba728-1b32-42dd-a5fb-ced8934c9154-alertmanager-trusted-ca-bundle\") pod \"403ba728-1b32-42dd-a5fb-ced8934c9154\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " Jul 07 14:12:22.976094 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.976027 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy\") pod \"403ba728-1b32-42dd-a5fb-ced8934c9154\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " Jul 07 14:12:22.976094 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.976025 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/403ba728-1b32-42dd-a5fb-ced8934c9154-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "403ba728-1b32-42dd-a5fb-ced8934c9154" (UID: "403ba728-1b32-42dd-a5fb-ced8934c9154"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:12:22.976094 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.976072 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-web-config\") pod \"403ba728-1b32-42dd-a5fb-ced8934c9154\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " Jul 07 14:12:22.976383 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.976112 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n49hf\" (UniqueName: \"kubernetes.io/projected/403ba728-1b32-42dd-a5fb-ced8934c9154-kube-api-access-n49hf\") pod \"403ba728-1b32-42dd-a5fb-ced8934c9154\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " Jul 07 14:12:22.976383 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.976152 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy-web\") pod \"403ba728-1b32-42dd-a5fb-ced8934c9154\" (UID: \"403ba728-1b32-42dd-a5fb-ced8934c9154\") " Jul 07 14:12:22.976383 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.976172 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/403ba728-1b32-42dd-a5fb-ced8934c9154-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "403ba728-1b32-42dd-a5fb-ced8934c9154" (UID: "403ba728-1b32-42dd-a5fb-ced8934c9154"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:12:22.978417 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.976385 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/403ba728-1b32-42dd-a5fb-ced8934c9154-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "403ba728-1b32-42dd-a5fb-ced8934c9154" (UID: "403ba728-1b32-42dd-a5fb-ced8934c9154"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:12:22.978417 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.976432 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/403ba728-1b32-42dd-a5fb-ced8934c9154-alertmanager-main-db\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:22.978417 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.976451 2570 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/403ba728-1b32-42dd-a5fb-ced8934c9154-metrics-client-ca\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:22.979409 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.979133 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-config-volume" (OuterVolumeSpecName: "config-volume") pod "403ba728-1b32-42dd-a5fb-ced8934c9154" (UID: "403ba728-1b32-42dd-a5fb-ced8934c9154"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:22.979409 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.979383 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/403ba728-1b32-42dd-a5fb-ced8934c9154-config-out" (OuterVolumeSpecName: "config-out") pod "403ba728-1b32-42dd-a5fb-ced8934c9154" (UID: "403ba728-1b32-42dd-a5fb-ced8934c9154"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:12:22.979672 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.979646 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "403ba728-1b32-42dd-a5fb-ced8934c9154" (UID: "403ba728-1b32-42dd-a5fb-ced8934c9154"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:22.979989 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.979963 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/403ba728-1b32-42dd-a5fb-ced8934c9154-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "403ba728-1b32-42dd-a5fb-ced8934c9154" (UID: "403ba728-1b32-42dd-a5fb-ced8934c9154"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:12:22.980084 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.980054 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/403ba728-1b32-42dd-a5fb-ced8934c9154-kube-api-access-n49hf" (OuterVolumeSpecName: "kube-api-access-n49hf") pod "403ba728-1b32-42dd-a5fb-ced8934c9154" (UID: "403ba728-1b32-42dd-a5fb-ced8934c9154"). InnerVolumeSpecName "kube-api-access-n49hf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:12:22.980145 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.980107 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "403ba728-1b32-42dd-a5fb-ced8934c9154" (UID: "403ba728-1b32-42dd-a5fb-ced8934c9154"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:22.981042 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.981019 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "403ba728-1b32-42dd-a5fb-ced8934c9154" (UID: "403ba728-1b32-42dd-a5fb-ced8934c9154"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:22.981253 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.981233 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "403ba728-1b32-42dd-a5fb-ced8934c9154" (UID: "403ba728-1b32-42dd-a5fb-ced8934c9154"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:22.984423 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.984396 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "403ba728-1b32-42dd-a5fb-ced8934c9154" (UID: "403ba728-1b32-42dd-a5fb-ced8934c9154"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:22.990607 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:22.990514 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-web-config" (OuterVolumeSpecName: "web-config") pod "403ba728-1b32-42dd-a5fb-ced8934c9154" (UID: "403ba728-1b32-42dd-a5fb-ced8934c9154"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:23.077052 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.077018 2570 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-config-volume\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:23.077052 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.077050 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/403ba728-1b32-42dd-a5fb-ced8934c9154-config-out\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:23.077052 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.077062 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/403ba728-1b32-42dd-a5fb-ced8934c9154-tls-assets\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:23.077352 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.077075 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-main-tls\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:23.077352 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.077087 2570 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-cluster-tls-config\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:23.077352 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.077100 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403ba728-1b32-42dd-a5fb-ced8934c9154-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:23.077352 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.077114 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:23.077352 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.077127 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-web-config\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:23.077352 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.077138 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n49hf\" (UniqueName: \"kubernetes.io/projected/403ba728-1b32-42dd-a5fb-ced8934c9154-kube-api-access-n49hf\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:23.077352 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.077149 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:23.077352 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.077161 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/403ba728-1b32-42dd-a5fb-ced8934c9154-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:23.141644 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.141610 2570 generic.go:356] "Generic (PLEG): container finished" podID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerID="b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9" exitCode=0 Jul 07 14:12:23.141644 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.141636 2570 generic.go:356] "Generic (PLEG): container finished" podID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerID="7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e" exitCode=0 Jul 07 14:12:23.141828 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.141704 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.141828 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.141698 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerDied","Data":"b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9"} Jul 07 14:12:23.141892 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.141875 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerDied","Data":"7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e"} Jul 07 14:12:23.141925 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.141904 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"403ba728-1b32-42dd-a5fb-ced8934c9154","Type":"ContainerDied","Data":"1c4f00801d5fbe67fb0523308d23ecbaf6df7267c221416c4adf25f56e6affdb"} Jul 07 14:12:23.141978 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.141942 2570 scope.go:117] "RemoveContainer" containerID="0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37" Jul 07 14:12:23.150318 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.150302 2570 scope.go:117] "RemoveContainer" containerID="b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9" Jul 07 14:12:23.157688 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.157662 2570 scope.go:117] "RemoveContainer" containerID="126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc" Jul 07 14:12:23.164303 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.164278 2570 scope.go:117] "RemoveContainer" containerID="7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e" Jul 07 14:12:23.168887 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.168861 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:12:23.172942 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.172916 2570 scope.go:117] "RemoveContainer" containerID="eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3" Jul 07 14:12:23.174574 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.174552 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:12:23.180242 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.180225 2570 scope.go:117] "RemoveContainer" containerID="70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2" Jul 07 14:12:23.187208 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.187189 2570 scope.go:117] "RemoveContainer" containerID="fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d" Jul 07 14:12:23.194251 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.194231 2570 scope.go:117] "RemoveContainer" containerID="0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37" Jul 07 14:12:23.194518 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:12:23.194498 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37\": container with ID starting with 0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37 not found: ID does not exist" containerID="0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37" Jul 07 14:12:23.194616 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.194529 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37"} err="failed to get container status \"0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37\": rpc error: code = NotFound desc = could not find container \"0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37\": container with ID starting with 0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37 not found: ID does not exist" Jul 07 14:12:23.194616 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.194595 2570 scope.go:117] "RemoveContainer" containerID="b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9" Jul 07 14:12:23.194854 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:12:23.194837 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9\": container with ID starting with b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9 not found: ID does not exist" containerID="b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9" Jul 07 14:12:23.194892 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.194861 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9"} err="failed to get container status \"b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9\": rpc error: code = NotFound desc = could not find container \"b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9\": container with ID starting with b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9 not found: ID does not exist" Jul 07 14:12:23.194892 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.194876 2570 scope.go:117] "RemoveContainer" containerID="126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc" Jul 07 14:12:23.195108 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:12:23.195094 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc\": container with ID starting with 126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc not found: ID does not exist" containerID="126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc" Jul 07 14:12:23.195160 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.195111 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc"} err="failed to get container status \"126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc\": rpc error: code = NotFound desc = could not find container \"126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc\": container with ID starting with 126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc not found: ID does not exist" Jul 07 14:12:23.195160 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.195122 2570 scope.go:117] "RemoveContainer" containerID="7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e" Jul 07 14:12:23.195332 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:12:23.195317 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e\": container with ID starting with 7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e not found: ID does not exist" containerID="7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e" Jul 07 14:12:23.195368 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.195334 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e"} err="failed to get container status \"7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e\": rpc error: code = NotFound desc = could not find container \"7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e\": container with ID starting with 7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e not found: ID does not exist" Jul 07 14:12:23.195368 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.195345 2570 scope.go:117] "RemoveContainer" containerID="eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3" Jul 07 14:12:23.195533 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:12:23.195516 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3\": container with ID starting with eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3 not found: ID does not exist" containerID="eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3" Jul 07 14:12:23.195655 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.195536 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3"} err="failed to get container status \"eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3\": rpc error: code = NotFound desc = could not find container \"eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3\": container with ID starting with eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3 not found: ID does not exist" Jul 07 14:12:23.195701 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.195655 2570 scope.go:117] "RemoveContainer" containerID="70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2" Jul 07 14:12:23.195875 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:12:23.195858 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2\": container with ID starting with 70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2 not found: ID does not exist" containerID="70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2" Jul 07 14:12:23.195914 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.195883 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2"} err="failed to get container status \"70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2\": rpc error: code = NotFound desc = could not find container \"70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2\": container with ID starting with 70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2 not found: ID does not exist" Jul 07 14:12:23.195914 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.195898 2570 scope.go:117] "RemoveContainer" containerID="fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d" Jul 07 14:12:23.196144 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:12:23.196126 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d\": container with ID starting with fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d not found: ID does not exist" containerID="fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d" Jul 07 14:12:23.196208 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.196150 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d"} err="failed to get container status \"fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d\": rpc error: code = NotFound desc = could not find container \"fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d\": container with ID starting with fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d not found: ID does not exist" Jul 07 14:12:23.196208 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.196170 2570 scope.go:117] "RemoveContainer" containerID="0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37" Jul 07 14:12:23.196386 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.196362 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37"} err="failed to get container status \"0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37\": rpc error: code = NotFound desc = could not find container \"0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37\": container with ID starting with 0923f05ac5b35ea03cb1850dd193bd3e07675acafef580f4d00cdfdef0856d37 not found: ID does not exist" Jul 07 14:12:23.196434 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.196385 2570 scope.go:117] "RemoveContainer" containerID="b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9" Jul 07 14:12:23.196601 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.196577 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9"} err="failed to get container status \"b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9\": rpc error: code = NotFound desc = could not find container \"b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9\": container with ID starting with b5482562d3fe4371e8ffa79adeafb35adb6b9613d5ea01e4dac3e2c9a07909c9 not found: ID does not exist" Jul 07 14:12:23.196657 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.196603 2570 scope.go:117] "RemoveContainer" containerID="126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc" Jul 07 14:12:23.196881 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.196817 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc"} err="failed to get container status \"126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc\": rpc error: code = NotFound desc = could not find container \"126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc\": container with ID starting with 126d27d3e688327ccb2af2c68773d02434396349e89f6e92de82fb6be35962dc not found: ID does not exist" Jul 07 14:12:23.196881 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.196835 2570 scope.go:117] "RemoveContainer" containerID="7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e" Jul 07 14:12:23.197111 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.197093 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e"} err="failed to get container status \"7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e\": rpc error: code = NotFound desc = could not find container \"7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e\": container with ID starting with 7a5000ff1d2e62f8ece8f323ad6a7e7f2b8a55fe26aa97d5e69cc28c6abccf7e not found: ID does not exist" Jul 07 14:12:23.197156 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.197111 2570 scope.go:117] "RemoveContainer" containerID="eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3" Jul 07 14:12:23.197414 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.197391 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3"} err="failed to get container status \"eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3\": rpc error: code = NotFound desc = could not find container \"eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3\": container with ID starting with eadb7d1de702a37ea50de032fb7c1bcfeb893239ae69759e23b01926251230a3 not found: ID does not exist" Jul 07 14:12:23.197414 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.197415 2570 scope.go:117] "RemoveContainer" containerID="70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2" Jul 07 14:12:23.197681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.197660 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2"} err="failed to get container status \"70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2\": rpc error: code = NotFound desc = could not find container \"70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2\": container with ID starting with 70e5682d25626a4ebe02fbc26eab18f36a3fece23d43796c32508448a821a5c2 not found: ID does not exist" Jul 07 14:12:23.197681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.197681 2570 scope.go:117] "RemoveContainer" containerID="fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d" Jul 07 14:12:23.198027 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.197926 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d"} err="failed to get container status \"fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d\": rpc error: code = NotFound desc = could not find container \"fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d\": container with ID starting with fb87c5f108f340764134dba9b29e0791ef7d75664a9290fc7a3670aebf029f5d not found: ID does not exist" Jul 07 14:12:23.210957 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.210927 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:12:23.211243 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211232 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="kube-rbac-proxy-metric" Jul 07 14:12:23.211285 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211246 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="kube-rbac-proxy-metric" Jul 07 14:12:23.211285 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211255 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="alertmanager" Jul 07 14:12:23.211285 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211261 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="alertmanager" Jul 07 14:12:23.211285 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211269 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="kube-rbac-proxy-web" Jul 07 14:12:23.211285 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211274 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="kube-rbac-proxy-web" Jul 07 14:12:23.211426 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211288 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="init-config-reloader" Jul 07 14:12:23.211426 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211295 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="init-config-reloader" Jul 07 14:12:23.211426 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211302 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="prom-label-proxy" Jul 07 14:12:23.211426 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211307 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="prom-label-proxy" Jul 07 14:12:23.211426 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211313 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="kube-rbac-proxy" Jul 07 14:12:23.211426 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211318 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="kube-rbac-proxy" Jul 07 14:12:23.211426 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211326 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="config-reloader" Jul 07 14:12:23.211426 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211331 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="config-reloader" Jul 07 14:12:23.211426 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211374 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="alertmanager" Jul 07 14:12:23.211426 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211384 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="kube-rbac-proxy" Jul 07 14:12:23.211426 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211391 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="kube-rbac-proxy-web" Jul 07 14:12:23.211426 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211397 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="prom-label-proxy" Jul 07 14:12:23.211426 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211402 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="config-reloader" Jul 07 14:12:23.211426 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.211408 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" containerName="kube-rbac-proxy-metric" Jul 07 14:12:23.215398 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.215378 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.221851 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.221829 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 14:12:23.221980 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.221829 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 14:12:23.221980 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.221834 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 14:12:23.222093 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.221977 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 14:12:23.222168 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.222146 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sr4x2\"" Jul 07 14:12:23.222967 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.222944 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 14:12:23.223067 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.223043 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 14:12:23.225561 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.225515 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 14:12:23.225561 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.225515 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 14:12:23.228091 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.228042 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 14:12:23.247090 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.247062 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:12:23.278737 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.278702 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.278904 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.278746 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.278904 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.278774 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52320b0f-e808-4ff5-bb97-624e5670a604-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.278904 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.278852 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.278904 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.278895 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hcc6\" (UniqueName: \"kubernetes.io/projected/52320b0f-e808-4ff5-bb97-624e5670a604-kube-api-access-2hcc6\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.279154 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.278961 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-web-config\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.279154 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.279003 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-config-volume\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.279154 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.279031 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.279154 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.279060 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52320b0f-e808-4ff5-bb97-624e5670a604-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.279154 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.279101 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52320b0f-e808-4ff5-bb97-624e5670a604-tls-assets\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.279154 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.279139 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/52320b0f-e808-4ff5-bb97-624e5670a604-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.279394 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.279199 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.279394 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.279265 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52320b0f-e808-4ff5-bb97-624e5670a604-config-out\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.379977 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.379938 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.379977 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.379973 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52320b0f-e808-4ff5-bb97-624e5670a604-config-out\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.380223 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.380002 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.380223 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.380038 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.380223 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.380072 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52320b0f-e808-4ff5-bb97-624e5670a604-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.380223 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.380101 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.380223 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.380126 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hcc6\" (UniqueName: \"kubernetes.io/projected/52320b0f-e808-4ff5-bb97-624e5670a604-kube-api-access-2hcc6\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.380223 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.380158 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-web-config\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.380223 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.380189 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-config-volume\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.380223 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.380213 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.380649 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.380235 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52320b0f-e808-4ff5-bb97-624e5670a604-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.380649 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.380263 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52320b0f-e808-4ff5-bb97-624e5670a604-tls-assets\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.380649 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.380288 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/52320b0f-e808-4ff5-bb97-624e5670a604-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.380796 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.380653 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/52320b0f-e808-4ff5-bb97-624e5670a604-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.381302 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.381267 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52320b0f-e808-4ff5-bb97-624e5670a604-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.381592 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.381566 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52320b0f-e808-4ff5-bb97-624e5670a604-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.382975 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.382927 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52320b0f-e808-4ff5-bb97-624e5670a604-config-out\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.383259 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.383169 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.383962 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.383621 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.383962 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.383649 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.383962 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.383908 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.383962 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.383933 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52320b0f-e808-4ff5-bb97-624e5670a604-tls-assets\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.384320 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.384299 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="403ba728-1b32-42dd-a5fb-ced8934c9154" path="/var/lib/kubelet/pods/403ba728-1b32-42dd-a5fb-ced8934c9154/volumes" Jul 07 14:12:23.384381 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.384359 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-web-config\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.384657 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.384640 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.385253 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.385235 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/52320b0f-e808-4ff5-bb97-624e5670a604-config-volume\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.390219 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.390200 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hcc6\" (UniqueName: \"kubernetes.io/projected/52320b0f-e808-4ff5-bb97-624e5670a604-kube-api-access-2hcc6\") pod \"alertmanager-main-0\" (UID: \"52320b0f-e808-4ff5-bb97-624e5670a604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.524180 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.524097 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:12:23.669364 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:23.669337 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:12:23.673120 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:12:23.673084 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52320b0f_e808_4ff5_bb97_624e5670a604.slice/crio-6d68e12d5e409c5f12c5bac452c6299837dd0b11fa2accdcb605e92e7c686ed0 WatchSource:0}: Error finding container 6d68e12d5e409c5f12c5bac452c6299837dd0b11fa2accdcb605e92e7c686ed0: Status 404 returned error can't find the container with id 6d68e12d5e409c5f12c5bac452c6299837dd0b11fa2accdcb605e92e7c686ed0 Jul 07 14:12:24.146964 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:24.146928 2570 generic.go:356] "Generic (PLEG): container finished" podID="52320b0f-e808-4ff5-bb97-624e5670a604" containerID="bcb374acb57aa0dfb43f044df2ac3c465c91764066c16d704c274b1af53b89b4" exitCode=0 Jul 07 14:12:24.147407 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:24.147018 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52320b0f-e808-4ff5-bb97-624e5670a604","Type":"ContainerDied","Data":"bcb374acb57aa0dfb43f044df2ac3c465c91764066c16d704c274b1af53b89b4"} Jul 07 14:12:24.147407 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:24.147115 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52320b0f-e808-4ff5-bb97-624e5670a604","Type":"ContainerStarted","Data":"6d68e12d5e409c5f12c5bac452c6299837dd0b11fa2accdcb605e92e7c686ed0"} Jul 07 14:12:25.155717 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.155680 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52320b0f-e808-4ff5-bb97-624e5670a604","Type":"ContainerStarted","Data":"0e82ddb39e171abc2d803c4f920e3cea7e22285f2a1daf098384423c5b1ac8c3"} Jul 07 14:12:25.156179 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.155792 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52320b0f-e808-4ff5-bb97-624e5670a604","Type":"ContainerStarted","Data":"050f5f251cfe99fd16d2069fe5d58dc6971ed2a9b4e4fa057ddb38883e07bf0c"} Jul 07 14:12:25.156179 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.155842 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52320b0f-e808-4ff5-bb97-624e5670a604","Type":"ContainerStarted","Data":"80a75a730f9644e34ff42294b7d12d555b67f2028157f227f76a9ad912c3653f"} Jul 07 14:12:25.156179 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.155886 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52320b0f-e808-4ff5-bb97-624e5670a604","Type":"ContainerStarted","Data":"a7fb6cc07e73954a89f7cbb06d137bf252a55777264c251cfbfb151c9dc2d5a2"} Jul 07 14:12:25.156179 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.155927 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52320b0f-e808-4ff5-bb97-624e5670a604","Type":"ContainerStarted","Data":"e63fec15671182f0e74ca266d3e97efba81f7ec9275f9a848f380c8111762c79"} Jul 07 14:12:25.156179 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.155970 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"52320b0f-e808-4ff5-bb97-624e5670a604","Type":"ContainerStarted","Data":"d8f586736ea76c20e96776331d28288e1e4d932f60860954986b6f8ed6bd07dc"} Jul 07 14:12:25.189390 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.189335 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.169664898 podStartE2EDuration="2.189315227s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.650329ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:12:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:12:25.187010116 +0000 UTC m=+154.405691855" watchObservedRunningTime="2026-07-07 14:12:25.189315227 +0000 UTC m=+154.407996967" Jul 07 14:12:25.649085 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.649055 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf"] Jul 07 14:12:25.651952 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.651931 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.655148 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.654876 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 14:12:25.655324 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.655300 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 14:12:25.655726 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.655700 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 14:12:25.656011 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.655979 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 14:12:25.656092 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.656068 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 14:12:25.656329 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.656311 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6bzxb\"" Jul 07 14:12:25.661439 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.661416 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 14:12:25.668170 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.668139 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf"] Jul 07 14:12:25.703712 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.703684 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1b814eb5-e5bd-44bb-962b-db261918a560-telemeter-client-tls\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.703862 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.703720 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1b814eb5-e5bd-44bb-962b-db261918a560-secret-telemeter-client\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.703862 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.703746 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b814eb5-e5bd-44bb-962b-db261918a560-metrics-client-ca\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.703862 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.703836 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s8m8\" (UniqueName: \"kubernetes.io/projected/1b814eb5-e5bd-44bb-962b-db261918a560-kube-api-access-6s8m8\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.703964 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.703877 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b814eb5-e5bd-44bb-962b-db261918a560-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.703964 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.703903 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b814eb5-e5bd-44bb-962b-db261918a560-serving-certs-ca-bundle\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.703964 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.703954 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b814eb5-e5bd-44bb-962b-db261918a560-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.704054 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.703973 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1b814eb5-e5bd-44bb-962b-db261918a560-federate-client-tls\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.804871 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.804832 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b814eb5-e5bd-44bb-962b-db261918a560-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.805071 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.804880 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b814eb5-e5bd-44bb-962b-db261918a560-serving-certs-ca-bundle\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.805071 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.804957 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b814eb5-e5bd-44bb-962b-db261918a560-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.805071 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.804990 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1b814eb5-e5bd-44bb-962b-db261918a560-federate-client-tls\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.805071 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.805036 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1b814eb5-e5bd-44bb-962b-db261918a560-telemeter-client-tls\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.805071 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.805066 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1b814eb5-e5bd-44bb-962b-db261918a560-secret-telemeter-client\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.805340 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.805107 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b814eb5-e5bd-44bb-962b-db261918a560-metrics-client-ca\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.805340 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.805178 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8m8\" (UniqueName: \"kubernetes.io/projected/1b814eb5-e5bd-44bb-962b-db261918a560-kube-api-access-6s8m8\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.805727 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.805694 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b814eb5-e5bd-44bb-962b-db261918a560-serving-certs-ca-bundle\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.805870 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.805838 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b814eb5-e5bd-44bb-962b-db261918a560-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.806121 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.806089 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b814eb5-e5bd-44bb-962b-db261918a560-metrics-client-ca\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.808609 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.808519 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1b814eb5-e5bd-44bb-962b-db261918a560-federate-client-tls\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.808609 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.808578 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b814eb5-e5bd-44bb-962b-db261918a560-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.808609 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.808587 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1b814eb5-e5bd-44bb-962b-db261918a560-secret-telemeter-client\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.808807 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.808666 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1b814eb5-e5bd-44bb-962b-db261918a560-telemeter-client-tls\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.819033 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.819002 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s8m8\" (UniqueName: \"kubernetes.io/projected/1b814eb5-e5bd-44bb-962b-db261918a560-kube-api-access-6s8m8\") pod \"telemeter-client-7c6cd7f55d-5d6vf\" (UID: \"1b814eb5-e5bd-44bb-962b-db261918a560\") " pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.964361 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.964260 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" Jul 07 14:12:25.975705 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.975673 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:12:25.976055 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.976023 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="prometheus" containerID="cri-o://8aaca9a0ec17376f95b2103c876d7f148d62c9c683d5d180f0de7e0b279b8894" gracePeriod=600 Jul 07 14:12:25.976191 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.976048 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="kube-rbac-proxy" containerID="cri-o://5fb19ae0e1e38915a8284d50aa5c2192394d37f585216ee443680e8788e99416" gracePeriod=600 Jul 07 14:12:25.976191 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.976088 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://08e99020158c37b0a9a106f03527dbafcb27ae639cb8d9421138f9033561a281" gracePeriod=600 Jul 07 14:12:25.976191 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.976127 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="thanos-sidecar" containerID="cri-o://7234043e80986fe78df52bc6a4775bf2a665473cd4ff22c744e84f125dd13719" gracePeriod=600 Jul 07 14:12:25.976347 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.976195 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="config-reloader" containerID="cri-o://7bf5f6ec598bf3f9c59e18801015c95c76593a14847121497b7f2bcd54b28a6d" gracePeriod=600 Jul 07 14:12:25.976347 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:25.976272 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="kube-rbac-proxy-web" containerID="cri-o://80b051d9b8a3c2b66d1c45c84c8599e0b33faca5c14ce93aa4d5b54fa35fb80a" gracePeriod=600 Jul 07 14:12:26.163054 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.162954 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf"] Jul 07 14:12:26.167024 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:12:26.166997 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b814eb5_e5bd_44bb_962b_db261918a560.slice/crio-30a81e46f8ff89395c7aaa0ab12680ccf8a8a64052e5c4c88107026c9b71eada WatchSource:0}: Error finding container 30a81e46f8ff89395c7aaa0ab12680ccf8a8a64052e5c4c88107026c9b71eada: Status 404 returned error can't find the container with id 30a81e46f8ff89395c7aaa0ab12680ccf8a8a64052e5c4c88107026c9b71eada Jul 07 14:12:26.168529 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.168498 2570 generic.go:356] "Generic (PLEG): container finished" podID="44012832-9bdb-4133-babb-5873dfa08b0b" containerID="08e99020158c37b0a9a106f03527dbafcb27ae639cb8d9421138f9033561a281" exitCode=0 Jul 07 14:12:26.168646 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.168529 2570 generic.go:356] "Generic (PLEG): container finished" podID="44012832-9bdb-4133-babb-5873dfa08b0b" containerID="5fb19ae0e1e38915a8284d50aa5c2192394d37f585216ee443680e8788e99416" exitCode=0 Jul 07 14:12:26.168646 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.168557 2570 generic.go:356] "Generic (PLEG): container finished" podID="44012832-9bdb-4133-babb-5873dfa08b0b" containerID="80b051d9b8a3c2b66d1c45c84c8599e0b33faca5c14ce93aa4d5b54fa35fb80a" exitCode=0 Jul 07 14:12:26.168646 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.168566 2570 generic.go:356] "Generic (PLEG): container finished" podID="44012832-9bdb-4133-babb-5873dfa08b0b" containerID="7234043e80986fe78df52bc6a4775bf2a665473cd4ff22c744e84f125dd13719" exitCode=0 Jul 07 14:12:26.168646 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.168575 2570 generic.go:356] "Generic (PLEG): container finished" podID="44012832-9bdb-4133-babb-5873dfa08b0b" containerID="7bf5f6ec598bf3f9c59e18801015c95c76593a14847121497b7f2bcd54b28a6d" exitCode=0 Jul 07 14:12:26.168646 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.168583 2570 generic.go:356] "Generic (PLEG): container finished" podID="44012832-9bdb-4133-babb-5873dfa08b0b" containerID="8aaca9a0ec17376f95b2103c876d7f148d62c9c683d5d180f0de7e0b279b8894" exitCode=0 Jul 07 14:12:26.168646 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.168575 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerDied","Data":"08e99020158c37b0a9a106f03527dbafcb27ae639cb8d9421138f9033561a281"} Jul 07 14:12:26.168949 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.168659 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerDied","Data":"5fb19ae0e1e38915a8284d50aa5c2192394d37f585216ee443680e8788e99416"} Jul 07 14:12:26.168949 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.168706 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerDied","Data":"80b051d9b8a3c2b66d1c45c84c8599e0b33faca5c14ce93aa4d5b54fa35fb80a"} Jul 07 14:12:26.168949 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.168747 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerDied","Data":"7234043e80986fe78df52bc6a4775bf2a665473cd4ff22c744e84f125dd13719"} Jul 07 14:12:26.168949 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.168789 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerDied","Data":"7bf5f6ec598bf3f9c59e18801015c95c76593a14847121497b7f2bcd54b28a6d"} Jul 07 14:12:26.168949 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.168830 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerDied","Data":"8aaca9a0ec17376f95b2103c876d7f148d62c9c683d5d180f0de7e0b279b8894"} Jul 07 14:12:26.256033 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.256003 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:26.313745 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.313711 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-web-config\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.313917 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.313762 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-config\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.313917 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.313819 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-metrics-client-ca\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.313917 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.313847 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-db\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.313917 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.313878 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-trusted-ca-bundle\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314189 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314165 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-metrics-client-certs\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314253 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314206 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-grpc-tls\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314253 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314222 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:12:26.314253 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314237 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-2\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314275 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:12:26.314698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314290 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-thanos-prometheus-http-client-file\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314318 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-0\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314352 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44012832-9bdb-4133-babb-5873dfa08b0b-config-out\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314398 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-kube-rbac-proxy\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314427 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314453 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-tls\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314487 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzcpr\" (UniqueName: \"kubernetes.io/projected/44012832-9bdb-4133-babb-5873dfa08b0b-kube-api-access-bzcpr\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314499 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:12:26.314698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314512 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-kubelet-serving-ca-bundle\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314535 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-serving-certs-ca-bundle\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314588 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-1\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314645 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44012832-9bdb-4133-babb-5873dfa08b0b-tls-assets\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.314698 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314670 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"44012832-9bdb-4133-babb-5873dfa08b0b\" (UID: \"44012832-9bdb-4133-babb-5873dfa08b0b\") " Jul 07 14:12:26.315334 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314955 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-metrics-client-ca\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.315334 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314972 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.315334 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.314987 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.315334 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.315119 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:12:26.316640 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.316195 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:12:26.318193 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.318165 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:12:26.318569 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.318358 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:26.318569 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.318428 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:26.318569 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.318483 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:26.319242 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.318914 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:12:26.319242 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.319207 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:12:26.319568 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.319478 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:26.319568 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.319501 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-config" (OuterVolumeSpecName: "config") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:26.320109 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.319947 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:26.321371 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.321336 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44012832-9bdb-4133-babb-5873dfa08b0b-kube-api-access-bzcpr" (OuterVolumeSpecName: "kube-api-access-bzcpr") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "kube-api-access-bzcpr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:12:26.321824 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.321782 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44012832-9bdb-4133-babb-5873dfa08b0b-config-out" (OuterVolumeSpecName: "config-out") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:12:26.322033 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.322013 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44012832-9bdb-4133-babb-5873dfa08b0b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:12:26.322132 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.322023 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:26.322229 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.322203 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:26.333231 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.333182 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-web-config" (OuterVolumeSpecName: "web-config") pod "44012832-9bdb-4133-babb-5873dfa08b0b" (UID: "44012832-9bdb-4133-babb-5873dfa08b0b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:12:26.416355 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416320 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44012832-9bdb-4133-babb-5873dfa08b0b-tls-assets\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416355 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416350 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416355 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416360 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-web-config\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416611 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416370 2570 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-config\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416611 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416378 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-db\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416611 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416389 2570 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-metrics-client-certs\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416611 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416397 2570 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-grpc-tls\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416611 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416405 2570 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416611 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416415 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416611 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416423 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44012832-9bdb-4133-babb-5873dfa08b0b-config-out\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416611 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416431 2570 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-kube-rbac-proxy\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416611 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416439 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416611 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416447 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/44012832-9bdb-4133-babb-5873dfa08b0b-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416611 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416455 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzcpr\" (UniqueName: \"kubernetes.io/projected/44012832-9bdb-4133-babb-5873dfa08b0b-kube-api-access-bzcpr\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416611 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416464 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416611 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416472 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:26.416611 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:26.416480 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/44012832-9bdb-4133-babb-5873dfa08b0b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:12:27.177676 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.177577 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44012832-9bdb-4133-babb-5873dfa08b0b","Type":"ContainerDied","Data":"c2f7cd4b14f060b5c7705c6890f596edd9eea80e43b8411169c2ffc42192980d"} Jul 07 14:12:27.177676 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.177586 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.178144 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.177690 2570 scope.go:117] "RemoveContainer" containerID="08e99020158c37b0a9a106f03527dbafcb27ae639cb8d9421138f9033561a281" Jul 07 14:12:27.179268 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.178963 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" event={"ID":"1b814eb5-e5bd-44bb-962b-db261918a560","Type":"ContainerStarted","Data":"30a81e46f8ff89395c7aaa0ab12680ccf8a8a64052e5c4c88107026c9b71eada"} Jul 07 14:12:27.186773 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.186756 2570 scope.go:117] "RemoveContainer" containerID="5fb19ae0e1e38915a8284d50aa5c2192394d37f585216ee443680e8788e99416" Jul 07 14:12:27.195132 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.195109 2570 scope.go:117] "RemoveContainer" containerID="80b051d9b8a3c2b66d1c45c84c8599e0b33faca5c14ce93aa4d5b54fa35fb80a" Jul 07 14:12:27.202676 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.202654 2570 scope.go:117] "RemoveContainer" containerID="7234043e80986fe78df52bc6a4775bf2a665473cd4ff22c744e84f125dd13719" Jul 07 14:12:27.210717 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.210695 2570 scope.go:117] "RemoveContainer" containerID="7bf5f6ec598bf3f9c59e18801015c95c76593a14847121497b7f2bcd54b28a6d" Jul 07 14:12:27.219348 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.219324 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:12:27.220894 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.220869 2570 scope.go:117] "RemoveContainer" containerID="8aaca9a0ec17376f95b2103c876d7f148d62c9c683d5d180f0de7e0b279b8894" Jul 07 14:12:27.221301 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.221275 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:12:27.229643 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.229617 2570 scope.go:117] "RemoveContainer" containerID="d5a77d84f8331b438b93b5e35e656df3d814edc2012a68d9912e8133dc2018b9" Jul 07 14:12:27.277132 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277104 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:12:27.277454 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277441 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="kube-rbac-proxy-thanos" Jul 07 14:12:27.277498 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277456 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="kube-rbac-proxy-thanos" Jul 07 14:12:27.277498 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277466 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="thanos-sidecar" Jul 07 14:12:27.277498 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277472 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="thanos-sidecar" Jul 07 14:12:27.277498 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277478 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="kube-rbac-proxy-web" Jul 07 14:12:27.277498 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277484 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="kube-rbac-proxy-web" Jul 07 14:12:27.277498 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277496 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="config-reloader" Jul 07 14:12:27.277730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277502 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="config-reloader" Jul 07 14:12:27.277730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277513 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="init-config-reloader" Jul 07 14:12:27.277730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277519 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="init-config-reloader" Jul 07 14:12:27.277730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277529 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="prometheus" Jul 07 14:12:27.277730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277534 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="prometheus" Jul 07 14:12:27.277730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277556 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="kube-rbac-proxy" Jul 07 14:12:27.277730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277561 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="kube-rbac-proxy" Jul 07 14:12:27.277730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277610 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="config-reloader" Jul 07 14:12:27.277730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277617 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="kube-rbac-proxy-web" Jul 07 14:12:27.277730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277624 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="kube-rbac-proxy" Jul 07 14:12:27.277730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277630 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="kube-rbac-proxy-thanos" Jul 07 14:12:27.277730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277635 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="thanos-sidecar" Jul 07 14:12:27.277730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.277643 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" containerName="prometheus" Jul 07 14:12:27.281677 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.281655 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.295709 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.295685 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 14:12:27.295883 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.295866 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 14:12:27.295956 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.295917 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-uhkojf6b0dtp\"" Jul 07 14:12:27.295956 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.295933 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 14:12:27.296057 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.295961 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 14:12:27.296057 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.295972 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 14:12:27.296057 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.295965 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 14:12:27.296811 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.296794 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-59q9d\"" Jul 07 14:12:27.298536 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.298513 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 14:12:27.298745 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.298730 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 14:12:27.298819 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.298805 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 14:12:27.300447 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.300432 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 14:12:27.300687 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.300673 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 14:12:27.301363 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.301345 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 14:12:27.304181 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.304156 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:12:27.305498 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.305480 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 14:12:27.307901 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.307881 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 14:12:27.326289 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.326265 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.326458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.326297 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.326458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.326318 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.326458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.326344 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.326458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.326418 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.326622 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.326473 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.326622 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.326494 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.326622 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.326512 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/393601fa-066d-4889-acfc-95605eb784ba-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.326622 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.326561 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.326622 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.326616 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/393601fa-066d-4889-acfc-95605eb784ba-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.326759 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.326632 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/393601fa-066d-4889-acfc-95605eb784ba-config-out\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.326759 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.326653 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-config\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.326862 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.326686 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.327160 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.327135 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.327277 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.327187 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.327277 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.327234 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-web-config\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.327277 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.327270 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.327428 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.327296 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.327428 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.327331 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.327428 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.327363 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9kcp\" (UniqueName: \"kubernetes.io/projected/393601fa-066d-4889-acfc-95605eb784ba-kube-api-access-t9kcp\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.385668 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.385633 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44012832-9bdb-4133-babb-5873dfa08b0b" path="/var/lib/kubelet/pods/44012832-9bdb-4133-babb-5873dfa08b0b/volumes" Jul 07 14:12:27.428095 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.427990 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428095 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428028 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428095 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428052 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/393601fa-066d-4889-acfc-95605eb784ba-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428376 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428209 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428376 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428253 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/393601fa-066d-4889-acfc-95605eb784ba-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428376 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428278 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/393601fa-066d-4889-acfc-95605eb784ba-config-out\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428376 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428302 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-config\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428376 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428346 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428378 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428410 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428432 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-web-config\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428433 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/393601fa-066d-4889-acfc-95605eb784ba-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428460 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428484 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428514 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428564 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9kcp\" (UniqueName: \"kubernetes.io/projected/393601fa-066d-4889-acfc-95605eb784ba-kube-api-access-t9kcp\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428617 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428649 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428679 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.428730 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428710 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.429299 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428743 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.429299 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428797 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.429299 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.428998 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.429933 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.429595 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.429933 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.429784 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.431658 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.431631 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.431919 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.431895 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.432167 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.432102 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/393601fa-066d-4889-acfc-95605eb784ba-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.432973 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.432947 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/393601fa-066d-4889-acfc-95605eb784ba-config-out\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.433058 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.432988 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-config\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.433251 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.433226 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/393601fa-066d-4889-acfc-95605eb784ba-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.434089 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.434063 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.434920 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.434854 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.434920 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.434855 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.435073 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.435008 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-web-config\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.435602 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.435578 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.435693 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.435673 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.435981 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.435957 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.436195 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.436175 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/393601fa-066d-4889-acfc-95605eb784ba-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.443041 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.443018 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9kcp\" (UniqueName: \"kubernetes.io/projected/393601fa-066d-4889-acfc-95605eb784ba-kube-api-access-t9kcp\") pod \"prometheus-k8s-0\" (UID: \"393601fa-066d-4889-acfc-95605eb784ba\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.590474 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.590441 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:12:27.769584 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:27.769534 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:12:27.776412 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:12:27.776373 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393601fa_066d_4889_acfc_95605eb784ba.slice/crio-3d947d17d841938d989eaaa89a994000f9f9fcd674d18e19fdce303fe5a7f4d6 WatchSource:0}: Error finding container 3d947d17d841938d989eaaa89a994000f9f9fcd674d18e19fdce303fe5a7f4d6: Status 404 returned error can't find the container with id 3d947d17d841938d989eaaa89a994000f9f9fcd674d18e19fdce303fe5a7f4d6 Jul 07 14:12:28.186633 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:28.186591 2570 generic.go:356] "Generic (PLEG): container finished" podID="393601fa-066d-4889-acfc-95605eb784ba" containerID="00b7f150df35a415fbd6864cc831d78975b293124fc2eb0082d524272128a899" exitCode=0 Jul 07 14:12:28.187066 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:28.186683 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"393601fa-066d-4889-acfc-95605eb784ba","Type":"ContainerDied","Data":"00b7f150df35a415fbd6864cc831d78975b293124fc2eb0082d524272128a899"} Jul 07 14:12:28.187066 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:28.186769 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"393601fa-066d-4889-acfc-95605eb784ba","Type":"ContainerStarted","Data":"3d947d17d841938d989eaaa89a994000f9f9fcd674d18e19fdce303fe5a7f4d6"} Jul 07 14:12:29.194119 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:29.194079 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"393601fa-066d-4889-acfc-95605eb784ba","Type":"ContainerStarted","Data":"b2791d5bc739c5f2f9f13c91a7172c3c97cd3feba344fbc367129d3a3b8c0ff2"} Jul 07 14:12:29.194559 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:29.194165 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"393601fa-066d-4889-acfc-95605eb784ba","Type":"ContainerStarted","Data":"e8f4f901c3f3260e81ee2e42be2ffff93caa2f22c0249f24e32c6092bbd23cc0"} Jul 07 14:12:29.194559 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:29.194213 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"393601fa-066d-4889-acfc-95605eb784ba","Type":"ContainerStarted","Data":"b894b87a4f2a087e724f9a7d68c9ceb1f7573d4dde0d6000ba763c7a30050ba7"} Jul 07 14:12:29.194559 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:29.194252 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"393601fa-066d-4889-acfc-95605eb784ba","Type":"ContainerStarted","Data":"5956ffeb693c26a0b4b949ddefbd30eeb82a86274b7512ecfd9fc21b738e26f0"} Jul 07 14:12:29.194559 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:29.194290 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"393601fa-066d-4889-acfc-95605eb784ba","Type":"ContainerStarted","Data":"afb87ebdffa616bfd099bd144bf963c44f835a3524a9607fbe7971ecf6ec2fb4"} Jul 07 14:12:29.194559 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:29.194326 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"393601fa-066d-4889-acfc-95605eb784ba","Type":"ContainerStarted","Data":"ff0e58e89962de93dc7c5b8f8adb4508f1fc74fd5bb883f4a1122d4ec7d8375c"} Jul 07 14:12:29.196099 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:29.196075 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" event={"ID":"1b814eb5-e5bd-44bb-962b-db261918a560","Type":"ContainerStarted","Data":"439bc32729d011927dcd0f6d4fb16061cbabb7b07cd82f6cea13bcd45f70a33e"} Jul 07 14:12:29.196188 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:29.196124 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" event={"ID":"1b814eb5-e5bd-44bb-962b-db261918a560","Type":"ContainerStarted","Data":"c2a2db3b0eb831330e8cbd07cf34d3b30bb704c02208b1fa290b9865ff73c0c2"} Jul 07 14:12:29.196188 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:29.196150 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" event={"ID":"1b814eb5-e5bd-44bb-962b-db261918a560","Type":"ContainerStarted","Data":"19d96e8ed7482153744f18f3ac82ee51ba73a7dd47750639ca4ea6d82f5088bb"} Jul 07 14:12:29.227574 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:29.227493 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.200864174 podStartE2EDuration="2.227470485s" totalImagesPullingTime="0s" totalInitContainerRuntime="26.606311ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:12:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:12:29.226102854 +0000 UTC m=+158.444784593" watchObservedRunningTime="2026-07-07 14:12:29.227470485 +0000 UTC m=+158.446152226" Jul 07 14:12:29.249847 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:29.249793 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c6cd7f55d-5d6vf" podStartSLOduration=2.040518078 podStartE2EDuration="4.24977734s" totalImagesPullingTime="2.209259262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:12:29.248203228 +0000 UTC m=+158.466884967" watchObservedRunningTime="2026-07-07 14:12:29.24977734 +0000 UTC m=+158.468459079" Jul 07 14:12:32.591265 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:12:32.591220 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:13:27.590684 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:13:27.590646 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:13:27.606638 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:13:27.606611 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:13:28.461363 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:13:28.461312 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:51.210791 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:14:51.210764 2570 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 14:18:02.686519 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:02.686483 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-gh67t"] Jul 07 14:18:02.689745 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:02.689730 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-gh67t" Jul 07 14:18:02.692372 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:02.692344 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 07 14:18:02.692498 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:02.692351 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 07 14:18:02.692498 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:02.692437 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-zrcbk\"" Jul 07 14:18:02.692498 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:02.692436 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 07 14:18:02.699130 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:02.699107 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-gh67t"] Jul 07 14:18:02.778179 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:02.778142 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a96c6bc-8977-4426-b854-2f2351e81bef-model-cache\") pod \"s3-init-gh67t\" (UID: \"1a96c6bc-8977-4426-b854-2f2351e81bef\") " pod="kserve/s3-init-gh67t" Jul 07 14:18:02.778353 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:02.778211 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpmzd\" (UniqueName: \"kubernetes.io/projected/1a96c6bc-8977-4426-b854-2f2351e81bef-kube-api-access-tpmzd\") pod \"s3-init-gh67t\" (UID: \"1a96c6bc-8977-4426-b854-2f2351e81bef\") " pod="kserve/s3-init-gh67t" Jul 07 14:18:02.879176 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:02.879137 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpmzd\" (UniqueName: \"kubernetes.io/projected/1a96c6bc-8977-4426-b854-2f2351e81bef-kube-api-access-tpmzd\") pod \"s3-init-gh67t\" (UID: \"1a96c6bc-8977-4426-b854-2f2351e81bef\") " pod="kserve/s3-init-gh67t" Jul 07 14:18:02.879354 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:02.879207 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a96c6bc-8977-4426-b854-2f2351e81bef-model-cache\") pod \"s3-init-gh67t\" (UID: \"1a96c6bc-8977-4426-b854-2f2351e81bef\") " pod="kserve/s3-init-gh67t" Jul 07 14:18:02.879537 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:02.879521 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a96c6bc-8977-4426-b854-2f2351e81bef-model-cache\") pod \"s3-init-gh67t\" (UID: \"1a96c6bc-8977-4426-b854-2f2351e81bef\") " pod="kserve/s3-init-gh67t" Jul 07 14:18:02.888926 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:02.888900 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpmzd\" (UniqueName: \"kubernetes.io/projected/1a96c6bc-8977-4426-b854-2f2351e81bef-kube-api-access-tpmzd\") pod \"s3-init-gh67t\" (UID: \"1a96c6bc-8977-4426-b854-2f2351e81bef\") " pod="kserve/s3-init-gh67t" Jul 07 14:18:03.021964 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:03.021927 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-gh67t" Jul 07 14:18:03.156968 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:03.156914 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-gh67t"] Jul 07 14:18:03.161234 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:18:03.161206 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a96c6bc_8977_4426_b854_2f2351e81bef.slice/crio-d6bd5978f4e7649f758772870f9786d35187b6d7e9c9382caa66ed60bcb569a2 WatchSource:0}: Error finding container d6bd5978f4e7649f758772870f9786d35187b6d7e9c9382caa66ed60bcb569a2: Status 404 returned error can't find the container with id d6bd5978f4e7649f758772870f9786d35187b6d7e9c9382caa66ed60bcb569a2 Jul 07 14:18:03.163178 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:03.163160 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:18:03.550513 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:03.550478 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-gh67t" event={"ID":"1a96c6bc-8977-4426-b854-2f2351e81bef","Type":"ContainerStarted","Data":"d6bd5978f4e7649f758772870f9786d35187b6d7e9c9382caa66ed60bcb569a2"} Jul 07 14:18:07.573536 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:07.573498 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-gh67t" event={"ID":"1a96c6bc-8977-4426-b854-2f2351e81bef","Type":"ContainerStarted","Data":"4ebd600b1e19fcc05a5f0300ce567b1385d4f50630361db8d27685dd421eacdf"} Jul 07 14:18:09.583766 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:09.583733 2570 generic.go:356] "Generic (PLEG): container finished" podID="1a96c6bc-8977-4426-b854-2f2351e81bef" containerID="4ebd600b1e19fcc05a5f0300ce567b1385d4f50630361db8d27685dd421eacdf" exitCode=0 Jul 07 14:18:09.584165 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:09.583792 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-gh67t" event={"ID":"1a96c6bc-8977-4426-b854-2f2351e81bef","Type":"ContainerDied","Data":"4ebd600b1e19fcc05a5f0300ce567b1385d4f50630361db8d27685dd421eacdf"} Jul 07 14:18:14.610792 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:14.610754 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-gh67t" event={"ID":"1a96c6bc-8977-4426-b854-2f2351e81bef","Type":"ContainerStarted","Data":"add66a6b93573d9e606148321756fe7d79f80a846319ca1ad9da6379c9678c15"} Jul 07 14:18:14.631370 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:18:14.631311 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-gh67t" podStartSLOduration=2.081739888 podStartE2EDuration="12.631294812s" totalImagesPullingTime="8.416763412s" totalInitContainerRuntime="2.132791512s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:18:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:18:14.630012901 +0000 UTC m=+503.848694639" watchObservedRunningTime="2026-07-07 14:18:14.631294812 +0000 UTC m=+503.849976550" Jul 07 14:19:19.886714 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:19.886677 2570 generic.go:356] "Generic (PLEG): container finished" podID="1a96c6bc-8977-4426-b854-2f2351e81bef" containerID="add66a6b93573d9e606148321756fe7d79f80a846319ca1ad9da6379c9678c15" exitCode=0 Jul 07 14:19:19.886714 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:19.886716 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-gh67t" event={"ID":"1a96c6bc-8977-4426-b854-2f2351e81bef","Type":"ContainerDied","Data":"add66a6b93573d9e606148321756fe7d79f80a846319ca1ad9da6379c9678c15"} Jul 07 14:19:21.016370 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:21.016345 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-gh67t" Jul 07 14:19:21.073850 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:21.073823 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a96c6bc-8977-4426-b854-2f2351e81bef-model-cache\") pod \"1a96c6bc-8977-4426-b854-2f2351e81bef\" (UID: \"1a96c6bc-8977-4426-b854-2f2351e81bef\") " Jul 07 14:19:21.074013 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:21.073879 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpmzd\" (UniqueName: \"kubernetes.io/projected/1a96c6bc-8977-4426-b854-2f2351e81bef-kube-api-access-tpmzd\") pod \"1a96c6bc-8977-4426-b854-2f2351e81bef\" (UID: \"1a96c6bc-8977-4426-b854-2f2351e81bef\") " Jul 07 14:19:21.076103 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:21.076076 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a96c6bc-8977-4426-b854-2f2351e81bef-kube-api-access-tpmzd" (OuterVolumeSpecName: "kube-api-access-tpmzd") pod "1a96c6bc-8977-4426-b854-2f2351e81bef" (UID: "1a96c6bc-8977-4426-b854-2f2351e81bef"). InnerVolumeSpecName "kube-api-access-tpmzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:19:21.096149 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:21.096125 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a96c6bc-8977-4426-b854-2f2351e81bef-model-cache" (OuterVolumeSpecName: "model-cache") pod "1a96c6bc-8977-4426-b854-2f2351e81bef" (UID: "1a96c6bc-8977-4426-b854-2f2351e81bef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:19:21.175410 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:21.175325 2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a96c6bc-8977-4426-b854-2f2351e81bef-model-cache\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:19:21.175410 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:21.175354 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpmzd\" (UniqueName: \"kubernetes.io/projected/1a96c6bc-8977-4426-b854-2f2351e81bef-kube-api-access-tpmzd\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:19:21.896153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:21.896120 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-gh67t" event={"ID":"1a96c6bc-8977-4426-b854-2f2351e81bef","Type":"ContainerDied","Data":"d6bd5978f4e7649f758772870f9786d35187b6d7e9c9382caa66ed60bcb569a2"} Jul 07 14:19:21.896153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:21.896148 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-gh67t" Jul 07 14:19:21.896356 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:21.896158 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6bd5978f4e7649f758772870f9786d35187b6d7e9c9382caa66ed60bcb569a2" Jul 07 14:19:59.650266 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.650212 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-m5pqf"] Jul 07 14:19:59.650778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.650614 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a96c6bc-8977-4426-b854-2f2351e81bef" containerName="s3-init" Jul 07 14:19:59.650778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.650633 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a96c6bc-8977-4426-b854-2f2351e81bef" containerName="s3-init" Jul 07 14:19:59.650778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.650657 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a96c6bc-8977-4426-b854-2f2351e81bef" containerName="download-hf-model" Jul 07 14:19:59.650778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.650666 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a96c6bc-8977-4426-b854-2f2351e81bef" containerName="download-hf-model" Jul 07 14:19:59.650778 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.650736 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a96c6bc-8977-4426-b854-2f2351e81bef" containerName="s3-init" Jul 07 14:19:59.653877 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.653861 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-m5pqf" Jul 07 14:19:59.656667 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.656644 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 07 14:19:59.658226 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.658210 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 07 14:19:59.659018 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.659002 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 07 14:19:59.662831 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.662809 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-zrcbk\"" Jul 07 14:19:59.664077 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.664055 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-m5pqf"] Jul 07 14:19:59.705168 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.705133 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfsnq\" (UniqueName: \"kubernetes.io/projected/b0ca200c-e686-46f1-9691-e6bfa16187e3-kube-api-access-wfsnq\") pod \"s3-tls-init-custom-m5pqf\" (UID: \"b0ca200c-e686-46f1-9691-e6bfa16187e3\") " pod="kserve/s3-tls-init-custom-m5pqf" Jul 07 14:19:59.705168 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.705169 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ca200c-e686-46f1-9691-e6bfa16187e3-model-cache\") pod \"s3-tls-init-custom-m5pqf\" (UID: \"b0ca200c-e686-46f1-9691-e6bfa16187e3\") " pod="kserve/s3-tls-init-custom-m5pqf" Jul 07 14:19:59.806023 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.805984 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfsnq\" (UniqueName: \"kubernetes.io/projected/b0ca200c-e686-46f1-9691-e6bfa16187e3-kube-api-access-wfsnq\") pod \"s3-tls-init-custom-m5pqf\" (UID: \"b0ca200c-e686-46f1-9691-e6bfa16187e3\") " pod="kserve/s3-tls-init-custom-m5pqf" Jul 07 14:19:59.806204 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.806031 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ca200c-e686-46f1-9691-e6bfa16187e3-model-cache\") pod \"s3-tls-init-custom-m5pqf\" (UID: \"b0ca200c-e686-46f1-9691-e6bfa16187e3\") " pod="kserve/s3-tls-init-custom-m5pqf" Jul 07 14:19:59.806443 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.806422 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ca200c-e686-46f1-9691-e6bfa16187e3-model-cache\") pod \"s3-tls-init-custom-m5pqf\" (UID: \"b0ca200c-e686-46f1-9691-e6bfa16187e3\") " pod="kserve/s3-tls-init-custom-m5pqf" Jul 07 14:19:59.816590 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.816559 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfsnq\" (UniqueName: \"kubernetes.io/projected/b0ca200c-e686-46f1-9691-e6bfa16187e3-kube-api-access-wfsnq\") pod \"s3-tls-init-custom-m5pqf\" (UID: \"b0ca200c-e686-46f1-9691-e6bfa16187e3\") " pod="kserve/s3-tls-init-custom-m5pqf" Jul 07 14:19:59.969746 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:19:59.969713 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-m5pqf" Jul 07 14:20:00.104391 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:00.104363 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-m5pqf"] Jul 07 14:20:00.107098 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:20:00.107065 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0ca200c_e686_46f1_9691_e6bfa16187e3.slice/crio-4112b73682a0dae70b8dba417e268d7a424dd590d4624253cdf0bd76db242b94 WatchSource:0}: Error finding container 4112b73682a0dae70b8dba417e268d7a424dd590d4624253cdf0bd76db242b94: Status 404 returned error can't find the container with id 4112b73682a0dae70b8dba417e268d7a424dd590d4624253cdf0bd76db242b94 Jul 07 14:20:01.072616 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:01.072575 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-m5pqf" event={"ID":"b0ca200c-e686-46f1-9691-e6bfa16187e3","Type":"ContainerStarted","Data":"4a36e215363f4c1302af32e20acef86c7dde660aaf1d7fb7a5db628ce3328607"} Jul 07 14:20:01.073087 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:01.072625 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-m5pqf" event={"ID":"b0ca200c-e686-46f1-9691-e6bfa16187e3","Type":"ContainerStarted","Data":"4112b73682a0dae70b8dba417e268d7a424dd590d4624253cdf0bd76db242b94"} Jul 07 14:20:02.077869 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:02.077778 2570 generic.go:356] "Generic (PLEG): container finished" podID="b0ca200c-e686-46f1-9691-e6bfa16187e3" containerID="4a36e215363f4c1302af32e20acef86c7dde660aaf1d7fb7a5db628ce3328607" exitCode=0 Jul 07 14:20:02.077869 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:02.077814 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-m5pqf" event={"ID":"b0ca200c-e686-46f1-9691-e6bfa16187e3","Type":"ContainerDied","Data":"4a36e215363f4c1302af32e20acef86c7dde660aaf1d7fb7a5db628ce3328607"} Jul 07 14:20:03.084797 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:03.084751 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-m5pqf" event={"ID":"b0ca200c-e686-46f1-9691-e6bfa16187e3","Type":"ContainerStarted","Data":"7325959fe36ffef0f1bd02a7b1a1cfd9f1ce898d0505d04015f08e4e16b117c8"} Jul 07 14:20:03.108223 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:03.108163 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-custom-m5pqf" podStartSLOduration=2.45392674 podStartE2EDuration="4.108146847s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.654220107s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:20:03.106992302 +0000 UTC m=+612.325674040" watchObservedRunningTime="2026-07-07 14:20:03.108146847 +0000 UTC m=+612.326828586" Jul 07 14:20:08.108934 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:08.108898 2570 generic.go:356] "Generic (PLEG): container finished" podID="b0ca200c-e686-46f1-9691-e6bfa16187e3" containerID="7325959fe36ffef0f1bd02a7b1a1cfd9f1ce898d0505d04015f08e4e16b117c8" exitCode=0 Jul 07 14:20:08.109337 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:08.108966 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-m5pqf" event={"ID":"b0ca200c-e686-46f1-9691-e6bfa16187e3","Type":"ContainerDied","Data":"7325959fe36ffef0f1bd02a7b1a1cfd9f1ce898d0505d04015f08e4e16b117c8"} Jul 07 14:20:09.257456 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:09.257430 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-m5pqf" Jul 07 14:20:09.394018 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:09.393932 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ca200c-e686-46f1-9691-e6bfa16187e3-model-cache\") pod \"b0ca200c-e686-46f1-9691-e6bfa16187e3\" (UID: \"b0ca200c-e686-46f1-9691-e6bfa16187e3\") " Jul 07 14:20:09.394018 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:09.394000 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfsnq\" (UniqueName: \"kubernetes.io/projected/b0ca200c-e686-46f1-9691-e6bfa16187e3-kube-api-access-wfsnq\") pod \"b0ca200c-e686-46f1-9691-e6bfa16187e3\" (UID: \"b0ca200c-e686-46f1-9691-e6bfa16187e3\") " Jul 07 14:20:09.396067 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:09.396037 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ca200c-e686-46f1-9691-e6bfa16187e3-kube-api-access-wfsnq" (OuterVolumeSpecName: "kube-api-access-wfsnq") pod "b0ca200c-e686-46f1-9691-e6bfa16187e3" (UID: "b0ca200c-e686-46f1-9691-e6bfa16187e3"). InnerVolumeSpecName "kube-api-access-wfsnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:20:09.416280 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:09.416242 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ca200c-e686-46f1-9691-e6bfa16187e3-model-cache" (OuterVolumeSpecName: "model-cache") pod "b0ca200c-e686-46f1-9691-e6bfa16187e3" (UID: "b0ca200c-e686-46f1-9691-e6bfa16187e3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:20:09.494701 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:09.494663 2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ca200c-e686-46f1-9691-e6bfa16187e3-model-cache\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:20:09.494701 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:09.494695 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfsnq\" (UniqueName: \"kubernetes.io/projected/b0ca200c-e686-46f1-9691-e6bfa16187e3-kube-api-access-wfsnq\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:20:10.120989 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:10.120947 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-m5pqf" event={"ID":"b0ca200c-e686-46f1-9691-e6bfa16187e3","Type":"ContainerDied","Data":"4112b73682a0dae70b8dba417e268d7a424dd590d4624253cdf0bd76db242b94"} Jul 07 14:20:10.120989 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:10.120973 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-m5pqf" Jul 07 14:20:10.120989 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:10.120986 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4112b73682a0dae70b8dba417e268d7a424dd590d4624253cdf0bd76db242b94" Jul 07 14:20:12.973752 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:12.973670 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-9j7zv"] Jul 07 14:20:12.974194 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:12.974174 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ca200c-e686-46f1-9691-e6bfa16187e3" containerName="download-hf-model" Jul 07 14:20:12.974267 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:12.974194 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ca200c-e686-46f1-9691-e6bfa16187e3" containerName="download-hf-model" Jul 07 14:20:12.974267 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:12.974211 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ca200c-e686-46f1-9691-e6bfa16187e3" containerName="s3-tls-init-custom" Jul 07 14:20:12.974267 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:12.974220 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ca200c-e686-46f1-9691-e6bfa16187e3" containerName="s3-tls-init-custom" Jul 07 14:20:12.974412 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:12.974335 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ca200c-e686-46f1-9691-e6bfa16187e3" containerName="s3-tls-init-custom" Jul 07 14:20:12.978108 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:12.978086 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-9j7zv" Jul 07 14:20:12.980512 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:12.980488 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 07 14:20:12.980704 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:12.980684 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 07 14:20:12.980704 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:12.980692 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 07 14:20:12.981463 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:12.981449 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-zrcbk\"" Jul 07 14:20:12.987189 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:12.987163 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-9j7zv"] Jul 07 14:20:13.128532 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:13.128501 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e01950df-6880-41a3-9da0-4452c9fed46a-model-cache\") pod \"s3-tls-init-serving-9j7zv\" (UID: \"e01950df-6880-41a3-9da0-4452c9fed46a\") " pod="kserve/s3-tls-init-serving-9j7zv" Jul 07 14:20:13.128719 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:13.128618 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5tdw\" (UniqueName: \"kubernetes.io/projected/e01950df-6880-41a3-9da0-4452c9fed46a-kube-api-access-p5tdw\") pod \"s3-tls-init-serving-9j7zv\" (UID: \"e01950df-6880-41a3-9da0-4452c9fed46a\") " pod="kserve/s3-tls-init-serving-9j7zv" Jul 07 14:20:13.229410 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:13.229315 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5tdw\" (UniqueName: \"kubernetes.io/projected/e01950df-6880-41a3-9da0-4452c9fed46a-kube-api-access-p5tdw\") pod \"s3-tls-init-serving-9j7zv\" (UID: \"e01950df-6880-41a3-9da0-4452c9fed46a\") " pod="kserve/s3-tls-init-serving-9j7zv" Jul 07 14:20:13.229410 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:13.229382 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e01950df-6880-41a3-9da0-4452c9fed46a-model-cache\") pod \"s3-tls-init-serving-9j7zv\" (UID: \"e01950df-6880-41a3-9da0-4452c9fed46a\") " pod="kserve/s3-tls-init-serving-9j7zv" Jul 07 14:20:13.229836 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:13.229814 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e01950df-6880-41a3-9da0-4452c9fed46a-model-cache\") pod \"s3-tls-init-serving-9j7zv\" (UID: \"e01950df-6880-41a3-9da0-4452c9fed46a\") " pod="kserve/s3-tls-init-serving-9j7zv" Jul 07 14:20:13.242326 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:13.242304 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5tdw\" (UniqueName: \"kubernetes.io/projected/e01950df-6880-41a3-9da0-4452c9fed46a-kube-api-access-p5tdw\") pod \"s3-tls-init-serving-9j7zv\" (UID: \"e01950df-6880-41a3-9da0-4452c9fed46a\") " pod="kserve/s3-tls-init-serving-9j7zv" Jul 07 14:20:13.296076 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:13.296041 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-9j7zv" Jul 07 14:20:13.432979 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:13.432957 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-9j7zv"] Jul 07 14:20:13.435334 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:20:13.435301 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode01950df_6880_41a3_9da0_4452c9fed46a.slice/crio-7a690571367f21427fccad8dfd1887724c35b3ce31d2232e2ad0473a1b52afba WatchSource:0}: Error finding container 7a690571367f21427fccad8dfd1887724c35b3ce31d2232e2ad0473a1b52afba: Status 404 returned error can't find the container with id 7a690571367f21427fccad8dfd1887724c35b3ce31d2232e2ad0473a1b52afba Jul 07 14:20:14.139841 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:14.139808 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-9j7zv" event={"ID":"e01950df-6880-41a3-9da0-4452c9fed46a","Type":"ContainerStarted","Data":"47d9e63a14b273b5d618c23c9ab4f2d73731f673afa4e8e1841432efad6f16ed"} Jul 07 14:20:14.139841 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:14.139848 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-9j7zv" event={"ID":"e01950df-6880-41a3-9da0-4452c9fed46a","Type":"ContainerStarted","Data":"7a690571367f21427fccad8dfd1887724c35b3ce31d2232e2ad0473a1b52afba"} Jul 07 14:20:15.145885 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:15.145845 2570 generic.go:356] "Generic (PLEG): container finished" podID="e01950df-6880-41a3-9da0-4452c9fed46a" containerID="47d9e63a14b273b5d618c23c9ab4f2d73731f673afa4e8e1841432efad6f16ed" exitCode=0 Jul 07 14:20:15.145885 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:15.145884 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-9j7zv" event={"ID":"e01950df-6880-41a3-9da0-4452c9fed46a","Type":"ContainerDied","Data":"47d9e63a14b273b5d618c23c9ab4f2d73731f673afa4e8e1841432efad6f16ed"} Jul 07 14:20:16.152844 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:16.152808 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-9j7zv" event={"ID":"e01950df-6880-41a3-9da0-4452c9fed46a","Type":"ContainerStarted","Data":"45fad92a928038626238c1ad40a000b37b995544f15d98470bc528b9fbfda5cb"} Jul 07 14:20:16.176268 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:16.176203 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-serving-9j7zv" podStartSLOduration=2.640619887 podStartE2EDuration="4.176180757s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.53556087s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:20:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:20:16.172704656 +0000 UTC m=+625.391386395" watchObservedRunningTime="2026-07-07 14:20:16.176180757 +0000 UTC m=+625.394862500" Jul 07 14:20:20.171901 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:20.171862 2570 generic.go:356] "Generic (PLEG): container finished" podID="e01950df-6880-41a3-9da0-4452c9fed46a" containerID="45fad92a928038626238c1ad40a000b37b995544f15d98470bc528b9fbfda5cb" exitCode=0 Jul 07 14:20:20.172278 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:20.171931 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-9j7zv" event={"ID":"e01950df-6880-41a3-9da0-4452c9fed46a","Type":"ContainerDied","Data":"45fad92a928038626238c1ad40a000b37b995544f15d98470bc528b9fbfda5cb"} Jul 07 14:20:21.322715 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:21.322690 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-9j7zv" Jul 07 14:20:21.510315 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:21.510284 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e01950df-6880-41a3-9da0-4452c9fed46a-model-cache\") pod \"e01950df-6880-41a3-9da0-4452c9fed46a\" (UID: \"e01950df-6880-41a3-9da0-4452c9fed46a\") " Jul 07 14:20:21.510469 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:21.510337 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5tdw\" (UniqueName: \"kubernetes.io/projected/e01950df-6880-41a3-9da0-4452c9fed46a-kube-api-access-p5tdw\") pod \"e01950df-6880-41a3-9da0-4452c9fed46a\" (UID: \"e01950df-6880-41a3-9da0-4452c9fed46a\") " Jul 07 14:20:21.512450 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:21.512421 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e01950df-6880-41a3-9da0-4452c9fed46a-kube-api-access-p5tdw" (OuterVolumeSpecName: "kube-api-access-p5tdw") pod "e01950df-6880-41a3-9da0-4452c9fed46a" (UID: "e01950df-6880-41a3-9da0-4452c9fed46a"). InnerVolumeSpecName "kube-api-access-p5tdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:20:21.532664 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:21.532632 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01950df-6880-41a3-9da0-4452c9fed46a-model-cache" (OuterVolumeSpecName: "model-cache") pod "e01950df-6880-41a3-9da0-4452c9fed46a" (UID: "e01950df-6880-41a3-9da0-4452c9fed46a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:20:21.611157 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:21.611124 2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e01950df-6880-41a3-9da0-4452c9fed46a-model-cache\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:20:21.611157 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:21.611154 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5tdw\" (UniqueName: \"kubernetes.io/projected/e01950df-6880-41a3-9da0-4452c9fed46a-kube-api-access-p5tdw\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:20:22.182348 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:22.182318 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-9j7zv" Jul 07 14:20:22.182490 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:22.182342 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-9j7zv" event={"ID":"e01950df-6880-41a3-9da0-4452c9fed46a","Type":"ContainerDied","Data":"7a690571367f21427fccad8dfd1887724c35b3ce31d2232e2ad0473a1b52afba"} Jul 07 14:20:22.182490 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:20:22.182381 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a690571367f21427fccad8dfd1887724c35b3ce31d2232e2ad0473a1b52afba" Jul 07 14:36:08.971793 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:08.971760 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hhjqp/must-gather-dmh9b"] Jul 07 14:36:08.972249 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:08.972087 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e01950df-6880-41a3-9da0-4452c9fed46a" containerName="s3-tls-init-serving" Jul 07 14:36:08.972249 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:08.972097 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e01950df-6880-41a3-9da0-4452c9fed46a" containerName="s3-tls-init-serving" Jul 07 14:36:08.972249 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:08.972111 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e01950df-6880-41a3-9da0-4452c9fed46a" containerName="download-hf-model" Jul 07 14:36:08.972249 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:08.972116 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e01950df-6880-41a3-9da0-4452c9fed46a" containerName="download-hf-model" Jul 07 14:36:08.972249 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:08.972176 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e01950df-6880-41a3-9da0-4452c9fed46a" containerName="s3-tls-init-serving" Jul 07 14:36:08.975096 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:08.975078 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hhjqp/must-gather-dmh9b" Jul 07 14:36:08.977810 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:08.977780 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hhjqp\"/\"kube-root-ca.crt\"" Jul 07 14:36:08.977810 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:08.977790 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hhjqp\"/\"openshift-service-ca.crt\"" Jul 07 14:36:08.977963 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:08.977815 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hhjqp\"/\"default-dockercfg-zm2qn\"" Jul 07 14:36:08.987579 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:08.987557 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hhjqp/must-gather-dmh9b"] Jul 07 14:36:09.070196 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:09.070169 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-226zs\" (UniqueName: \"kubernetes.io/projected/f37e93da-5e79-4f39-834f-36bbac5f575f-kube-api-access-226zs\") pod \"must-gather-dmh9b\" (UID: \"f37e93da-5e79-4f39-834f-36bbac5f575f\") " pod="openshift-must-gather-hhjqp/must-gather-dmh9b" Jul 07 14:36:09.070196 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:09.070204 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f37e93da-5e79-4f39-834f-36bbac5f575f-must-gather-output\") pod \"must-gather-dmh9b\" (UID: \"f37e93da-5e79-4f39-834f-36bbac5f575f\") " pod="openshift-must-gather-hhjqp/must-gather-dmh9b" Jul 07 14:36:09.170898 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:09.170863 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f37e93da-5e79-4f39-834f-36bbac5f575f-must-gather-output\") pod \"must-gather-dmh9b\" (UID: \"f37e93da-5e79-4f39-834f-36bbac5f575f\") " pod="openshift-must-gather-hhjqp/must-gather-dmh9b" Jul 07 14:36:09.171099 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:09.170959 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-226zs\" (UniqueName: \"kubernetes.io/projected/f37e93da-5e79-4f39-834f-36bbac5f575f-kube-api-access-226zs\") pod \"must-gather-dmh9b\" (UID: \"f37e93da-5e79-4f39-834f-36bbac5f575f\") " pod="openshift-must-gather-hhjqp/must-gather-dmh9b" Jul 07 14:36:09.171265 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:09.171242 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f37e93da-5e79-4f39-834f-36bbac5f575f-must-gather-output\") pod \"must-gather-dmh9b\" (UID: \"f37e93da-5e79-4f39-834f-36bbac5f575f\") " pod="openshift-must-gather-hhjqp/must-gather-dmh9b" Jul 07 14:36:09.180885 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:09.180855 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-226zs\" (UniqueName: \"kubernetes.io/projected/f37e93da-5e79-4f39-834f-36bbac5f575f-kube-api-access-226zs\") pod \"must-gather-dmh9b\" (UID: \"f37e93da-5e79-4f39-834f-36bbac5f575f\") " pod="openshift-must-gather-hhjqp/must-gather-dmh9b" Jul 07 14:36:09.293791 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:09.293702 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hhjqp/must-gather-dmh9b" Jul 07 14:36:09.426057 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:09.426026 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hhjqp/must-gather-dmh9b"] Jul 07 14:36:09.429036 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:36:09.429003 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf37e93da_5e79_4f39_834f_36bbac5f575f.slice/crio-c77d87a86897e7bf33e17a698d596a783320662959a1dfbf36f7edb2fd8e9d8c WatchSource:0}: Error finding container c77d87a86897e7bf33e17a698d596a783320662959a1dfbf36f7edb2fd8e9d8c: Status 404 returned error can't find the container with id c77d87a86897e7bf33e17a698d596a783320662959a1dfbf36f7edb2fd8e9d8c Jul 07 14:36:09.430849 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:09.430833 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:36:10.148256 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:10.148211 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hhjqp/must-gather-dmh9b" event={"ID":"f37e93da-5e79-4f39-834f-36bbac5f575f","Type":"ContainerStarted","Data":"c77d87a86897e7bf33e17a698d596a783320662959a1dfbf36f7edb2fd8e9d8c"} Jul 07 14:36:16.180872 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:16.180831 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hhjqp/must-gather-dmh9b" event={"ID":"f37e93da-5e79-4f39-834f-36bbac5f575f","Type":"ContainerStarted","Data":"49021f0ba7500dd0d5705655eb2eb9e171ac8340ede8e21737d21cf203ceb164"} Jul 07 14:36:16.180872 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:16.180874 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hhjqp/must-gather-dmh9b" event={"ID":"f37e93da-5e79-4f39-834f-36bbac5f575f","Type":"ContainerStarted","Data":"cd4dde375d4c9e3b13c28a385136fecb552acf3d2eec8b7ff214391c9781c7ae"} Jul 07 14:36:16.203147 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:16.203089 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hhjqp/must-gather-dmh9b" podStartSLOduration=2.041622817 podStartE2EDuration="8.203067946s" totalImagesPullingTime="6.161445129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:16.201411371 +0000 UTC m=+1585.420093113" watchObservedRunningTime="2026-07-07 14:36:16.203067946 +0000 UTC m=+1585.421749687" Jul 07 14:36:37.283504 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:37.283472 2570 generic.go:356] "Generic (PLEG): container finished" podID="f37e93da-5e79-4f39-834f-36bbac5f575f" containerID="cd4dde375d4c9e3b13c28a385136fecb552acf3d2eec8b7ff214391c9781c7ae" exitCode=0 Jul 07 14:36:37.283912 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:37.283567 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hhjqp/must-gather-dmh9b" event={"ID":"f37e93da-5e79-4f39-834f-36bbac5f575f","Type":"ContainerDied","Data":"cd4dde375d4c9e3b13c28a385136fecb552acf3d2eec8b7ff214391c9781c7ae"} Jul 07 14:36:37.283912 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:37.283893 2570 scope.go:117] "RemoveContainer" containerID="cd4dde375d4c9e3b13c28a385136fecb552acf3d2eec8b7ff214391c9781c7ae" Jul 07 14:36:38.226989 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:38.226955 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-hhjqp_must-gather-dmh9b_f37e93da-5e79-4f39-834f-36bbac5f575f/gather/0.log" Jul 07 14:36:38.887669 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:38.887637 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z7x97/must-gather-c2s2z"] Jul 07 14:36:38.890531 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:38.890509 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z7x97/must-gather-c2s2z" Jul 07 14:36:38.893251 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:38.893231 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z7x97\"/\"openshift-service-ca.crt\"" Jul 07 14:36:38.893356 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:38.893261 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z7x97\"/\"kube-root-ca.crt\"" Jul 07 14:36:38.894311 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:38.894289 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z7x97\"/\"default-dockercfg-4m829\"" Jul 07 14:36:38.906151 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:38.906127 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z7x97/must-gather-c2s2z"] Jul 07 14:36:38.940768 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:38.940744 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2178522d-1606-453c-8981-3ee9f4495fe1-must-gather-output\") pod \"must-gather-c2s2z\" (UID: \"2178522d-1606-453c-8981-3ee9f4495fe1\") " pod="openshift-must-gather-z7x97/must-gather-c2s2z" Jul 07 14:36:38.940887 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:38.940819 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb55c\" (UniqueName: \"kubernetes.io/projected/2178522d-1606-453c-8981-3ee9f4495fe1-kube-api-access-vb55c\") pod \"must-gather-c2s2z\" (UID: \"2178522d-1606-453c-8981-3ee9f4495fe1\") " pod="openshift-must-gather-z7x97/must-gather-c2s2z" Jul 07 14:36:39.041702 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:39.041668 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb55c\" (UniqueName: \"kubernetes.io/projected/2178522d-1606-453c-8981-3ee9f4495fe1-kube-api-access-vb55c\") pod \"must-gather-c2s2z\" (UID: \"2178522d-1606-453c-8981-3ee9f4495fe1\") " pod="openshift-must-gather-z7x97/must-gather-c2s2z" Jul 07 14:36:39.041885 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:39.041742 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2178522d-1606-453c-8981-3ee9f4495fe1-must-gather-output\") pod \"must-gather-c2s2z\" (UID: \"2178522d-1606-453c-8981-3ee9f4495fe1\") " pod="openshift-must-gather-z7x97/must-gather-c2s2z" Jul 07 14:36:39.042085 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:39.042067 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2178522d-1606-453c-8981-3ee9f4495fe1-must-gather-output\") pod \"must-gather-c2s2z\" (UID: \"2178522d-1606-453c-8981-3ee9f4495fe1\") " pod="openshift-must-gather-z7x97/must-gather-c2s2z" Jul 07 14:36:39.053402 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:39.053376 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb55c\" (UniqueName: \"kubernetes.io/projected/2178522d-1606-453c-8981-3ee9f4495fe1-kube-api-access-vb55c\") pod \"must-gather-c2s2z\" (UID: \"2178522d-1606-453c-8981-3ee9f4495fe1\") " pod="openshift-must-gather-z7x97/must-gather-c2s2z" Jul 07 14:36:39.199959 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:39.199870 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z7x97/must-gather-c2s2z" Jul 07 14:36:39.334042 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:39.334016 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z7x97/must-gather-c2s2z"] Jul 07 14:36:39.336651 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:36:39.336621 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2178522d_1606_453c_8981_3ee9f4495fe1.slice/crio-b76288f56ae618f76e183b8c5ff410f894d09cbee4fe85271169e7d07b8da808 WatchSource:0}: Error finding container b76288f56ae618f76e183b8c5ff410f894d09cbee4fe85271169e7d07b8da808: Status 404 returned error can't find the container with id b76288f56ae618f76e183b8c5ff410f894d09cbee4fe85271169e7d07b8da808 Jul 07 14:36:40.302610 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:40.302568 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z7x97/must-gather-c2s2z" event={"ID":"2178522d-1606-453c-8981-3ee9f4495fe1","Type":"ContainerStarted","Data":"7d4d76ac3a096b8563a60fc23f4012ab23c3f5b34b975807ae59df10967b2c46"} Jul 07 14:36:40.303153 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:40.303110 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z7x97/must-gather-c2s2z" event={"ID":"2178522d-1606-453c-8981-3ee9f4495fe1","Type":"ContainerStarted","Data":"b76288f56ae618f76e183b8c5ff410f894d09cbee4fe85271169e7d07b8da808"} Jul 07 14:36:41.310788 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:41.310749 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z7x97/must-gather-c2s2z" event={"ID":"2178522d-1606-453c-8981-3ee9f4495fe1","Type":"ContainerStarted","Data":"08bbdd9cff0aab85fe2088b6c4873b74fdaad463d4b41a634256bf930858c179"} Jul 07 14:36:41.337486 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:41.337436 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z7x97/must-gather-c2s2z" podStartSLOduration=2.507838881 podStartE2EDuration="3.337411251s" totalImagesPullingTime="829.57237ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:41.335117501 +0000 UTC m=+1610.553799243" watchObservedRunningTime="2026-07-07 14:36:41.337411251 +0000 UTC m=+1610.556092990" Jul 07 14:36:41.942765 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:41.942738 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kk77l_dcbf3f4e-4994-44f6-a479-5eecb805c29e/global-pull-secret-syncer/0.log" Jul 07 14:36:42.219506 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:42.219479 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h7cnd_0d416559-3214-42d7-aefb-b7e5c3b223e2/konnectivity-agent/0.log" Jul 07 14:36:42.377887 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:42.377859 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-42.ec2.internal_751654497f7f64d912e56b96725ec553/haproxy/0.log" Jul 07 14:36:43.683699 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:43.683653 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-hhjqp/must-gather-dmh9b"] Jul 07 14:36:43.684143 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:43.683888 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-hhjqp/must-gather-dmh9b" podUID="f37e93da-5e79-4f39-834f-36bbac5f575f" containerName="copy" containerID="cri-o://49021f0ba7500dd0d5705655eb2eb9e171ac8340ede8e21737d21cf203ceb164" gracePeriod=2 Jul 07 14:36:43.685468 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:43.685444 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-hhjqp/must-gather-dmh9b"] Jul 07 14:36:43.686937 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:36:43.686909 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dmh9b\" is forbidden: User \"system:node:ip-10-0-138-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-hhjqp\": no relationship found between node 'ip-10-0-138-42.ec2.internal' and this object" podUID="f37e93da-5e79-4f39-834f-36bbac5f575f" pod="openshift-must-gather-hhjqp/must-gather-dmh9b" Jul 07 14:36:44.073042 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.072941 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-hhjqp_must-gather-dmh9b_f37e93da-5e79-4f39-834f-36bbac5f575f/copy/0.log" Jul 07 14:36:44.076512 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.076224 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hhjqp/must-gather-dmh9b" Jul 07 14:36:44.079152 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:36:44.078335 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dmh9b\" is forbidden: User \"system:node:ip-10-0-138-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-hhjqp\": no relationship found between node 'ip-10-0-138-42.ec2.internal' and this object" podUID="f37e93da-5e79-4f39-834f-36bbac5f575f" pod="openshift-must-gather-hhjqp/must-gather-dmh9b" Jul 07 14:36:44.191826 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.189943 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-226zs\" (UniqueName: \"kubernetes.io/projected/f37e93da-5e79-4f39-834f-36bbac5f575f-kube-api-access-226zs\") pod \"f37e93da-5e79-4f39-834f-36bbac5f575f\" (UID: \"f37e93da-5e79-4f39-834f-36bbac5f575f\") " Jul 07 14:36:44.191826 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.190039 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f37e93da-5e79-4f39-834f-36bbac5f575f-must-gather-output\") pod \"f37e93da-5e79-4f39-834f-36bbac5f575f\" (UID: \"f37e93da-5e79-4f39-834f-36bbac5f575f\") " Jul 07 14:36:44.191826 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.191472 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f37e93da-5e79-4f39-834f-36bbac5f575f-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "f37e93da-5e79-4f39-834f-36bbac5f575f" (UID: "f37e93da-5e79-4f39-834f-36bbac5f575f"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:36:44.204036 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.203968 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f37e93da-5e79-4f39-834f-36bbac5f575f-kube-api-access-226zs" (OuterVolumeSpecName: "kube-api-access-226zs") pod "f37e93da-5e79-4f39-834f-36bbac5f575f" (UID: "f37e93da-5e79-4f39-834f-36bbac5f575f"). InnerVolumeSpecName "kube-api-access-226zs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:36:44.292016 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.291882 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-226zs\" (UniqueName: \"kubernetes.io/projected/f37e93da-5e79-4f39-834f-36bbac5f575f-kube-api-access-226zs\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:36:44.292016 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.291923 2570 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f37e93da-5e79-4f39-834f-36bbac5f575f-must-gather-output\") on node \"ip-10-0-138-42.ec2.internal\" DevicePath \"\"" Jul 07 14:36:44.332289 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.332171 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-hhjqp_must-gather-dmh9b_f37e93da-5e79-4f39-834f-36bbac5f575f/copy/0.log" Jul 07 14:36:44.336588 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.332906 2570 generic.go:356] "Generic (PLEG): container finished" podID="f37e93da-5e79-4f39-834f-36bbac5f575f" containerID="49021f0ba7500dd0d5705655eb2eb9e171ac8340ede8e21737d21cf203ceb164" exitCode=143 Jul 07 14:36:44.336588 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.333052 2570 scope.go:117] "RemoveContainer" containerID="49021f0ba7500dd0d5705655eb2eb9e171ac8340ede8e21737d21cf203ceb164" Jul 07 14:36:44.336588 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.333211 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hhjqp/must-gather-dmh9b" Jul 07 14:36:44.341301 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:36:44.341263 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dmh9b\" is forbidden: User \"system:node:ip-10-0-138-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-hhjqp\": no relationship found between node 'ip-10-0-138-42.ec2.internal' and this object" podUID="f37e93da-5e79-4f39-834f-36bbac5f575f" pod="openshift-must-gather-hhjqp/must-gather-dmh9b" Jul 07 14:36:44.358588 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:36:44.358464 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dmh9b\" is forbidden: User \"system:node:ip-10-0-138-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-hhjqp\": no relationship found between node 'ip-10-0-138-42.ec2.internal' and this object" podUID="f37e93da-5e79-4f39-834f-36bbac5f575f" pod="openshift-must-gather-hhjqp/must-gather-dmh9b" Jul 07 14:36:44.373458 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.373424 2570 scope.go:117] "RemoveContainer" containerID="cd4dde375d4c9e3b13c28a385136fecb552acf3d2eec8b7ff214391c9781c7ae" Jul 07 14:36:44.404374 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.404337 2570 scope.go:117] "RemoveContainer" containerID="49021f0ba7500dd0d5705655eb2eb9e171ac8340ede8e21737d21cf203ceb164" Jul 07 14:36:44.407843 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:36:44.407808 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49021f0ba7500dd0d5705655eb2eb9e171ac8340ede8e21737d21cf203ceb164\": container with ID starting with 49021f0ba7500dd0d5705655eb2eb9e171ac8340ede8e21737d21cf203ceb164 not found: ID does not exist" containerID="49021f0ba7500dd0d5705655eb2eb9e171ac8340ede8e21737d21cf203ceb164" Jul 07 14:36:44.407972 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.407856 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49021f0ba7500dd0d5705655eb2eb9e171ac8340ede8e21737d21cf203ceb164"} err="failed to get container status \"49021f0ba7500dd0d5705655eb2eb9e171ac8340ede8e21737d21cf203ceb164\": rpc error: code = NotFound desc = could not find container \"49021f0ba7500dd0d5705655eb2eb9e171ac8340ede8e21737d21cf203ceb164\": container with ID starting with 49021f0ba7500dd0d5705655eb2eb9e171ac8340ede8e21737d21cf203ceb164 not found: ID does not exist" Jul 07 14:36:44.407972 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.407883 2570 scope.go:117] "RemoveContainer" containerID="cd4dde375d4c9e3b13c28a385136fecb552acf3d2eec8b7ff214391c9781c7ae" Jul 07 14:36:44.408206 ip-10-0-138-42 kubenswrapper[2570]: E0707 14:36:44.408186 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd4dde375d4c9e3b13c28a385136fecb552acf3d2eec8b7ff214391c9781c7ae\": container with ID starting with cd4dde375d4c9e3b13c28a385136fecb552acf3d2eec8b7ff214391c9781c7ae not found: ID does not exist" containerID="cd4dde375d4c9e3b13c28a385136fecb552acf3d2eec8b7ff214391c9781c7ae" Jul 07 14:36:44.408329 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:44.408307 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd4dde375d4c9e3b13c28a385136fecb552acf3d2eec8b7ff214391c9781c7ae"} err="failed to get container status \"cd4dde375d4c9e3b13c28a385136fecb552acf3d2eec8b7ff214391c9781c7ae\": rpc error: code = NotFound desc = could not find container \"cd4dde375d4c9e3b13c28a385136fecb552acf3d2eec8b7ff214391c9781c7ae\": container with ID starting with cd4dde375d4c9e3b13c28a385136fecb552acf3d2eec8b7ff214391c9781c7ae not found: ID does not exist" Jul 07 14:36:45.385756 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:45.385721 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f37e93da-5e79-4f39-834f-36bbac5f575f" path="/var/lib/kubelet/pods/f37e93da-5e79-4f39-834f-36bbac5f575f/volumes" Jul 07 14:36:46.586645 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:46.586619 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52320b0f-e808-4ff5-bb97-624e5670a604/alertmanager/0.log" Jul 07 14:36:46.652350 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:46.652323 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52320b0f-e808-4ff5-bb97-624e5670a604/config-reloader/0.log" Jul 07 14:36:46.706915 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:46.706834 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52320b0f-e808-4ff5-bb97-624e5670a604/kube-rbac-proxy-web/0.log" Jul 07 14:36:46.750650 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:46.750629 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52320b0f-e808-4ff5-bb97-624e5670a604/kube-rbac-proxy/0.log" Jul 07 14:36:46.797989 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:46.797953 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52320b0f-e808-4ff5-bb97-624e5670a604/kube-rbac-proxy-metric/0.log" Jul 07 14:36:46.846929 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:46.846855 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52320b0f-e808-4ff5-bb97-624e5670a604/prom-label-proxy/0.log" Jul 07 14:36:46.895755 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:46.895731 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_52320b0f-e808-4ff5-bb97-624e5670a604/init-config-reloader/0.log" Jul 07 14:36:47.006126 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:47.006094 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-rq7nl_50cb0949-74af-4386-95e3-681c2c379b15/kube-state-metrics/0.log" Jul 07 14:36:47.093478 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:47.093445 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-rq7nl_50cb0949-74af-4386-95e3-681c2c379b15/kube-rbac-proxy-main/0.log" Jul 07 14:36:47.129310 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:47.129238 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-rq7nl_50cb0949-74af-4386-95e3-681c2c379b15/kube-rbac-proxy-self/0.log" Jul 07 14:36:47.186622 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:47.186581 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-859664664b-cqsgx_bb5442dc-f0df-4427-b97b-f0a331303eca/metrics-server/0.log" Jul 07 14:36:47.245370 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:47.245326 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-lbz9n_df002840-32e8-49b4-a487-83cbfac99ab2/monitoring-plugin/0.log" Jul 07 14:36:47.805900 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:47.805820 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wlkfd_585e14f6-c40c-4fa1-9b56-bb3a17e6bd11/node-exporter/0.log" Jul 07 14:36:47.849378 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:47.849347 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wlkfd_585e14f6-c40c-4fa1-9b56-bb3a17e6bd11/kube-rbac-proxy/0.log" Jul 07 14:36:47.926056 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:47.926025 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wlkfd_585e14f6-c40c-4fa1-9b56-bb3a17e6bd11/init-textfile/0.log" Jul 07 14:36:48.003948 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.003916 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-dgxnb_c3222ded-830b-4a91-ab23-bd3d71c998fb/kube-rbac-proxy-main/0.log" Jul 07 14:36:48.112613 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.112519 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-dgxnb_c3222ded-830b-4a91-ab23-bd3d71c998fb/kube-rbac-proxy-self/0.log" Jul 07 14:36:48.192241 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.192207 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-dgxnb_c3222ded-830b-4a91-ab23-bd3d71c998fb/openshift-state-metrics/0.log" Jul 07 14:36:48.270614 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.270581 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_393601fa-066d-4889-acfc-95605eb784ba/prometheus/0.log" Jul 07 14:36:48.311489 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.311459 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_393601fa-066d-4889-acfc-95605eb784ba/config-reloader/0.log" Jul 07 14:36:48.365632 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.365565 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_393601fa-066d-4889-acfc-95605eb784ba/thanos-sidecar/0.log" Jul 07 14:36:48.420947 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.420906 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_393601fa-066d-4889-acfc-95605eb784ba/kube-rbac-proxy-web/0.log" Jul 07 14:36:48.458870 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.458844 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_393601fa-066d-4889-acfc-95605eb784ba/kube-rbac-proxy/0.log" Jul 07 14:36:48.499300 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.499273 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_393601fa-066d-4889-acfc-95605eb784ba/kube-rbac-proxy-thanos/0.log" Jul 07 14:36:48.548163 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.548136 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_393601fa-066d-4889-acfc-95605eb784ba/init-config-reloader/0.log" Jul 07 14:36:48.591901 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.591871 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-qzrj7_68b3270e-fc59-4d1e-9c22-dbc4d5960f82/prometheus-operator/0.log" Jul 07 14:36:48.646428 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.646347 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-qzrj7_68b3270e-fc59-4d1e-9c22-dbc4d5960f82/kube-rbac-proxy/0.log" Jul 07 14:36:48.705822 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.705791 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-2cf8g_d86488e8-f762-4b0a-a60a-0fb101cbf94a/prometheus-operator-admission-webhook/0.log" Jul 07 14:36:48.761736 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.761711 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c6cd7f55d-5d6vf_1b814eb5-e5bd-44bb-962b-db261918a560/telemeter-client/0.log" Jul 07 14:36:48.829211 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.829185 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c6cd7f55d-5d6vf_1b814eb5-e5bd-44bb-962b-db261918a560/reload/0.log" Jul 07 14:36:48.918089 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:48.918015 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c6cd7f55d-5d6vf_1b814eb5-e5bd-44bb-962b-db261918a560/kube-rbac-proxy/0.log" Jul 07 14:36:49.006948 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:49.006920 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66dcd899c7-rdxsk_ed4623a1-c6e6-4b65-90ea-3ccc63612c1b/thanos-query/0.log" Jul 07 14:36:49.086384 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:49.086359 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66dcd899c7-rdxsk_ed4623a1-c6e6-4b65-90ea-3ccc63612c1b/kube-rbac-proxy-web/0.log" Jul 07 14:36:49.154493 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:49.154462 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66dcd899c7-rdxsk_ed4623a1-c6e6-4b65-90ea-3ccc63612c1b/kube-rbac-proxy/0.log" Jul 07 14:36:49.202627 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:49.202520 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66dcd899c7-rdxsk_ed4623a1-c6e6-4b65-90ea-3ccc63612c1b/prom-label-proxy/0.log" Jul 07 14:36:49.241877 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:49.241849 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66dcd899c7-rdxsk_ed4623a1-c6e6-4b65-90ea-3ccc63612c1b/kube-rbac-proxy-rules/0.log" Jul 07 14:36:49.314408 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:49.314372 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66dcd899c7-rdxsk_ed4623a1-c6e6-4b65-90ea-3ccc63612c1b/kube-rbac-proxy-metrics/0.log" Jul 07 14:36:50.246048 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.246013 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq"] Jul 07 14:36:50.246650 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.246515 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f37e93da-5e79-4f39-834f-36bbac5f575f" containerName="gather" Jul 07 14:36:50.246650 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.246531 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f37e93da-5e79-4f39-834f-36bbac5f575f" containerName="gather" Jul 07 14:36:50.246650 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.246572 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f37e93da-5e79-4f39-834f-36bbac5f575f" containerName="copy" Jul 07 14:36:50.246650 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.246582 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f37e93da-5e79-4f39-834f-36bbac5f575f" containerName="copy" Jul 07 14:36:50.246892 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.246690 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f37e93da-5e79-4f39-834f-36bbac5f575f" containerName="copy" Jul 07 14:36:50.246892 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.246704 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f37e93da-5e79-4f39-834f-36bbac5f575f" containerName="gather" Jul 07 14:36:50.250580 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.250558 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.268842 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.268814 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq"] Jul 07 14:36:50.364030 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.363998 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7f21658b-f48e-4863-adec-cd499dca1206-proc\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.364205 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.364053 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f21658b-f48e-4863-adec-cd499dca1206-lib-modules\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.364205 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.364102 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xhsf\" (UniqueName: \"kubernetes.io/projected/7f21658b-f48e-4863-adec-cd499dca1206-kube-api-access-4xhsf\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.364205 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.364175 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f21658b-f48e-4863-adec-cd499dca1206-sys\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.364205 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.364204 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7f21658b-f48e-4863-adec-cd499dca1206-podres\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.465760 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.465720 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f21658b-f48e-4863-adec-cd499dca1206-lib-modules\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.465943 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.465797 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xhsf\" (UniqueName: \"kubernetes.io/projected/7f21658b-f48e-4863-adec-cd499dca1206-kube-api-access-4xhsf\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.465943 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.465859 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f21658b-f48e-4863-adec-cd499dca1206-sys\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.465943 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.465907 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7f21658b-f48e-4863-adec-cd499dca1206-podres\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.465943 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.465914 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f21658b-f48e-4863-adec-cd499dca1206-lib-modules\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.466169 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.465987 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7f21658b-f48e-4863-adec-cd499dca1206-proc\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.466169 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.466001 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7f21658b-f48e-4863-adec-cd499dca1206-podres\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.466169 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.466049 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7f21658b-f48e-4863-adec-cd499dca1206-proc\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.466409 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.466382 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f21658b-f48e-4863-adec-cd499dca1206-sys\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.478750 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.478719 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xhsf\" (UniqueName: \"kubernetes.io/projected/7f21658b-f48e-4863-adec-cd499dca1206-kube-api-access-4xhsf\") pod \"perf-node-gather-daemonset-45kjq\" (UID: \"7f21658b-f48e-4863-adec-cd499dca1206\") " pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.565206 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.564868 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:50.726149 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:50.726079 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq"] Jul 07 14:36:50.729779 ip-10-0-138-42 kubenswrapper[2570]: W0707 14:36:50.729747 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7f21658b_f48e_4863_adec_cd499dca1206.slice/crio-d5e9ae2a58bad7ff445f2d3c5c263c3ba6f0ef75d6b44abedded5cbf8013db30 WatchSource:0}: Error finding container d5e9ae2a58bad7ff445f2d3c5c263c3ba6f0ef75d6b44abedded5cbf8013db30: Status 404 returned error can't find the container with id d5e9ae2a58bad7ff445f2d3c5c263c3ba6f0ef75d6b44abedded5cbf8013db30 Jul 07 14:36:51.388139 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:51.388108 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" event={"ID":"7f21658b-f48e-4863-adec-cd499dca1206","Type":"ContainerStarted","Data":"1817c63a110f0df43f68cf44a531de7bce0477dfd300d3e96f1906fb250b803c"} Jul 07 14:36:51.388642 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:51.388621 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:51.388784 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:51.388768 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" event={"ID":"7f21658b-f48e-4863-adec-cd499dca1206","Type":"ContainerStarted","Data":"d5e9ae2a58bad7ff445f2d3c5c263c3ba6f0ef75d6b44abedded5cbf8013db30"} Jul 07 14:36:51.409403 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:51.409339 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" podStartSLOduration=1.409317121 podStartE2EDuration="1.409317121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:36:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:51.406210945 +0000 UTC m=+1620.624892685" watchObservedRunningTime="2026-07-07 14:36:51.409317121 +0000 UTC m=+1620.627998861" Jul 07 14:36:51.600284 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:51.600253 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-hrrz8_eab7fad4-03a5-4f76-bba9-b96fc67541b1/download-server/0.log" Jul 07 14:36:53.390025 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:53.390000 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hs5p_08753bf9-ebff-40ef-84a3-104117a47f7f/dns/0.log" Jul 07 14:36:53.428036 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:53.427994 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hs5p_08753bf9-ebff-40ef-84a3-104117a47f7f/kube-rbac-proxy/0.log" Jul 07 14:36:53.548450 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:53.548421 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8lrz7_7b566614-1557-40f7-bf9b-6b8bda043477/dns-node-resolver/0.log" Jul 07 14:36:54.150885 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:54.150857 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-594cc4b499-jst28_57ee1633-4c59-4fbd-a0b5-53da29e3d2e3/registry/0.log" Jul 07 14:36:54.228661 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:54.228631 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hwd8x_e2215475-b6b9-4620-8be6-51d230f88ab1/node-ca/0.log" Jul 07 14:36:55.940794 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:55.940756 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wf6rz_ecef2f02-f123-48b2-aaac-c6caea96a16c/serve-healthcheck-canary/0.log" Jul 07 14:36:56.700967 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:56.700938 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jd5qx_496706ae-5f0b-43e0-b97f-2c7e7bf78543/kube-rbac-proxy/0.log" Jul 07 14:36:56.742035 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:56.742012 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jd5qx_496706ae-5f0b-43e0-b97f-2c7e7bf78543/exporter/0.log" Jul 07 14:36:56.779738 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:56.779709 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jd5qx_496706ae-5f0b-43e0-b97f-2c7e7bf78543/extractor/0.log" Jul 07 14:36:58.404816 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:58.404791 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z7x97/perf-node-gather-daemonset-45kjq" Jul 07 14:36:59.479802 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:59.479749 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-gh67t_1a96c6bc-8977-4426-b854-2f2351e81bef/s3-init/0.log" Jul 07 14:36:59.507441 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:59.507407 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-gh67t_1a96c6bc-8977-4426-b854-2f2351e81bef/download-hf-model/0.log" Jul 07 14:36:59.552148 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:59.552114 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-m5pqf_b0ca200c-e686-46f1-9691-e6bfa16187e3/s3-tls-init-custom/0.log" Jul 07 14:36:59.576129 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:59.576106 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-m5pqf_b0ca200c-e686-46f1-9691-e6bfa16187e3/download-hf-model/0.log" Jul 07 14:36:59.623681 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:59.623649 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-9j7zv_e01950df-6880-41a3-9da0-4452c9fed46a/s3-tls-init-serving/0.log" Jul 07 14:36:59.662317 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:36:59.662283 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-9j7zv_e01950df-6880-41a3-9da0-4452c9fed46a/download-hf-model/0.log" Jul 07 14:37:07.345130 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:37:07.345102 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rln75_385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1/kube-multus-additional-cni-plugins/0.log" Jul 07 14:37:07.379615 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:37:07.379583 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rln75_385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1/egress-router-binary-copy/0.log" Jul 07 14:37:07.408602 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:37:07.408570 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rln75_385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1/cni-plugins/0.log" Jul 07 14:37:07.443443 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:37:07.443415 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rln75_385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1/bond-cni-plugin/0.log" Jul 07 14:37:07.475177 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:37:07.475148 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rln75_385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1/routeoverride-cni/0.log" Jul 07 14:37:07.502187 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:37:07.502161 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rln75_385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1/whereabouts-cni-bincopy/0.log" Jul 07 14:37:07.538935 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:37:07.538905 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rln75_385dbecc-18c8-4eb6-aea1-dfdaff0dc7e1/whereabouts-cni/0.log" Jul 07 14:37:07.584379 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:37:07.584348 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qhtwt_a603d868-bba3-41dd-9cc9-df6a86f21dd3/kube-multus/0.log" Jul 07 14:37:07.614433 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:37:07.614364 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6bvcz_58bbe9a4-1a51-4bf4-994a-43e65007a822/network-metrics-daemon/0.log" Jul 07 14:37:07.645054 ip-10-0-138-42 kubenswrapper[2570]: I0707 14:37:07.645026 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6bvcz_58bbe9a4-1a51-4bf4-994a-43e65007a822/kube-rbac-proxy/0.log"