Jul 08 18:56:48.335882 ip-10-0-142-189 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 18:56:48.335896 ip-10-0-142-189 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 18:56:48.335906 ip-10-0-142-189 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 18:56:48.336256 ip-10-0-142-189 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 18:56:59.533411 ip-10-0-142-189 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 18:56:59.533422 ip-10-0-142-189 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot eb67b311fc1d41238c916dd4eac0889f -- Jul 08 18:58:51.468651 ip-10-0-142-189 systemd[1]: Starting Kubernetes Kubelet... Jul 08 18:58:51.972044 ip-10-0-142-189 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:58:51.972044 ip-10-0-142-189 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 18:58:51.972044 ip-10-0-142-189 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:58:51.972044 ip-10-0-142-189 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 18:58:51.972044 ip-10-0-142-189 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:58:51.973069 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.972972 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 18:58:51.980128 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980108 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:58:51.980128 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980127 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980132 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980136 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980139 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980142 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980145 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980148 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980159 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980162 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980165 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980168 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980170 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980173 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980176 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980179 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980182 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980185 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980189 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980192 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980194 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:58:51.980206 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980197 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980199 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980202 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980205 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980208 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980211 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980214 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980217 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980220 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980223 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980226 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980228 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980231 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980234 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980237 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980239 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980242 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980244 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980247 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980250 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:58:51.980744 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980253 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980255 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980258 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980261 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980264 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980266 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980269 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980271 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980274 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980276 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980279 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980283 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980287 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980292 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980297 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980300 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980303 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980307 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980310 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:58:51.981265 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980314 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980317 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980320 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980322 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980325 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980329 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980333 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980336 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980338 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980341 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980345 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980349 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980352 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980354 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980357 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980360 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980362 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980365 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980367 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:58:51.981815 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980370 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980373 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980376 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980378 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980381 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980384 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980386 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980389 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980392 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980395 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980398 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980401 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980418 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980421 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980423 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980426 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980430 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980433 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980436 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.980439 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:58:51.982318 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981228 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981235 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981240 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981243 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981246 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981250 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981253 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981256 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981259 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981262 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981265 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981268 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981274 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981277 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981281 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981286 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981288 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981291 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981294 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981297 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:58:51.982898 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981300 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981303 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981306 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981308 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981311 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981314 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981317 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981320 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981323 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981326 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981329 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981333 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981337 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981340 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981343 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981346 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981349 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981351 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981354 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:58:51.983446 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981357 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981360 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981362 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981365 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981368 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981373 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981376 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981380 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981382 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981386 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981389 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981392 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981395 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981399 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981418 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981421 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981424 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981427 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981430 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981433 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:58:51.983982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981436 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981438 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981441 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981444 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981446 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981449 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981452 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981455 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981458 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981461 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981463 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981466 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981471 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981474 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981476 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981479 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981482 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981485 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981488 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981491 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:58:51.984533 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981493 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981498 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981501 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981504 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981507 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981510 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981512 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981515 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981518 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981521 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981523 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981526 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981529 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981532 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981535 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981538 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981541 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981543 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981546 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981549 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:58:51.985067 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981977 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981983 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981985 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981988 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981992 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981995 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.981998 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982000 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982003 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982006 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982008 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982011 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982014 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982017 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982020 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982023 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982025 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982028 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982034 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982037 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:58:51.985621 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982040 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982043 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982045 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982048 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982051 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982053 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982056 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982059 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982061 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982064 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982066 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982069 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982072 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982074 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982077 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982080 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982083 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982086 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982088 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982091 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:58:51.986146 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982094 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982098 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982102 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982105 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982107 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982111 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982114 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982116 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982120 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982122 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982127 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982130 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982133 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982135 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982138 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982141 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982143 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982146 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982148 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982151 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:58:51.986682 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982154 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982157 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982160 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982162 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982165 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982168 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982170 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982173 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982176 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982178 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982181 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982184 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982187 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982189 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982192 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982194 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982197 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982200 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982203 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982205 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:58:51.987196 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982208 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982211 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982216 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982219 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982221 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982224 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982229 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982233 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982236 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982239 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982242 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982245 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982248 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982251 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982254 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982256 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982259 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982263 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.982266 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:58:51.987729 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982339 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982347 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982353 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982358 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982364 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982370 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982378 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982385 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982390 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982395 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982401 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982421 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982425 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982428 2574 flags.go:64] FLAG: --cgroup-root="" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982431 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982436 2574 flags.go:64] FLAG: --client-ca-file="" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982439 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982443 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982448 2574 flags.go:64] FLAG: --cluster-domain="" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982451 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982455 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982458 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982462 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982466 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 18:58:51.988222 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982469 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982473 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982477 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982480 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982483 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982486 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982490 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982494 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982499 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982502 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982505 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982508 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982511 2574 flags.go:64] FLAG: --enable-server="true" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982515 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982520 2574 flags.go:64] FLAG: --event-burst="100" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982523 2574 flags.go:64] FLAG: --event-qps="50" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982526 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982529 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982534 2574 flags.go:64] FLAG: --eviction-hard="" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982538 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982541 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982545 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982548 2574 flags.go:64] FLAG: --eviction-soft="" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982553 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982556 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 18:58:51.988875 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982559 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982562 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982565 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982568 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982572 2574 flags.go:64] FLAG: --feature-gates="" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982576 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982579 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982583 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982586 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982589 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982592 2574 flags.go:64] FLAG: --help="false" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982595 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-142-189.ec2.internal" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982599 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982602 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982605 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982609 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982613 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982616 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982619 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982622 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982625 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982628 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982632 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982635 2574 flags.go:64] FLAG: --kube-reserved="" Jul 08 18:58:51.989641 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982638 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982645 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982648 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982651 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982654 2574 flags.go:64] FLAG: --lock-file="" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982658 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982663 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982666 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982672 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982675 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982678 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982681 2574 flags.go:64] FLAG: --logging-format="text" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982684 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982688 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982691 2574 flags.go:64] FLAG: --manifest-url="" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982694 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982699 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982703 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982707 2574 flags.go:64] FLAG: --max-pods="110" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982710 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982714 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982717 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982720 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982723 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982726 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 18:58:51.990277 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982730 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982738 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982741 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982744 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982747 2574 flags.go:64] FLAG: --pod-cidr="" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982751 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982757 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982760 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982763 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982767 2574 flags.go:64] FLAG: --port="10250" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982771 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982774 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09d2d337e7ca67b9b" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982777 2574 flags.go:64] FLAG: --qos-reserved="" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982782 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982786 2574 flags.go:64] FLAG: --register-node="true" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982789 2574 flags.go:64] FLAG: --register-with-taints="" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982793 2574 flags.go:64] FLAG: --registry-burst="10" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982796 2574 flags.go:64] FLAG: --registry-qps="5" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982799 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982802 2574 flags.go:64] FLAG: --reserved-memory="" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982806 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982810 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982813 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982816 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982819 2574 flags.go:64] FLAG: --runonce="false" Jul 08 18:58:51.991125 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982822 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982825 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982829 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982832 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982835 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982838 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982841 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982845 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982848 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982851 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982854 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982857 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982861 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982864 2574 flags.go:64] FLAG: --system-cgroups="" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982867 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982873 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982878 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982882 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982887 2574 flags.go:64] FLAG: --tls-min-version="" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982890 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982894 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982897 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982901 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982904 2574 flags.go:64] FLAG: --v="2" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982914 2574 flags.go:64] FLAG: --version="false" Jul 08 18:58:51.992172 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982918 2574 flags.go:64] FLAG: --vmodule="" Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982922 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.982926 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983050 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983054 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983057 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983060 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983063 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983065 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983068 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983071 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983074 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983077 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983080 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983082 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983085 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983087 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983092 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983096 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:58:51.992891 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983101 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983104 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983108 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983111 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983115 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983118 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983121 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983124 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983127 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983130 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983132 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983135 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983138 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983140 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983143 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983146 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983148 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983151 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983153 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983156 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:58:51.993398 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983159 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983162 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983164 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983167 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983169 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983172 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983174 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983177 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983179 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983182 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983185 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983187 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983190 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983193 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983195 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983198 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983201 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983205 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983208 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:58:51.993943 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983211 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983214 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983217 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983220 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983223 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983225 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983228 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983231 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983235 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983238 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983240 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983243 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983246 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983248 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983252 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983256 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983259 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983262 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983265 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:58:51.994585 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983269 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983272 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983274 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983277 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983280 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983282 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983285 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983288 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983291 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983293 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983296 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983299 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983302 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983305 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983308 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983310 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983313 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983315 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983318 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983321 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:58:51.995097 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983323 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983326 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983329 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983332 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.983334 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.984007 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.992376 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.992395 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.993422 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.993431 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993496 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993503 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993506 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993510 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993513 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:58:51.995635 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993517 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993520 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993524 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993527 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993530 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993533 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993537 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993542 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993545 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993549 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993551 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993555 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993559 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993562 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993565 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993570 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993575 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993578 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:58:51.996032 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993582 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993585 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993588 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993591 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993595 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993598 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993601 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993604 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993608 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993611 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993614 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993617 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993620 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993622 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993625 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993628 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993631 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993633 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993636 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993639 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:58:51.996519 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993642 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993645 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993647 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993650 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993653 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993657 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993659 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993663 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993665 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993668 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993671 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993673 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993676 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993679 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993681 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993684 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993687 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993690 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993694 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:58:51.997052 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993696 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993699 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993702 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993705 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993708 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993710 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993713 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993716 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993718 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993721 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993724 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993726 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993729 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993732 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993735 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993737 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993740 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993745 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993748 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993751 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:58:51.997610 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993754 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993756 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993759 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993762 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993765 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993768 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993771 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993773 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993776 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993779 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993782 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993785 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993788 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993791 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993794 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993796 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:58:51.998130 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993799 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.993805 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993934 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993940 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993943 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993946 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993950 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993954 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993959 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993962 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993965 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993968 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993971 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993974 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993977 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:58:51.998573 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993980 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993983 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993986 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993990 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993992 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993995 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.993998 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994001 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994004 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994007 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994010 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994012 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994023 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994027 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994030 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994033 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994037 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994041 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994044 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:58:51.998982 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994047 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994050 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994053 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994056 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994059 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994062 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994065 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994068 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994070 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994073 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994076 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994079 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994081 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994085 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994088 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994092 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994094 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994097 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994100 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:58:51.999494 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994103 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994107 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994111 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994114 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994117 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994120 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994123 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994126 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994129 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994131 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994134 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994137 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994140 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994143 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994145 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994148 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994151 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994153 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994156 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:58:51.999990 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994159 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994162 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994164 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994167 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994170 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994172 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994175 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994177 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994181 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994184 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994186 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994189 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994192 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994195 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994197 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994201 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994204 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994207 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994209 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994212 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:58:52.000503 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994215 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:58:52.001066 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994218 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:58:52.001066 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994221 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:58:52.001066 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994223 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:58:52.001066 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994226 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:58:52.001066 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994229 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:58:52.001066 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994231 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:58:52.001066 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994234 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:58:52.001066 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:51.994240 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:58:52.001066 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.994245 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:58:52.001066 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.994382 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 18:58:52.001066 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.996643 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 18:58:52.001066 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.998169 2574 server.go:1019] "Starting client certificate rotation" Jul 08 18:58:52.001066 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.998279 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 18:58:52.001066 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:51.998312 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 18:58:52.001531 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.001119 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 18:58:52.002425 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.002395 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 18:58:52.011769 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.011749 2574 log.go:25] "Validated CRI v1 runtime API" Jul 08 18:58:52.015857 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.015843 2574 log.go:25] "Validated CRI v1 image API" Jul 08 18:58:52.016859 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.016842 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 18:58:52.023488 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.023459 2574 fs.go:135] Filesystem UUIDs: map[55f91ed4-8b7c-4a49-afbb-cfbd5144d248:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 bff3dcf9-02a9-4424-b8a4-be3f2dfb3923:/dev/nvme0n1p4] Jul 08 18:58:52.023488 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.023482 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 18:58:52.028640 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.028520 2574 manager.go:216] Machine: {Timestamp:2026-07-08 18:58:52.027961602 +0000 UTC m=+0.420108406 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099634 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bdd516c6d5bc48f77f564b778c8da SystemUUID:ec2bdd51-6c6d-5bc4-8f77-f564b778c8da BootID:eb67b311-fc1d-4123-8c91-6dd4eac0889f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1b:02:9d:af:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1b:02:9d:af:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:6e:c3:e8:d0:07 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 18:58:52.028640 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.028629 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 18:58:52.028771 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.028725 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 18:58:52.032638 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.032604 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 18:58:52.032835 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.032642 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-189.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 18:58:52.034533 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.034520 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 18:58:52.034533 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.034534 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 18:58:52.034631 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.034542 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 18:58:52.035357 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.035346 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 18:58:52.036423 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.036390 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 18:58:52.036817 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.036804 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 18:58:52.040038 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.040025 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 08 18:58:52.040162 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.040153 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 18:58:52.040196 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.040183 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 08 18:58:52.040196 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.040192 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 18:58:52.040258 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.040208 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 18:58:52.040258 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.040219 2574 kubelet.go:398] "Adding apiserver pod source" Jul 08 18:58:52.040258 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.040228 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 18:58:52.040693 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.040681 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 18:58:52.040733 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.040702 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 18:58:52.044818 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.044792 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 18:58:52.046871 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.046856 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 18:58:52.046927 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.046889 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 18:58:52.049731 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.049716 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 18:58:52.049797 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.049736 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 18:58:52.049797 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.049743 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 18:58:52.049797 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.049749 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 18:58:52.049797 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.049758 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 18:58:52.049797 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.049764 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 18:58:52.049797 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.049772 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 18:58:52.049797 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.049778 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 18:58:52.049797 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.049785 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 18:58:52.049797 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.049791 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 18:58:52.049797 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.049800 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 18:58:52.050128 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.049806 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 18:58:52.050128 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.049849 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 18:58:52.050128 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.049856 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 18:58:52.053673 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.053658 2574 server.go:1268] "Started kubelet" Jul 08 18:58:52.053794 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.053744 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 18:58:52.053837 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.053817 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 18:58:52.053901 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.053880 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 18:58:52.054604 ip-10-0-142-189 systemd[1]: Started Kubernetes Kubelet. Jul 08 18:58:52.055296 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.055165 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 18:58:52.055495 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.055467 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 18:58:52.055495 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.055484 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 18:58:52.055627 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.055521 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 18:58:52.056735 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.056713 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 08 18:58:52.059555 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.059525 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 18:58:52.061393 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.061376 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 18:58:52.061393 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.061388 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 18:58:52.062117 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.061638 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-189.ec2.internal\" not found" Jul 08 18:58:52.062117 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.062015 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 18:58:52.062117 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.062025 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 18:58:52.062117 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.062044 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 18:58:52.062326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.062283 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 08 18:58:52.062326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.062292 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 08 18:58:52.062483 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.062467 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 18:58:52.062546 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.062490 2574 factory.go:55] Registering systemd factory Jul 08 18:58:52.062546 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.062500 2574 factory.go:223] Registration of the systemd container factory successfully Jul 08 18:58:52.062877 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.062798 2574 factory.go:153] Registering CRI-O factory Jul 08 18:58:52.062877 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.062815 2574 factory.go:223] Registration of the crio container factory successfully Jul 08 18:58:52.062877 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.062839 2574 factory.go:103] Registering Raw factory Jul 08 18:58:52.062877 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.062854 2574 manager.go:1196] Started watching for new ooms in manager Jul 08 18:58:52.063700 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.063685 2574 manager.go:349] Starting recovery of all containers Jul 08 18:58:52.064230 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.062916 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-189.ec2.internal.18c065926fc688fd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-189.ec2.internal,UID:ip-10-0-142-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-189.ec2.internal,},FirstTimestamp:2026-07-08 18:58:52.053629181 +0000 UTC m=+0.445775962,LastTimestamp:2026-07-08 18:58:52.053629181 +0000 UTC m=+0.445775962,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-189.ec2.internal,}" Jul 08 18:58:52.075376 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.075182 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 18:58:52.075376 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.075227 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 18:58:52.075376 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.075259 2574 manager.go:354] Recovery completed Jul 08 18:58:52.080275 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.080259 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:58:52.082307 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.082275 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:58:52.082416 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.082320 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:58:52.082416 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.082332 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:58:52.082969 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.082955 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 18:58:52.082969 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.082967 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 18:58:52.083071 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.082985 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 08 18:58:52.083071 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.083033 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:58:52.083849 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.083820 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:58:52.083940 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.083851 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:58:52.083940 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.083864 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:58:52.084230 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.084217 2574 policy_none.go:49] "None policy: Start" Jul 08 18:58:52.084264 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.084235 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 18:58:52.084264 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.084247 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 18:58:52.084929 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.084822 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-189.ec2.internal.18c06592717c15f8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-189.ec2.internal,UID:ip-10-0-142-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-189.ec2.internal,},FirstTimestamp:2026-07-08 18:58:52.082304504 +0000 UTC m=+0.474451286,LastTimestamp:2026-07-08 18:58:52.082304504 +0000 UTC m=+0.474451286,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-189.ec2.internal,}" Jul 08 18:58:52.085393 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.085370 2574 policy_none.go:47] "Start" Jul 08 18:58:52.097684 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.097610 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-189.ec2.internal.18c06592717c689f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-189.ec2.internal,UID:ip-10-0-142-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-189.ec2.internal,},FirstTimestamp:2026-07-08 18:58:52.082325663 +0000 UTC m=+0.474472445,LastTimestamp:2026-07-08 18:58:52.082325663 +0000 UTC m=+0.474472445,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-189.ec2.internal,}" Jul 08 18:58:52.101006 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.100898 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-189.ec2.internal.18c06592717c9278 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-189.ec2.internal,UID:ip-10-0-142-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-189.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-189.ec2.internal,},FirstTimestamp:2026-07-08 18:58:52.082336376 +0000 UTC m=+0.474483158,LastTimestamp:2026-07-08 18:58:52.082336376 +0000 UTC m=+0.474483158,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-189.ec2.internal,}" Jul 08 18:58:52.108141 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.108065 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-189.ec2.internal.18c06592717c15f8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-189.ec2.internal.18c06592717c15f8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-189.ec2.internal,UID:ip-10-0-142-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-189.ec2.internal,},FirstTimestamp:2026-07-08 18:58:52.082304504 +0000 UTC m=+0.474451286,LastTimestamp:2026-07-08 18:58:52.083837072 +0000 UTC m=+0.475983853,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-189.ec2.internal,}" Jul 08 18:58:52.114359 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.114293 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-189.ec2.internal.18c06592717c689f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-189.ec2.internal.18c06592717c689f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-189.ec2.internal,UID:ip-10-0-142-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-189.ec2.internal,},FirstTimestamp:2026-07-08 18:58:52.082325663 +0000 UTC m=+0.474472445,LastTimestamp:2026-07-08 18:58:52.0838588 +0000 UTC m=+0.476005582,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-189.ec2.internal,}" Jul 08 18:58:52.120695 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.120628 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-189.ec2.internal.18c06592717c9278\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-189.ec2.internal.18c06592717c9278 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-189.ec2.internal,UID:ip-10-0-142-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-189.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-189.ec2.internal,},FirstTimestamp:2026-07-08 18:58:52.082336376 +0000 UTC m=+0.474483158,LastTimestamp:2026-07-08 18:58:52.08386851 +0000 UTC m=+0.476015291,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-189.ec2.internal,}" Jul 08 18:58:52.125123 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.125106 2574 manager.go:337] "Starting Device Plugin manager" Jul 08 18:58:52.125200 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.125152 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 18:58:52.125200 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.125164 2574 server.go:87] "Starting device plugin registration server" Jul 08 18:58:52.125532 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.125519 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 18:58:52.125585 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.125536 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 18:58:52.125706 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.125694 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 18:58:52.125794 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.125780 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 18:58:52.125794 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.125789 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 18:58:52.126310 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.126291 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 18:58:52.126389 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.126355 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-189.ec2.internal\" not found" Jul 08 18:58:52.130867 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.130799 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-189.ec2.internal.18c065927430a4dd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-189.ec2.internal,UID:ip-10-0-142-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-142-189.ec2.internal,},FirstTimestamp:2026-07-08 18:58:52.127691997 +0000 UTC m=+0.519838769,LastTimestamp:2026-07-08 18:58:52.127691997 +0000 UTC m=+0.519838769,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-189.ec2.internal,}" Jul 08 18:58:52.211075 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.211040 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bqtkz" Jul 08 18:58:52.216860 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.216816 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 18:58:52.218202 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.218184 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 18:58:52.218267 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.218224 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 18:58:52.218267 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.218248 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 18:58:52.218365 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.218282 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 18:58:52.218498 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.218474 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bqtkz" Jul 08 18:58:52.227417 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.227346 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:58:52.228319 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.228300 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:58:52.228435 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.228334 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:58:52.228435 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.228348 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:58:52.228435 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.228371 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.228762 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.228747 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:58:52.239675 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.239658 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.239749 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.239684 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-189.ec2.internal\": node \"ip-10-0-142-189.ec2.internal\" not found" Jul 08 18:58:52.279922 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.279892 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-189.ec2.internal\" not found" Jul 08 18:58:52.320080 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.320017 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-189.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal"] Jul 08 18:58:52.320173 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.320135 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:58:52.321971 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.321954 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:58:52.322090 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.321987 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:58:52.322090 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.321998 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:58:52.323458 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.323443 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:58:52.323532 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.323507 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.323571 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.323562 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:58:52.324386 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.324371 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:58:52.324480 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.324394 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:58:52.324480 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.324451 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:58:52.324480 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.324465 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:58:52.324634 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.324398 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:58:52.324634 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.324530 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:58:52.325854 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.325837 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.325920 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.325877 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:58:52.326658 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.326636 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:58:52.326766 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.326677 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:58:52.326766 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.326695 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:58:52.353447 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.353413 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-189.ec2.internal\" not found" node="ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.357349 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.357330 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-189.ec2.internal\" not found" node="ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.363982 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.363962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5400be6aab20143e36fa75476b73c789-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal\" (UID: \"5400be6aab20143e36fa75476b73c789\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.364057 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.364004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5400be6aab20143e36fa75476b73c789-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal\" (UID: \"5400be6aab20143e36fa75476b73c789\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.364057 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.364024 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8179e64f56bafcea70993a6654313ec4-config\") pod \"kube-apiserver-proxy-ip-10-0-142-189.ec2.internal\" (UID: \"8179e64f56bafcea70993a6654313ec4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.380454 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.380422 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-189.ec2.internal\" not found" Jul 08 18:58:52.464750 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.464717 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8179e64f56bafcea70993a6654313ec4-config\") pod \"kube-apiserver-proxy-ip-10-0-142-189.ec2.internal\" (UID: \"8179e64f56bafcea70993a6654313ec4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.464750 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.464749 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5400be6aab20143e36fa75476b73c789-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal\" (UID: \"5400be6aab20143e36fa75476b73c789\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.464929 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.464767 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5400be6aab20143e36fa75476b73c789-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal\" (UID: \"5400be6aab20143e36fa75476b73c789\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.464929 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.464797 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5400be6aab20143e36fa75476b73c789-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal\" (UID: \"5400be6aab20143e36fa75476b73c789\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.464929 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.464820 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8179e64f56bafcea70993a6654313ec4-config\") pod \"kube-apiserver-proxy-ip-10-0-142-189.ec2.internal\" (UID: \"8179e64f56bafcea70993a6654313ec4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.464929 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.464825 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5400be6aab20143e36fa75476b73c789-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal\" (UID: \"5400be6aab20143e36fa75476b73c789\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.481086 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.481019 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-189.ec2.internal\" not found" Jul 08 18:58:52.582344 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.582294 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-189.ec2.internal\" not found" Jul 08 18:58:52.661569 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.661526 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.661657 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.661553 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-189.ec2.internal" Jul 08 18:58:52.683400 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.683357 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-189.ec2.internal\" not found" Jul 08 18:58:52.784458 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.784329 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-189.ec2.internal\" not found" Jul 08 18:58:52.885610 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.885580 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-189.ec2.internal\" not found" Jul 08 18:58:52.986320 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:52.986285 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-189.ec2.internal\" not found" Jul 08 18:58:52.997767 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.997736 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 18:58:52.997920 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:52.997900 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 18:58:53.086598 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:53.086507 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-189.ec2.internal\" not found" Jul 08 18:58:53.123500 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:53.123460 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:58:53.124562 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:53.124544 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:58:53.124664 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:53.124582 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:58:53.124664 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:53.124597 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:58:53.138689 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:53.138666 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:58:53.162845 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:53.162816 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:58:53.222606 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:53.222560 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 18:53:52 +0000 UTC" deadline="2028-01-04 08:34:52.501443296 +0000 UTC" Jul 08 18:58:53.222606 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:53.222596 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13069h35m59.27885035s" Jul 08 18:58:53.264962 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:53.264923 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-189.ec2.internal" Jul 08 18:58:53.277344 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:53.277305 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 18:58:53.279803 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:53.279787 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal" Jul 08 18:58:53.295572 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:53.295548 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 18:58:53.347092 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:53.347008 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:58:53.453736 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:53.453690 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8179e64f56bafcea70993a6654313ec4.slice/crio-37c167d04bed29dcaac6bf397f1fb9ac4f629dcee336f3fc05a98107dd224b77 WatchSource:0}: Error finding container 37c167d04bed29dcaac6bf397f1fb9ac4f629dcee336f3fc05a98107dd224b77: Status 404 returned error can't find the container with id 37c167d04bed29dcaac6bf397f1fb9ac4f629dcee336f3fc05a98107dd224b77 Jul 08 18:58:53.453963 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:53.453939 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5400be6aab20143e36fa75476b73c789.slice/crio-3172658f988fa78090d93b1e11f19b4b51fc868db929c579a7a9e041543c691f WatchSource:0}: Error finding container 3172658f988fa78090d93b1e11f19b4b51fc868db929c579a7a9e041543c691f: Status 404 returned error can't find the container with id 3172658f988fa78090d93b1e11f19b4b51fc868db929c579a7a9e041543c691f Jul 08 18:58:53.460521 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:53.460499 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:58:54.043003 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.042961 2574 apiserver.go:52] "Watching apiserver" Jul 08 18:58:54.062409 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.062378 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 18:58:54.067038 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.067009 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 18:58:54.067689 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.067659 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-7jmds","kube-system/konnectivity-agent-xg5dz","openshift-cluster-node-tuning-operator/tuned-6j4kq","openshift-multus/multus-additional-cni-plugins-jggch","openshift-multus/multus-zbbm7","openshift-multus/network-metrics-daemon-k4pww","openshift-network-diagnostics/network-check-target-5zw8l","openshift-ovn-kubernetes/ovnkube-node-wqlrv","kube-system/kube-apiserver-proxy-ip-10-0-142-189.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx","openshift-dns/node-resolver-s9c56","openshift-image-registry/node-ca-p7px9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal","openshift-network-operator/iptables-alerter-nfnb5"] Jul 08 18:58:54.069275 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.069240 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:58:54.070229 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.069337 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:58:54.070469 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.070448 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s9c56" Jul 08 18:58:54.072076 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.071980 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.073054 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.073036 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.073779 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.073756 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 18:58:54.073869 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.073819 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dxckj\"" Jul 08 18:58:54.075088 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.074689 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.075088 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.074824 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:58:54.075088 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.074972 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 18:58:54.076119 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.075943 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4ql8f\"" Jul 08 18:58:54.076207 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.076142 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 18:58:54.076916 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.076360 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:58:54.076916 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.076450 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 18:58:54.076916 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.076503 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:58:54.076916 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.076561 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 18:58:54.076916 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.076630 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 18:58:54.076916 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.076689 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 18:58:54.076916 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.076815 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 18:58:54.077730 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.077187 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7w88f\"" Jul 08 18:58:54.077838 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.077817 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nfnb5" Jul 08 18:58:54.079737 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.079714 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.081978 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.081957 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xg5dz" Jul 08 18:58:54.083920 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.083899 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.085518 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.085497 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:58:54.085620 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.085562 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:58:54.086818 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.086793 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p7px9" Jul 08 18:58:54.093550 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.093386 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 18:58:54.093550 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.093398 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 18:58:54.094729 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.094017 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 18:58:54.110764 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.110728 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 18:58:54.115858 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.115793 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 18:58:54.115858 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.115819 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 18:58:54.116451 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.115986 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 18:58:54.116451 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.116095 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 18:58:54.116569 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.116449 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 18:58:54.116569 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.116482 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-997l4\"" Jul 08 18:58:54.116707 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.116687 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 18:58:54.116769 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.116733 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wvhkg\"" Jul 08 18:58:54.116833 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.116817 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8brz8\"" Jul 08 18:58:54.116893 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.116874 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 18:58:54.116950 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.116922 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 18:58:54.117339 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.117256 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 18:58:54.117339 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.117324 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 18:58:54.117540 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.117255 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-87bt5\"" Jul 08 18:58:54.117888 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.117723 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:58:54.117888 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.117839 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 18:58:54.118035 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.117940 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 18:58:54.118255 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.118111 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tpkr8\"" Jul 08 18:58:54.122804 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.122779 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s7vb8\"" Jul 08 18:58:54.130127 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.130098 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 18:58:54.141573 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.141546 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 18:58:54.153019 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.152988 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c2csb" Jul 08 18:58:54.164150 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.164122 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 18:58:54.174286 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-systemd-units\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.174496 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174293 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-run-openvswitch\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.174496 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-sys-fs\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.174496 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174354 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-var-lib-cni-multus\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.174496 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174382 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf533b5c-6379-40d6-bd6d-1cf429b2ef2e-hosts-file\") pod \"node-resolver-s9c56\" (UID: \"bf533b5c-6379-40d6-bd6d-1cf429b2ef2e\") " pod="openshift-dns/node-resolver-s9c56" Jul 08 18:58:54.174496 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174406 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-log-socket\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.174496 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174481 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-hostroot\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.174829 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174520 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8db410ea-9a2a-4463-a5f6-dfb2c25515e6-agent-certs\") pod \"konnectivity-agent-xg5dz\" (UID: \"8db410ea-9a2a-4463-a5f6-dfb2c25515e6\") " pod="kube-system/konnectivity-agent-xg5dz" Jul 08 18:58:54.174829 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-kubelet\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.174829 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.174829 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-device-dir\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.174829 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174647 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9svjm\" (UniqueName: \"kubernetes.io/projected/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-kube-api-access-9svjm\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.174829 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feb81d8c-4f54-436a-9b05-094323099754-cni-binary-copy\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.174829 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174695 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-etc-openvswitch\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.174829 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-sysctl-conf\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.174829 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174775 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14160c19-e852-417e-beee-1bd3f869f339-cnibin\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.174829 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-run-netns\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174866 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d7ed295-ebb1-4990-ad40-567f040e2578-iptables-alerter-script\") pod \"iptables-alerter-nfnb5\" (UID: \"3d7ed295-ebb1-4990-ad40-567f040e2578\") " pod="openshift-network-operator/iptables-alerter-nfnb5" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8db410ea-9a2a-4463-a5f6-dfb2c25515e6-konnectivity-ca\") pod \"konnectivity-agent-xg5dz\" (UID: \"8db410ea-9a2a-4463-a5f6-dfb2c25515e6\") " pod="kube-system/konnectivity-agent-xg5dz" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174913 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-node-log\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174945 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-sys\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174974 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkhbh\" (UniqueName: \"kubernetes.io/projected/bf533b5c-6379-40d6-bd6d-1cf429b2ef2e-kube-api-access-jkhbh\") pod \"node-resolver-s9c56\" (UID: \"bf533b5c-6379-40d6-bd6d-1cf429b2ef2e\") " pod="openshift-dns/node-resolver-s9c56" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.174992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-run-netns\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175025 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175048 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74bebf1f-0175-47fe-be43-314ad803cf63-ovnkube-script-lib\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175064 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-multus-conf-dir\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175088 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/feb81d8c-4f54-436a-9b05-094323099754-multus-daemon-config\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175120 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-cni-bin\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175151 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175186 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnvr2\" (UniqueName: \"kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2\") pod \"network-check-target-5zw8l\" (UID: \"c1ce3bf0-78da-4542-81fa-0dccea93ae8c\") " pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-sysctl-d\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.175326 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14160c19-e852-417e-beee-1bd3f869f339-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175272 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-cnibin\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175296 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-var-lib-kubelet\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq67c\" (UniqueName: \"kubernetes.io/projected/9c146ab4-0d07-4951-9d48-bfff5ab7acef-kube-api-access-dq67c\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfrwl\" (UniqueName: \"kubernetes.io/projected/3d7ed295-ebb1-4990-ad40-567f040e2578-kube-api-access-tfrwl\") pod \"iptables-alerter-nfnb5\" (UID: \"3d7ed295-ebb1-4990-ad40-567f040e2578\") " pod="openshift-network-operator/iptables-alerter-nfnb5" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74bebf1f-0175-47fe-be43-314ad803cf63-ovn-node-metrics-cert\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14160c19-e852-417e-beee-1bd3f869f339-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175454 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-multus-socket-dir-parent\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-etc-kubernetes\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtrw7\" (UniqueName: \"kubernetes.io/projected/14160c19-e852-417e-beee-1bd3f869f339-kube-api-access-qtrw7\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175529 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-run-ovn\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175574 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c425d240-601b-44d7-8185-7b4e5f80b9be-kubelet-config\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c425d240-601b-44d7-8185-7b4e5f80b9be-dbus\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175612 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqd85\" (UniqueName: \"kubernetes.io/projected/fa3a6023-79bf-4124-91a9-68653cd84334-kube-api-access-hqd85\") pod \"node-ca-p7px9\" (UID: \"fa3a6023-79bf-4124-91a9-68653cd84334\") " pod="openshift-image-registry/node-ca-p7px9" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175636 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-kubernetes\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175661 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-systemd\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.176149 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14160c19-e852-417e-beee-1bd3f869f339-os-release\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175702 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14160c19-e852-417e-beee-1bd3f869f339-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-cni-netd\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175750 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-modprobe-d\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175780 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-lib-modules\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175811 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-multus-cni-dir\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175835 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2wrq\" (UniqueName: \"kubernetes.io/projected/74bebf1f-0175-47fe-be43-314ad803cf63-kube-api-access-w2wrq\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175864 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-registration-dir\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175887 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa3a6023-79bf-4124-91a9-68653cd84334-serviceca\") pod \"node-ca-p7px9\" (UID: \"fa3a6023-79bf-4124-91a9-68653cd84334\") " pod="openshift-image-registry/node-ca-p7px9" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-sysconfig\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175943 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-host\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.175978 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-tmp\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-os-release\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176026 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-var-lib-openvswitch\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176054 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74bebf1f-0175-47fe-be43-314ad803cf63-env-overrides\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176085 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6rvt\" (UniqueName: \"kubernetes.io/projected/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-kube-api-access-k6rvt\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.176959 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176107 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-var-lib-kubelet\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-tuned\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176145 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa3a6023-79bf-4124-91a9-68653cd84334-host\") pod \"node-ca-p7px9\" (UID: \"fa3a6023-79bf-4124-91a9-68653cd84334\") " pod="openshift-image-registry/node-ca-p7px9" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176169 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-run-k8s-cni-cncf-io\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-slash\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176202 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-socket-dir\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-etc-selinux\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176266 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14160c19-e852-417e-beee-1bd3f869f339-system-cni-dir\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176291 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-run-multus-certs\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf29v\" (UniqueName: \"kubernetes.io/projected/feb81d8c-4f54-436a-9b05-094323099754-kube-api-access-qf29v\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d7ed295-ebb1-4990-ad40-567f040e2578-host-slash\") pod \"iptables-alerter-nfnb5\" (UID: \"3d7ed295-ebb1-4990-ad40-567f040e2578\") " pod="openshift-network-operator/iptables-alerter-nfnb5" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176378 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-run-systemd\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176394 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74bebf1f-0175-47fe-be43-314ad803cf63-ovnkube-config\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176408 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-run\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14160c19-e852-417e-beee-1bd3f869f339-cni-binary-copy\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.177878 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176466 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-system-cni-dir\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.178682 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-var-lib-cni-bin\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.178682 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.176507 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf533b5c-6379-40d6-bd6d-1cf429b2ef2e-tmp-dir\") pod \"node-resolver-s9c56\" (UID: \"bf533b5c-6379-40d6-bd6d-1cf429b2ef2e\") " pod="openshift-dns/node-resolver-s9c56" Jul 08 18:58:54.178682 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.178382 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c2csb" Jul 08 18:58:54.223814 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.223715 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal" event={"ID":"5400be6aab20143e36fa75476b73c789","Type":"ContainerStarted","Data":"3172658f988fa78090d93b1e11f19b4b51fc868db929c579a7a9e041543c691f"} Jul 08 18:58:54.225613 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.225549 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-189.ec2.internal" event={"ID":"8179e64f56bafcea70993a6654313ec4","Type":"ContainerStarted","Data":"37c167d04bed29dcaac6bf397f1fb9ac4f629dcee336f3fc05a98107dd224b77"} Jul 08 18:58:54.277085 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.276880 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d7ed295-ebb1-4990-ad40-567f040e2578-host-slash\") pod \"iptables-alerter-nfnb5\" (UID: \"3d7ed295-ebb1-4990-ad40-567f040e2578\") " pod="openshift-network-operator/iptables-alerter-nfnb5" Jul 08 18:58:54.277085 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.276922 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-run-systemd\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.277085 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.276942 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74bebf1f-0175-47fe-be43-314ad803cf63-ovnkube-config\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.277085 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277007 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d7ed295-ebb1-4990-ad40-567f040e2578-host-slash\") pod \"iptables-alerter-nfnb5\" (UID: \"3d7ed295-ebb1-4990-ad40-567f040e2578\") " pod="openshift-network-operator/iptables-alerter-nfnb5" Jul 08 18:58:54.277085 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277061 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-run\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.277085 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277088 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-run-systemd\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.277085 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14160c19-e852-417e-beee-1bd3f869f339-cni-binary-copy\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-system-cni-dir\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277158 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-var-lib-cni-bin\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277183 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf533b5c-6379-40d6-bd6d-1cf429b2ef2e-tmp-dir\") pod \"node-resolver-s9c56\" (UID: \"bf533b5c-6379-40d6-bd6d-1cf429b2ef2e\") " pod="openshift-dns/node-resolver-s9c56" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277233 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-systemd-units\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-run-openvswitch\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-sys-fs\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277308 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-var-lib-cni-multus\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277335 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf533b5c-6379-40d6-bd6d-1cf429b2ef2e-hosts-file\") pod \"node-resolver-s9c56\" (UID: \"bf533b5c-6379-40d6-bd6d-1cf429b2ef2e\") " pod="openshift-dns/node-resolver-s9c56" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277374 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-log-socket\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277399 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-hostroot\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277425 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8db410ea-9a2a-4463-a5f6-dfb2c25515e6-agent-certs\") pod \"konnectivity-agent-xg5dz\" (UID: \"8db410ea-9a2a-4463-a5f6-dfb2c25515e6\") " pod="kube-system/konnectivity-agent-xg5dz" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277452 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-kubelet\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277503 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-device-dir\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277532 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9svjm\" (UniqueName: \"kubernetes.io/projected/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-kube-api-access-9svjm\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277578 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feb81d8c-4f54-436a-9b05-094323099754-cni-binary-copy\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-etc-openvswitch\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.277690 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277639 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-sysctl-conf\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14160c19-e852-417e-beee-1bd3f869f339-cnibin\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277698 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-run-netns\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277704 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74bebf1f-0175-47fe-be43-314ad803cf63-ovnkube-config\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277727 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277754 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14160c19-e852-417e-beee-1bd3f869f339-cni-binary-copy\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277804 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-hostroot\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277860 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-run\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277869 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-system-cni-dir\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.277876 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277912 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-var-lib-cni-bin\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.277942 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs podName:9c146ab4-0d07-4951-9d48-bfff5ab7acef nodeName:}" failed. No retries permitted until 2026-07-08 18:58:54.777919827 +0000 UTC m=+3.170066611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs") pod "network-metrics-daemon-k4pww" (UID: "9c146ab4-0d07-4951-9d48-bfff5ab7acef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277955 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-var-lib-cni-multus\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-sys-fs\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277991 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-etc-openvswitch\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278001 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-log-socket\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-kubelet\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.278651 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.277808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d7ed295-ebb1-4990-ad40-567f040e2578-iptables-alerter-script\") pod \"iptables-alerter-nfnb5\" (UID: \"3d7ed295-ebb1-4990-ad40-567f040e2578\") " pod="openshift-network-operator/iptables-alerter-nfnb5" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278052 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8db410ea-9a2a-4463-a5f6-dfb2c25515e6-konnectivity-ca\") pod \"konnectivity-agent-xg5dz\" (UID: \"8db410ea-9a2a-4463-a5f6-dfb2c25515e6\") " pod="kube-system/konnectivity-agent-xg5dz" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278078 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-node-log\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278103 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-sys\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkhbh\" (UniqueName: \"kubernetes.io/projected/bf533b5c-6379-40d6-bd6d-1cf429b2ef2e-kube-api-access-jkhbh\") pod \"node-resolver-s9c56\" (UID: \"bf533b5c-6379-40d6-bd6d-1cf429b2ef2e\") " pod="openshift-dns/node-resolver-s9c56" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278142 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-sysctl-conf\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278192 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14160c19-e852-417e-beee-1bd3f869f339-cnibin\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278250 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278285 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf533b5c-6379-40d6-bd6d-1cf429b2ef2e-tmp-dir\") pod \"node-resolver-s9c56\" (UID: \"bf533b5c-6379-40d6-bd6d-1cf429b2ef2e\") " pod="openshift-dns/node-resolver-s9c56" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278302 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-run-netns\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278359 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-systemd-units\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278366 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-node-log\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278398 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278464 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-run-openvswitch\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278501 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d7ed295-ebb1-4990-ad40-567f040e2578-iptables-alerter-script\") pod \"iptables-alerter-nfnb5\" (UID: \"3d7ed295-ebb1-4990-ad40-567f040e2578\") " pod="openshift-network-operator/iptables-alerter-nfnb5" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278589 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf533b5c-6379-40d6-bd6d-1cf429b2ef2e-hosts-file\") pod \"node-resolver-s9c56\" (UID: \"bf533b5c-6379-40d6-bd6d-1cf429b2ef2e\") " pod="openshift-dns/node-resolver-s9c56" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-run-netns\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278651 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-sys\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.279551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278682 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74bebf1f-0175-47fe-be43-314ad803cf63-ovnkube-script-lib\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-multus-conf-dir\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278767 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/feb81d8c-4f54-436a-9b05-094323099754-multus-daemon-config\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278797 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-cni-bin\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278789 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-run-netns\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278852 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnvr2\" (UniqueName: \"kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2\") pod \"network-check-target-5zw8l\" (UID: \"c1ce3bf0-78da-4542-81fa-0dccea93ae8c\") " pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278867 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278878 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-sysctl-d\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14160c19-e852-417e-beee-1bd3f869f339-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278920 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-multus-conf-dir\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278933 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-cnibin\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278947 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8db410ea-9a2a-4463-a5f6-dfb2c25515e6-konnectivity-ca\") pod \"konnectivity-agent-xg5dz\" (UID: \"8db410ea-9a2a-4463-a5f6-dfb2c25515e6\") " pod="kube-system/konnectivity-agent-xg5dz" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278959 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-var-lib-kubelet\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq67c\" (UniqueName: \"kubernetes.io/projected/9c146ab4-0d07-4951-9d48-bfff5ab7acef-kube-api-access-dq67c\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279010 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feb81d8c-4f54-436a-9b05-094323099754-cni-binary-copy\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.280372 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279026 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279015 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfrwl\" (UniqueName: \"kubernetes.io/projected/3d7ed295-ebb1-4990-ad40-567f040e2578-kube-api-access-tfrwl\") pod \"iptables-alerter-nfnb5\" (UID: \"3d7ed295-ebb1-4990-ad40-567f040e2578\") " pod="openshift-network-operator/iptables-alerter-nfnb5" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279447 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74bebf1f-0175-47fe-be43-314ad803cf63-ovn-node-metrics-cert\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279504 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14160c19-e852-417e-beee-1bd3f869f339-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279542 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-multus-socket-dir-parent\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-etc-kubernetes\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtrw7\" (UniqueName: \"kubernetes.io/projected/14160c19-e852-417e-beee-1bd3f869f339-kube-api-access-qtrw7\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-run-ovn\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279681 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c425d240-601b-44d7-8185-7b4e5f80b9be-kubelet-config\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279710 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c425d240-601b-44d7-8185-7b4e5f80b9be-dbus\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqd85\" (UniqueName: \"kubernetes.io/projected/fa3a6023-79bf-4124-91a9-68653cd84334-kube-api-access-hqd85\") pod \"node-ca-p7px9\" (UID: \"fa3a6023-79bf-4124-91a9-68653cd84334\") " pod="openshift-image-registry/node-ca-p7px9" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279782 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-kubernetes\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-systemd\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14160c19-e852-417e-beee-1bd3f869f339-os-release\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279890 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14160c19-e852-417e-beee-1bd3f869f339-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.278433 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-device-dir\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.280097 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/feb81d8c-4f54-436a-9b05-094323099754-multus-daemon-config\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.280919 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.279085 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-sysctl-d\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.280363 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74bebf1f-0175-47fe-be43-314ad803cf63-ovnkube-script-lib\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.280452 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14160c19-e852-417e-beee-1bd3f869f339-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.280555 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-cnibin\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.280602 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14160c19-e852-417e-beee-1bd3f869f339-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.280620 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-kubernetes\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.280680 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-var-lib-kubelet\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.280737 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-run-ovn\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.280779 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14160c19-e852-417e-beee-1bd3f869f339-os-release\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.280850 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c425d240-601b-44d7-8185-7b4e5f80b9be-kubelet-config\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281063 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14160c19-e852-417e-beee-1bd3f869f339-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281186 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-multus-socket-dir-parent\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281371 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c425d240-601b-44d7-8185-7b4e5f80b9be-dbus\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281461 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-etc-kubernetes\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281582 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-cni-netd\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.281623 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281592 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-systemd\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281682 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-modprobe-d\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281720 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-lib-modules\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281750 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-multus-cni-dir\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281777 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2wrq\" (UniqueName: \"kubernetes.io/projected/74bebf1f-0175-47fe-be43-314ad803cf63-kube-api-access-w2wrq\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-registration-dir\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281868 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-cni-netd\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-modprobe-d\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281968 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-multus-cni-dir\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.281859 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa3a6023-79bf-4124-91a9-68653cd84334-serviceca\") pod \"node-ca-p7px9\" (UID: \"fa3a6023-79bf-4124-91a9-68653cd84334\") " pod="openshift-image-registry/node-ca-p7px9" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282082 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-sysconfig\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-host\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-tmp\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282176 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-os-release\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282209 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-var-lib-openvswitch\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282220 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-registration-dir\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282238 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74bebf1f-0175-47fe-be43-314ad803cf63-env-overrides\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282208 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-lib-modules\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.282395 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282286 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-var-lib-openvswitch\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282333 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-os-release\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282332 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6rvt\" (UniqueName: \"kubernetes.io/projected/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-kube-api-access-k6rvt\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-var-lib-kubelet\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-tuned\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282446 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa3a6023-79bf-4124-91a9-68653cd84334-host\") pod \"node-ca-p7px9\" (UID: \"fa3a6023-79bf-4124-91a9-68653cd84334\") " pod="openshift-image-registry/node-ca-p7px9" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282479 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-run-k8s-cni-cncf-io\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282493 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa3a6023-79bf-4124-91a9-68653cd84334-serviceca\") pod \"node-ca-p7px9\" (UID: \"fa3a6023-79bf-4124-91a9-68653cd84334\") " pod="openshift-image-registry/node-ca-p7px9" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282554 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-slash\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-host\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282595 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-run-k8s-cni-cncf-io\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282599 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-socket-dir\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-etc-selinux\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282696 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282702 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-socket-dir\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282734 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8db410ea-9a2a-4463-a5f6-dfb2c25515e6-agent-certs\") pod \"konnectivity-agent-xg5dz\" (UID: \"8db410ea-9a2a-4463-a5f6-dfb2c25515e6\") " pod="kube-system/konnectivity-agent-xg5dz" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282735 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14160c19-e852-417e-beee-1bd3f869f339-system-cni-dir\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.283329 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282758 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-slash\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.284256 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282787 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14160c19-e852-417e-beee-1bd3f869f339-system-cni-dir\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.284256 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282785 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-run-multus-certs\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.284256 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf29v\" (UniqueName: \"kubernetes.io/projected/feb81d8c-4f54-436a-9b05-094323099754-kube-api-access-qf29v\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.284256 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282871 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-etc-selinux\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.284256 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.282885 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:58:54.284256 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.282931 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-sysconfig\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.284256 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.283035 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret podName:c425d240-601b-44d7-8185-7b4e5f80b9be nodeName:}" failed. No retries permitted until 2026-07-08 18:58:54.783004317 +0000 UTC m=+3.175151097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret") pod "global-pull-secret-syncer-7jmds" (UID: "c425d240-601b-44d7-8185-7b4e5f80b9be") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:58:54.284256 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.283103 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-var-lib-kubelet\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.284256 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.283235 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74bebf1f-0175-47fe-be43-314ad803cf63-env-overrides\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.284256 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.283326 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74bebf1f-0175-47fe-be43-314ad803cf63-host-cni-bin\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.284256 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.283404 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa3a6023-79bf-4124-91a9-68653cd84334-host\") pod \"node-ca-p7px9\" (UID: \"fa3a6023-79bf-4124-91a9-68653cd84334\") " pod="openshift-image-registry/node-ca-p7px9" Jul 08 18:58:54.284256 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.283510 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/feb81d8c-4f54-436a-9b05-094323099754-host-run-multus-certs\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.284256 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.284168 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74bebf1f-0175-47fe-be43-314ad803cf63-ovn-node-metrics-cert\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.286278 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.286250 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-etc-tuned\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.287449 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.287427 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-tmp\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.294824 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.294753 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:58:54.295281 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.295255 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9svjm\" (UniqueName: \"kubernetes.io/projected/97ea550b-8abd-4bf7-bc8a-96ed573c95f4-kube-api-access-9svjm\") pod \"tuned-6j4kq\" (UID: \"97ea550b-8abd-4bf7-bc8a-96ed573c95f4\") " pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.304708 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.304683 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:58:54.304847 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.304716 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:58:54.304847 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.304733 2574 projected.go:196] Error preparing data for projected volume kube-api-access-fnvr2 for pod openshift-network-diagnostics/network-check-target-5zw8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:58:54.304847 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.304830 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2 podName:c1ce3bf0-78da-4542-81fa-0dccea93ae8c nodeName:}" failed. No retries permitted until 2026-07-08 18:58:54.804808972 +0000 UTC m=+3.196955765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fnvr2" (UniqueName: "kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2") pod "network-check-target-5zw8l" (UID: "c1ce3bf0-78da-4542-81fa-0dccea93ae8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:58:54.312241 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.312164 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqd85\" (UniqueName: \"kubernetes.io/projected/fa3a6023-79bf-4124-91a9-68653cd84334-kube-api-access-hqd85\") pod \"node-ca-p7px9\" (UID: \"fa3a6023-79bf-4124-91a9-68653cd84334\") " pod="openshift-image-registry/node-ca-p7px9" Jul 08 18:58:54.313211 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.313180 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkhbh\" (UniqueName: \"kubernetes.io/projected/bf533b5c-6379-40d6-bd6d-1cf429b2ef2e-kube-api-access-jkhbh\") pod \"node-resolver-s9c56\" (UID: \"bf533b5c-6379-40d6-bd6d-1cf429b2ef2e\") " pod="openshift-dns/node-resolver-s9c56" Jul 08 18:58:54.314507 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.314461 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2wrq\" (UniqueName: \"kubernetes.io/projected/74bebf1f-0175-47fe-be43-314ad803cf63-kube-api-access-w2wrq\") pod \"ovnkube-node-wqlrv\" (UID: \"74bebf1f-0175-47fe-be43-314ad803cf63\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.315658 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.315632 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6rvt\" (UniqueName: \"kubernetes.io/projected/91f1f29a-4edb-4a20-b932-dbdfd56d5ce2-kube-api-access-k6rvt\") pod \"aws-ebs-csi-driver-node-f59hx\" (UID: \"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.315780 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.315715 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfrwl\" (UniqueName: \"kubernetes.io/projected/3d7ed295-ebb1-4990-ad40-567f040e2578-kube-api-access-tfrwl\") pod \"iptables-alerter-nfnb5\" (UID: \"3d7ed295-ebb1-4990-ad40-567f040e2578\") " pod="openshift-network-operator/iptables-alerter-nfnb5" Jul 08 18:58:54.318449 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.318313 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq67c\" (UniqueName: \"kubernetes.io/projected/9c146ab4-0d07-4951-9d48-bfff5ab7acef-kube-api-access-dq67c\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:58:54.319992 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.319911 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtrw7\" (UniqueName: \"kubernetes.io/projected/14160c19-e852-417e-beee-1bd3f869f339-kube-api-access-qtrw7\") pod \"multus-additional-cni-plugins-jggch\" (UID: \"14160c19-e852-417e-beee-1bd3f869f339\") " pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.320430 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.320367 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf29v\" (UniqueName: \"kubernetes.io/projected/feb81d8c-4f54-436a-9b05-094323099754-kube-api-access-qf29v\") pod \"multus-zbbm7\" (UID: \"feb81d8c-4f54-436a-9b05-094323099754\") " pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.387251 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.387216 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s9c56" Jul 08 18:58:54.397136 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.396927 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" Jul 08 18:58:54.401967 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:54.401896 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf533b5c_6379_40d6_bd6d_1cf429b2ef2e.slice/crio-73a4544d8c30fc3c2b2e61c56f2bdf38816a6a11ebbbcfe45c50fc36be8a34e4 WatchSource:0}: Error finding container 73a4544d8c30fc3c2b2e61c56f2bdf38816a6a11ebbbcfe45c50fc36be8a34e4: Status 404 returned error can't find the container with id 73a4544d8c30fc3c2b2e61c56f2bdf38816a6a11ebbbcfe45c50fc36be8a34e4 Jul 08 18:58:54.406380 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.406345 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jggch" Jul 08 18:58:54.414626 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.414601 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zbbm7" Jul 08 18:58:54.419137 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:54.419112 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14160c19_e852_417e_beee_1bd3f869f339.slice/crio-d0d6752c63e72789dabe6ec94cd5fc2b5e849d989c2c24739453c1ed182d4bfb WatchSource:0}: Error finding container d0d6752c63e72789dabe6ec94cd5fc2b5e849d989c2c24739453c1ed182d4bfb: Status 404 returned error can't find the container with id d0d6752c63e72789dabe6ec94cd5fc2b5e849d989c2c24739453c1ed182d4bfb Jul 08 18:58:54.424814 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.424787 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nfnb5" Jul 08 18:58:54.425578 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:54.425548 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb81d8c_4f54_436a_9b05_094323099754.slice/crio-e5a01202ac8d34deba936b27ac685818f8541f1a6365dab036d0098c87c34246 WatchSource:0}: Error finding container e5a01202ac8d34deba936b27ac685818f8541f1a6365dab036d0098c87c34246: Status 404 returned error can't find the container with id e5a01202ac8d34deba936b27ac685818f8541f1a6365dab036d0098c87c34246 Jul 08 18:58:54.432359 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.432326 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:58:54.435544 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:54.435513 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7ed295_ebb1_4990_ad40_567f040e2578.slice/crio-335db7efd02552e81fc9a64fc862dc1a6989eeb880718c147e62fd32052fb6a9 WatchSource:0}: Error finding container 335db7efd02552e81fc9a64fc862dc1a6989eeb880718c147e62fd32052fb6a9: Status 404 returned error can't find the container with id 335db7efd02552e81fc9a64fc862dc1a6989eeb880718c147e62fd32052fb6a9 Jul 08 18:58:54.442212 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.442186 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xg5dz" Jul 08 18:58:54.444481 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:54.444427 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74bebf1f_0175_47fe_be43_314ad803cf63.slice/crio-0c65159476d8e9e04a4a43ee53b682d0eae8c1ae0a28c8b7c55cb3680a6efaac WatchSource:0}: Error finding container 0c65159476d8e9e04a4a43ee53b682d0eae8c1ae0a28c8b7c55cb3680a6efaac: Status 404 returned error can't find the container with id 0c65159476d8e9e04a4a43ee53b682d0eae8c1ae0a28c8b7c55cb3680a6efaac Jul 08 18:58:54.449135 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.449113 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" Jul 08 18:58:54.456347 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.456321 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p7px9" Jul 08 18:58:54.464439 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:58:54.464385 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f1f29a_4edb_4a20_b932_dbdfd56d5ce2.slice/crio-c2b1ae1532988b4eeaa860c90c524a63066fb9c3ad9cbffefffbdf39b97145e7 WatchSource:0}: Error finding container c2b1ae1532988b4eeaa860c90c524a63066fb9c3ad9cbffefffbdf39b97145e7: Status 404 returned error can't find the container with id c2b1ae1532988b4eeaa860c90c524a63066fb9c3ad9cbffefffbdf39b97145e7 Jul 08 18:58:54.786393 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.786301 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:58:54.786562 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.786415 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:58:54.786562 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.786483 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:58:54.786562 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.786503 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:58:54.786562 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.786560 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs podName:9c146ab4-0d07-4951-9d48-bfff5ab7acef nodeName:}" failed. No retries permitted until 2026-07-08 18:58:55.78653955 +0000 UTC m=+4.178686329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs") pod "network-metrics-daemon-k4pww" (UID: "9c146ab4-0d07-4951-9d48-bfff5ab7acef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:58:54.786855 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.786580 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret podName:c425d240-601b-44d7-8185-7b4e5f80b9be nodeName:}" failed. No retries permitted until 2026-07-08 18:58:55.786571881 +0000 UTC m=+4.178718649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret") pod "global-pull-secret-syncer-7jmds" (UID: "c425d240-601b-44d7-8185-7b4e5f80b9be") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:58:54.887068 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:54.887034 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnvr2\" (UniqueName: \"kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2\") pod \"network-check-target-5zw8l\" (UID: \"c1ce3bf0-78da-4542-81fa-0dccea93ae8c\") " pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:58:54.887263 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.887206 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:58:54.887263 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.887230 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:58:54.887263 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.887240 2574 projected.go:196] Error preparing data for projected volume kube-api-access-fnvr2 for pod openshift-network-diagnostics/network-check-target-5zw8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:58:54.887436 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:54.887296 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2 podName:c1ce3bf0-78da-4542-81fa-0dccea93ae8c nodeName:}" failed. No retries permitted until 2026-07-08 18:58:55.88728137 +0000 UTC m=+4.279428136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnvr2" (UniqueName: "kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2") pod "network-check-target-5zw8l" (UID: "c1ce3bf0-78da-4542-81fa-0dccea93ae8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:58:55.181746 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.181650 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:53:54 +0000 UTC" deadline="2028-02-07 12:37:25.312978327 +0000 UTC" Jul 08 18:58:55.181746 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.181687 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13889h38m30.13129436s" Jul 08 18:58:55.219301 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.219260 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:58:55.219494 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:55.219438 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:58:55.229598 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.229557 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s9c56" event={"ID":"bf533b5c-6379-40d6-bd6d-1cf429b2ef2e","Type":"ContainerStarted","Data":"73a4544d8c30fc3c2b2e61c56f2bdf38816a6a11ebbbcfe45c50fc36be8a34e4"} Jul 08 18:58:55.230884 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.230852 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p7px9" event={"ID":"fa3a6023-79bf-4124-91a9-68653cd84334","Type":"ContainerStarted","Data":"8961973df09d4c01e17bd72421f1555e00be58365f765c097f0028e5438f5af1"} Jul 08 18:58:55.232126 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.232088 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" event={"ID":"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2","Type":"ContainerStarted","Data":"c2b1ae1532988b4eeaa860c90c524a63066fb9c3ad9cbffefffbdf39b97145e7"} Jul 08 18:58:55.236781 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.236746 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xg5dz" event={"ID":"8db410ea-9a2a-4463-a5f6-dfb2c25515e6","Type":"ContainerStarted","Data":"33d12bd6323d8bed8e1205be789fc5d2be200e39482db1dfcdd828f2b633c9e7"} Jul 08 18:58:55.238063 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.238034 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nfnb5" event={"ID":"3d7ed295-ebb1-4990-ad40-567f040e2578","Type":"ContainerStarted","Data":"335db7efd02552e81fc9a64fc862dc1a6989eeb880718c147e62fd32052fb6a9"} Jul 08 18:58:55.239390 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.239362 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zbbm7" event={"ID":"feb81d8c-4f54-436a-9b05-094323099754","Type":"ContainerStarted","Data":"e5a01202ac8d34deba936b27ac685818f8541f1a6365dab036d0098c87c34246"} Jul 08 18:58:55.240646 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.240623 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jggch" event={"ID":"14160c19-e852-417e-beee-1bd3f869f339","Type":"ContainerStarted","Data":"d0d6752c63e72789dabe6ec94cd5fc2b5e849d989c2c24739453c1ed182d4bfb"} Jul 08 18:58:55.241841 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.241813 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" event={"ID":"97ea550b-8abd-4bf7-bc8a-96ed573c95f4","Type":"ContainerStarted","Data":"8074dc57806035f5f36e5334e1dd6fb6d63010ddc157d45ea1171bfe727e1d29"} Jul 08 18:58:55.243073 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.243046 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" event={"ID":"74bebf1f-0175-47fe-be43-314ad803cf63","Type":"ContainerStarted","Data":"0c65159476d8e9e04a4a43ee53b682d0eae8c1ae0a28c8b7c55cb3680a6efaac"} Jul 08 18:58:55.795590 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.795546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:58:55.795798 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.795623 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:58:55.795798 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:55.795788 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:58:55.795913 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:55.795855 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs podName:9c146ab4-0d07-4951-9d48-bfff5ab7acef nodeName:}" failed. No retries permitted until 2026-07-08 18:58:57.795835259 +0000 UTC m=+6.187982029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs") pod "network-metrics-daemon-k4pww" (UID: "9c146ab4-0d07-4951-9d48-bfff5ab7acef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:58:55.795980 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:55.795936 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:58:55.796033 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:55.795980 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret podName:c425d240-601b-44d7-8185-7b4e5f80b9be nodeName:}" failed. No retries permitted until 2026-07-08 18:58:57.795966617 +0000 UTC m=+6.188113407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret") pod "global-pull-secret-syncer-7jmds" (UID: "c425d240-601b-44d7-8185-7b4e5f80b9be") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:58:55.896016 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:55.895969 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnvr2\" (UniqueName: \"kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2\") pod \"network-check-target-5zw8l\" (UID: \"c1ce3bf0-78da-4542-81fa-0dccea93ae8c\") " pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:58:55.896220 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:55.896184 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:58:55.896220 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:55.896203 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:58:55.896220 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:55.896217 2574 projected.go:196] Error preparing data for projected volume kube-api-access-fnvr2 for pod openshift-network-diagnostics/network-check-target-5zw8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:58:55.896423 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:55.896281 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2 podName:c1ce3bf0-78da-4542-81fa-0dccea93ae8c nodeName:}" failed. No retries permitted until 2026-07-08 18:58:57.896259863 +0000 UTC m=+6.288406657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnvr2" (UniqueName: "kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2") pod "network-check-target-5zw8l" (UID: "c1ce3bf0-78da-4542-81fa-0dccea93ae8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:58:56.182947 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:56.182685 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:53:54 +0000 UTC" deadline="2027-12-16 17:16:01.33059466 +0000 UTC" Jul 08 18:58:56.182947 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:56.182948 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12622h17m5.147652867s" Jul 08 18:58:56.219244 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:56.219216 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:58:56.219441 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:56.219370 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:58:56.219949 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:56.219926 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:58:56.220059 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:56.220031 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:58:56.250815 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:56.250746 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-189.ec2.internal" event={"ID":"8179e64f56bafcea70993a6654313ec4","Type":"ContainerStarted","Data":"5dc43edd9e50bdd386d61a02693fef92ac9abefa01b7b80c822085ba34abe5b2"} Jul 08 18:58:56.272616 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:56.271753 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-189.ec2.internal" podStartSLOduration=3.271731927 podStartE2EDuration="3.271731927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:58:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:58:56.270090023 +0000 UTC m=+4.662236811" watchObservedRunningTime="2026-07-08 18:58:56.271731927 +0000 UTC m=+4.663878716" Jul 08 18:58:57.219471 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:57.219380 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:58:57.219926 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:57.219521 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:58:57.267361 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:57.266649 2574 generic.go:356] "Generic (PLEG): container finished" podID="5400be6aab20143e36fa75476b73c789" containerID="0d63fb4e387999e2c7eae7d5493b0d044dff128d02b20bfec4a17f3394926f48" exitCode=0 Jul 08 18:58:57.267948 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:57.267652 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal" event={"ID":"5400be6aab20143e36fa75476b73c789","Type":"ContainerDied","Data":"0d63fb4e387999e2c7eae7d5493b0d044dff128d02b20bfec4a17f3394926f48"} Jul 08 18:58:57.811418 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:57.811351 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:58:57.811572 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:57.811430 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:58:57.811633 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:57.811591 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:58:57.811674 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:57.811658 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs podName:9c146ab4-0d07-4951-9d48-bfff5ab7acef nodeName:}" failed. No retries permitted until 2026-07-08 18:59:01.811638533 +0000 UTC m=+10.203785302 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs") pod "network-metrics-daemon-k4pww" (UID: "9c146ab4-0d07-4951-9d48-bfff5ab7acef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:58:57.812202 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:57.812071 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:58:57.812202 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:57.812125 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret podName:c425d240-601b-44d7-8185-7b4e5f80b9be nodeName:}" failed. No retries permitted until 2026-07-08 18:59:01.812109797 +0000 UTC m=+10.204256567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret") pod "global-pull-secret-syncer-7jmds" (UID: "c425d240-601b-44d7-8185-7b4e5f80b9be") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:58:57.911826 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:57.911785 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnvr2\" (UniqueName: \"kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2\") pod \"network-check-target-5zw8l\" (UID: \"c1ce3bf0-78da-4542-81fa-0dccea93ae8c\") " pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:58:57.912052 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:57.912033 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:58:57.912116 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:57.912059 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:58:57.912116 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:57.912073 2574 projected.go:196] Error preparing data for projected volume kube-api-access-fnvr2 for pod openshift-network-diagnostics/network-check-target-5zw8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:58:57.912225 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:57.912132 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2 podName:c1ce3bf0-78da-4542-81fa-0dccea93ae8c nodeName:}" failed. No retries permitted until 2026-07-08 18:59:01.912114007 +0000 UTC m=+10.304260791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnvr2" (UniqueName: "kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2") pod "network-check-target-5zw8l" (UID: "c1ce3bf0-78da-4542-81fa-0dccea93ae8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:58:58.219505 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:58.219422 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:58:58.219981 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:58.219550 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:58:58.222023 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:58.221999 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:58:58.222168 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:58.222110 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:58:59.219219 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:58:59.219129 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:58:59.219415 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:58:59.219276 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:00.218730 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:00.218577 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:00.218730 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:00.218616 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:00.218730 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:00.218722 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:00.219313 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:00.218819 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:01.219300 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:01.219266 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:01.219812 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:01.219432 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:01.846915 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:01.846826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:01.846915 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:01.846892 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:01.847124 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:01.847035 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:59:01.847124 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:01.847106 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs podName:9c146ab4-0d07-4951-9d48-bfff5ab7acef nodeName:}" failed. No retries permitted until 2026-07-08 18:59:09.847088126 +0000 UTC m=+18.239234914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs") pod "network-metrics-daemon-k4pww" (UID: "9c146ab4-0d07-4951-9d48-bfff5ab7acef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:59:01.847228 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:01.847035 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:59:01.847228 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:01.847189 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret podName:c425d240-601b-44d7-8185-7b4e5f80b9be nodeName:}" failed. No retries permitted until 2026-07-08 18:59:09.847177033 +0000 UTC m=+18.239323812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret") pod "global-pull-secret-syncer-7jmds" (UID: "c425d240-601b-44d7-8185-7b4e5f80b9be") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:59:01.947511 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:01.947472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnvr2\" (UniqueName: \"kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2\") pod \"network-check-target-5zw8l\" (UID: \"c1ce3bf0-78da-4542-81fa-0dccea93ae8c\") " pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:01.947676 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:01.947661 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:59:01.947728 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:01.947689 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:59:01.947728 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:01.947704 2574 projected.go:196] Error preparing data for projected volume kube-api-access-fnvr2 for pod openshift-network-diagnostics/network-check-target-5zw8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:59:01.947817 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:01.947766 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2 podName:c1ce3bf0-78da-4542-81fa-0dccea93ae8c nodeName:}" failed. No retries permitted until 2026-07-08 18:59:09.947740642 +0000 UTC m=+18.339887449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnvr2" (UniqueName: "kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2") pod "network-check-target-5zw8l" (UID: "c1ce3bf0-78da-4542-81fa-0dccea93ae8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:59:02.219626 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:02.219536 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:02.220101 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:02.219666 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:02.220101 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:02.219690 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:02.220101 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:02.219835 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:03.219315 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:03.219273 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:03.219509 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:03.219417 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:04.219089 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:04.219051 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:04.219620 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:04.219191 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:04.219620 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:04.219051 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:04.219620 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:04.219294 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:05.218800 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:05.218772 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:05.218931 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:05.218904 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:05.296970 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:05.296893 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal" event={"ID":"5400be6aab20143e36fa75476b73c789","Type":"ContainerStarted","Data":"25466f35174eee4f2b0454f128fc59268683011a979ad853bc56784e6871eaad"} Jul 08 18:59:06.219067 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.218885 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:06.219262 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.218949 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:06.219262 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:06.219215 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:06.219422 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:06.219363 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:06.300503 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.300463 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xg5dz" event={"ID":"8db410ea-9a2a-4463-a5f6-dfb2c25515e6","Type":"ContainerStarted","Data":"e85ab49b622c5da2d2cbcdb03e7bd3c3252bbffe31f62c412bb554b11af8fef6"} Jul 08 18:59:06.302387 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.302358 2574 generic.go:356] "Generic (PLEG): container finished" podID="14160c19-e852-417e-beee-1bd3f869f339" containerID="bc134a38eb19d88db0582d0fc759a38a045dc2555ff481f0809176991aa8307b" exitCode=0 Jul 08 18:59:06.302512 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.302428 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jggch" event={"ID":"14160c19-e852-417e-beee-1bd3f869f339","Type":"ContainerDied","Data":"bc134a38eb19d88db0582d0fc759a38a045dc2555ff481f0809176991aa8307b"} Jul 08 18:59:06.304152 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.304116 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" event={"ID":"97ea550b-8abd-4bf7-bc8a-96ed573c95f4","Type":"ContainerStarted","Data":"0889827acdee603b46d64e00d9696a2fd448fb0f6080e91ca4d0d1a53b9d2126"} Jul 08 18:59:06.305885 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.305852 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s9c56" event={"ID":"bf533b5c-6379-40d6-bd6d-1cf429b2ef2e","Type":"ContainerStarted","Data":"d94efe2dae6f979bcf4e9bad2a4ee4f120ec23a79ab161ed0cd4c560e063a4ee"} Jul 08 18:59:06.307380 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.307360 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p7px9" event={"ID":"fa3a6023-79bf-4124-91a9-68653cd84334","Type":"ContainerStarted","Data":"c51a11e113c160e8b789d157ace32f5ea4aaa76641b1a6b72052d1bd78ad0991"} Jul 08 18:59:06.309124 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.309097 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" event={"ID":"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2","Type":"ContainerStarted","Data":"40fbed2073c5e9447ea47a6d91461d6a92802cd6b3dd20789e28b92b0f4c7128"} Jul 08 18:59:06.319038 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.318990 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xg5dz" podStartSLOduration=4.005707838 podStartE2EDuration="14.318975199s" totalImagesPullingTime="10.313267361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:06.318617794 +0000 UTC m=+14.710764583" watchObservedRunningTime="2026-07-08 18:59:06.318975199 +0000 UTC m=+14.711121988" Jul 08 18:59:06.335634 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.335573 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s9c56" podStartSLOduration=3.520251071 podStartE2EDuration="14.335551897s" totalImagesPullingTime="10.815300826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:06.33544292 +0000 UTC m=+14.727589711" watchObservedRunningTime="2026-07-08 18:59:06.335551897 +0000 UTC m=+14.727698685" Jul 08 18:59:06.375201 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.375145 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-189.ec2.internal" podStartSLOduration=13.375124609 podStartE2EDuration="13.375124609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:58:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:06.374382347 +0000 UTC m=+14.766529159" watchObservedRunningTime="2026-07-08 18:59:06.375124609 +0000 UTC m=+14.767271398" Jul 08 18:59:06.393195 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.392949 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6j4kq" podStartSLOduration=3.656277605 podStartE2EDuration="14.392932893s" totalImagesPullingTime="10.736655288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:06.392566928 +0000 UTC m=+14.784713743" watchObservedRunningTime="2026-07-08 18:59:06.392932893 +0000 UTC m=+14.785079682" Jul 08 18:59:06.807401 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.807298 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xg5dz" Jul 08 18:59:06.808097 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.808075 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xg5dz" Jul 08 18:59:06.828283 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:06.828229 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p7px9" podStartSLOduration=4.175920082 podStartE2EDuration="14.828206443s" totalImagesPullingTime="10.652286361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:06.411400833 +0000 UTC m=+14.803547649" watchObservedRunningTime="2026-07-08 18:59:06.828206443 +0000 UTC m=+15.220353253" Jul 08 18:59:07.219289 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:07.219208 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:07.219478 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:07.219376 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:07.315486 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:07.315414 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nfnb5" event={"ID":"3d7ed295-ebb1-4990-ad40-567f040e2578","Type":"ContainerStarted","Data":"eabb7348a2afb3961f9ab4e9cd28daa47433d18d97e14f7ad1076a809866ba99"} Jul 08 18:59:07.316537 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:07.316516 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xg5dz" Jul 08 18:59:07.316828 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:07.316808 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xg5dz" Jul 08 18:59:07.334036 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:07.333981 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nfnb5" podStartSLOduration=4.640426437 podStartE2EDuration="15.333960531s" totalImagesPullingTime="10.693534094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:07.333219215 +0000 UTC m=+15.725366005" watchObservedRunningTime="2026-07-08 18:59:07.333960531 +0000 UTC m=+15.726107320" Jul 08 18:59:08.218569 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:08.218528 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:08.218756 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:08.218528 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:08.218756 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:08.218651 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:08.218756 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:08.218726 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:09.219466 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:09.219431 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:09.220082 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:09.219562 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:09.916284 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:09.916244 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:09.916474 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:09.916312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:09.916474 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:09.916433 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:59:09.916597 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:09.916442 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:59:09.916597 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:09.916509 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret podName:c425d240-601b-44d7-8185-7b4e5f80b9be nodeName:}" failed. No retries permitted until 2026-07-08 18:59:25.916488171 +0000 UTC m=+34.308634936 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret") pod "global-pull-secret-syncer-7jmds" (UID: "c425d240-601b-44d7-8185-7b4e5f80b9be") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:59:09.916597 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:09.916537 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs podName:9c146ab4-0d07-4951-9d48-bfff5ab7acef nodeName:}" failed. No retries permitted until 2026-07-08 18:59:25.916524456 +0000 UTC m=+34.308671235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs") pod "network-metrics-daemon-k4pww" (UID: "9c146ab4-0d07-4951-9d48-bfff5ab7acef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:59:10.017116 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:10.017068 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnvr2\" (UniqueName: \"kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2\") pod \"network-check-target-5zw8l\" (UID: \"c1ce3bf0-78da-4542-81fa-0dccea93ae8c\") " pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:10.017306 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:10.017209 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:59:10.017306 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:10.017224 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:59:10.017306 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:10.017234 2574 projected.go:196] Error preparing data for projected volume kube-api-access-fnvr2 for pod openshift-network-diagnostics/network-check-target-5zw8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:59:10.017306 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:10.017291 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2 podName:c1ce3bf0-78da-4542-81fa-0dccea93ae8c nodeName:}" failed. No retries permitted until 2026-07-08 18:59:26.017276354 +0000 UTC m=+34.409423122 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnvr2" (UniqueName: "kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2") pod "network-check-target-5zw8l" (UID: "c1ce3bf0-78da-4542-81fa-0dccea93ae8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:59:10.219176 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:10.219097 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:10.219300 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:10.219206 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:10.219300 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:10.219262 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:10.219408 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:10.219386 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:11.218834 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:11.218623 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:11.219424 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:11.218936 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:12.220498 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:12.220461 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:12.220914 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:12.220582 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:12.220914 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:12.220638 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:12.220914 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:12.220741 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:13.219267 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:13.219233 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:13.219470 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:13.219387 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:14.219229 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:14.219155 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:14.219229 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:14.219156 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:14.219964 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:14.219304 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:14.219964 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:14.219409 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:15.118220 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:15.118191 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 18:59:15.137147 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:15.137064 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T18:59:15.118214932Z","UUID":"87849019-52e1-4ab7-b80a-8e43063dfecd","Handler":null,"Name":"","Endpoint":""} Jul 08 18:59:15.138798 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:15.138769 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 18:59:15.138909 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:15.138807 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 18:59:15.219151 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:15.218980 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:15.219312 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:15.219258 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:15.337317 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:15.337274 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" event={"ID":"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2","Type":"ContainerStarted","Data":"0c296cc2ea6d4c6bb958210c06fc40ed48ba1c65079e7103cfbafe4bbc1e7d3e"} Jul 08 18:59:15.338973 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:15.338946 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zbbm7" event={"ID":"feb81d8c-4f54-436a-9b05-094323099754","Type":"ContainerStarted","Data":"01ed8a0cb5759bf61b5cf32f28762ed068f08871c50ca99019aa6b0cfdcb9643"} Jul 08 18:59:15.342036 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:15.341997 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" event={"ID":"74bebf1f-0175-47fe-be43-314ad803cf63","Type":"ContainerStarted","Data":"c4e0d08f184c4eeb89b20082ba1a6bb309fb85869dab71338d6df49c4cc43505"} Jul 08 18:59:15.342156 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:15.342068 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" event={"ID":"74bebf1f-0175-47fe-be43-314ad803cf63","Type":"ContainerStarted","Data":"e6da52ba9c0893a9aaef8a38dd39a12fdbfb6304d751a9ff6ff073e7e559bf28"} Jul 08 18:59:15.342156 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:15.342119 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" event={"ID":"74bebf1f-0175-47fe-be43-314ad803cf63","Type":"ContainerStarted","Data":"26b2e4827efe6a65f34515802d99fe5aa9eda934ca25be53731375b0ff3c5bfc"} Jul 08 18:59:15.361194 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:15.361148 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zbbm7" podStartSLOduration=2.7605466180000002 podStartE2EDuration="23.361130522s" totalImagesPullingTime="20.600583904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:15.360465884 +0000 UTC m=+23.752612674" watchObservedRunningTime="2026-07-08 18:59:15.361130522 +0000 UTC m=+23.753277309" Jul 08 18:59:16.218659 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:16.218619 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:16.218857 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:16.218627 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:16.218857 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:16.218754 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:16.218857 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:16.218819 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:16.347551 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:16.347497 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" event={"ID":"74bebf1f-0175-47fe-be43-314ad803cf63","Type":"ContainerStarted","Data":"1755d87398ce7fd6fe848434376d30b5c9a76b9e69afc8720894b270e7729786"} Jul 08 18:59:16.348015 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:16.347645 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" event={"ID":"74bebf1f-0175-47fe-be43-314ad803cf63","Type":"ContainerStarted","Data":"c67edae2b4c597bc909bf5b180f2fc2d01c437dae8f5dabaf936812056068904"} Jul 08 18:59:16.348015 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:16.347701 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" event={"ID":"74bebf1f-0175-47fe-be43-314ad803cf63","Type":"ContainerStarted","Data":"d2657f12b5b8a5dd5057a2b984927d501df1b79e69874156ddde6a435699e877"} Jul 08 18:59:17.219267 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:17.219234 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:17.219438 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:17.219373 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:18.219212 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:18.219181 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:18.219733 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:18.219181 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:18.219733 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:18.219317 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:18.219733 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:18.219410 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:18.355186 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:18.355111 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" event={"ID":"91f1f29a-4edb-4a20-b932-dbdfd56d5ce2","Type":"ContainerStarted","Data":"fadbf8178bcb78ac25d43064a16d91e6d8819ebf6fbde8320f954ca1170e0633"} Jul 08 18:59:18.357064 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:18.357035 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jggch" event={"ID":"14160c19-e852-417e-beee-1bd3f869f339","Type":"ContainerStarted","Data":"c6f28927ca895d696c516eaea24d48c75ce46d20f7ddb95c8c63dd4ef670d06e"} Jul 08 18:59:18.360157 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:18.360133 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" event={"ID":"74bebf1f-0175-47fe-be43-314ad803cf63","Type":"ContainerStarted","Data":"5ba8a8ad579c6ceb30bb1732e9163226b4c13d335c33160bfb61ba23f74db17a"} Jul 08 18:59:18.380175 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:18.380127 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f59hx" podStartSLOduration=3.144803305 podStartE2EDuration="26.380112386s" totalImagesPullingTime="23.235309081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:58:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:18.379852219 +0000 UTC m=+26.771999028" watchObservedRunningTime="2026-07-08 18:59:18.380112386 +0000 UTC m=+26.772259173" Jul 08 18:59:19.219227 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:19.219193 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:19.219761 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:19.219303 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:19.364020 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:19.363982 2574 generic.go:356] "Generic (PLEG): container finished" podID="14160c19-e852-417e-beee-1bd3f869f339" containerID="c6f28927ca895d696c516eaea24d48c75ce46d20f7ddb95c8c63dd4ef670d06e" exitCode=0 Jul 08 18:59:19.364186 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:19.364065 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jggch" event={"ID":"14160c19-e852-417e-beee-1bd3f869f339","Type":"ContainerDied","Data":"c6f28927ca895d696c516eaea24d48c75ce46d20f7ddb95c8c63dd4ef670d06e"} Jul 08 18:59:20.219160 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:20.219118 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:20.219363 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:20.219249 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:20.219363 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:20.219306 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:20.219809 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:20.219435 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:21.219147 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:21.218905 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:21.219290 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:21.219173 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:21.370452 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:21.370418 2574 generic.go:356] "Generic (PLEG): container finished" podID="14160c19-e852-417e-beee-1bd3f869f339" containerID="55483ecd839fc63758c045a566a77358589a8764278a9d0b7347214d599d5dd1" exitCode=0 Jul 08 18:59:21.370930 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:21.370506 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jggch" event={"ID":"14160c19-e852-417e-beee-1bd3f869f339","Type":"ContainerDied","Data":"55483ecd839fc63758c045a566a77358589a8764278a9d0b7347214d599d5dd1"} Jul 08 18:59:21.374133 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:21.374112 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" event={"ID":"74bebf1f-0175-47fe-be43-314ad803cf63","Type":"ContainerStarted","Data":"9124f10507c5b36c9b26f573b3d18b6a40b8f8e4ca03dc1f3c9677676ee87e59"} Jul 08 18:59:21.374375 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:21.374359 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:59:21.374438 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:21.374417 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:59:21.389562 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:21.389533 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:59:21.421595 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:21.421550 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" podStartSLOduration=8.811372868 podStartE2EDuration="29.421534702s" totalImagesPullingTime="20.610161834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:21.420533453 +0000 UTC m=+29.812680254" watchObservedRunningTime="2026-07-08 18:59:21.421534702 +0000 UTC m=+29.813681472" Jul 08 18:59:22.220140 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:22.220100 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:22.220349 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:22.220215 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:22.220349 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:22.220271 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:22.220433 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:22.220380 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:22.376917 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:22.376886 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:59:22.392642 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:22.392618 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:59:22.545736 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:22.545652 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7jmds"] Jul 08 18:59:22.545880 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:22.545749 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:22.545880 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:22.545856 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:22.548636 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:22.548608 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5zw8l"] Jul 08 18:59:22.548763 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:22.548683 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:22.548763 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:22.548753 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:22.551570 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:22.551548 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k4pww"] Jul 08 18:59:22.551682 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:22.551657 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:22.551793 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:22.551774 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:23.383786 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:23.383749 2574 generic.go:356] "Generic (PLEG): container finished" podID="14160c19-e852-417e-beee-1bd3f869f339" containerID="0eb82e2f822ff4e3b54ef1a86edb59077420bc878e0db998915942a54714c527" exitCode=0 Jul 08 18:59:23.384167 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:23.383788 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jggch" event={"ID":"14160c19-e852-417e-beee-1bd3f869f339","Type":"ContainerDied","Data":"0eb82e2f822ff4e3b54ef1a86edb59077420bc878e0db998915942a54714c527"} Jul 08 18:59:24.219203 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:24.219162 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:24.219384 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:24.219166 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:24.219384 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:24.219270 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:24.219384 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:24.219361 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:24.219384 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:24.219166 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:24.219580 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:24.219450 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:25.934861 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:25.934579 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:25.935360 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:25.934914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:25.935360 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:25.934742 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:59:25.935360 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:25.935005 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret podName:c425d240-601b-44d7-8185-7b4e5f80b9be nodeName:}" failed. No retries permitted until 2026-07-08 18:59:57.934982745 +0000 UTC m=+66.327129543 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret") pod "global-pull-secret-syncer-7jmds" (UID: "c425d240-601b-44d7-8185-7b4e5f80b9be") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:59:25.935360 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:25.935071 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:59:25.935360 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:25.935128 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs podName:9c146ab4-0d07-4951-9d48-bfff5ab7acef nodeName:}" failed. No retries permitted until 2026-07-08 18:59:57.935111934 +0000 UTC m=+66.327258714 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs") pod "network-metrics-daemon-k4pww" (UID: "9c146ab4-0d07-4951-9d48-bfff5ab7acef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:59:26.036042 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:26.036006 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnvr2\" (UniqueName: \"kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2\") pod \"network-check-target-5zw8l\" (UID: \"c1ce3bf0-78da-4542-81fa-0dccea93ae8c\") " pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:26.036187 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:26.036164 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:59:26.036187 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:26.036187 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:59:26.036249 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:26.036196 2574 projected.go:196] Error preparing data for projected volume kube-api-access-fnvr2 for pod openshift-network-diagnostics/network-check-target-5zw8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:59:26.036306 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:26.036250 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2 podName:c1ce3bf0-78da-4542-81fa-0dccea93ae8c nodeName:}" failed. No retries permitted until 2026-07-08 18:59:58.036236062 +0000 UTC m=+66.428382827 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnvr2" (UniqueName: "kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2") pod "network-check-target-5zw8l" (UID: "c1ce3bf0-78da-4542-81fa-0dccea93ae8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:59:26.219625 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:26.219519 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:26.219789 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:26.219519 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:26.219789 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:26.219682 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:26.219885 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:26.219661 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:26.219885 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:26.219799 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:26.220169 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:26.219897 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:28.219285 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.219251 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:28.219744 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.219250 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:28.219744 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:28.219412 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jmds" podUID="c425d240-601b-44d7-8185-7b4e5f80b9be" Jul 08 18:59:28.219744 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.219250 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:28.219744 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:28.219467 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 18:59:28.219744 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:28.219549 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zw8l" podUID="c1ce3bf0-78da-4542-81fa-0dccea93ae8c" Jul 08 18:59:28.944505 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.944473 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-189.ec2.internal" event="NodeReady" Jul 08 18:59:28.944677 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.944642 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 18:59:28.980868 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.980561 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-qxslq"] Jul 08 18:59:28.985921 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.985879 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b8b77d9f4-kz6lg"] Jul 08 18:59:28.986083 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.986018 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 18:59:28.988516 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.988487 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bwhqh\"" Jul 08 18:59:28.988516 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.988496 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 08 18:59:28.988680 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.988539 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 08 18:59:28.989165 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.989146 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:28.991457 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.991435 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 18:59:28.991730 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.991708 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 18:59:28.991839 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.991708 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2n9mw\"" Jul 08 18:59:28.992071 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.992043 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 18:59:28.998150 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:28.997888 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-qxslq"] Jul 08 18:59:29.002667 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.000941 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-thtdt"] Jul 08 18:59:29.003635 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.003593 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 18:59:29.005145 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.005125 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b8b77d9f4-kz6lg"] Jul 08 18:59:29.005250 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.005219 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-thtdt" Jul 08 18:59:29.007808 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.007790 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 18:59:29.008559 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.008394 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hs7p8\"" Jul 08 18:59:29.008559 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.008512 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 18:59:29.008871 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.008828 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 18:59:29.008962 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.008831 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v5gbg"] Jul 08 18:59:29.012281 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.012244 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-thtdt"] Jul 08 18:59:29.012402 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.012378 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:29.014686 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.014668 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 18:59:29.014845 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.014830 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-97fdz\"" Jul 08 18:59:29.014903 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.014851 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 18:59:29.022515 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.022489 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v5gbg"] Jul 08 18:59:29.161170 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161130 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93793458-6e1c-40f3-90ab-f52bb5c6cb66-trusted-ca\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.161170 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:29.161427 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.161427 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161220 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93793458-6e1c-40f3-90ab-f52bb5c6cb66-installation-pull-secrets\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.161427 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161304 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 18:59:29.161427 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161413 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs7vl\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-kube-api-access-xs7vl\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.161624 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-bound-sa-token\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.161624 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-tmp-dir\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:29.161624 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161528 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-config-volume\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:29.161624 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161551 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqbwn\" (UniqueName: \"kubernetes.io/projected/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-kube-api-access-hqbwn\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:29.161624 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161574 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6040d8e3-4ec5-4988-8f52-2df87ad31a3e-cert\") pod \"ingress-canary-thtdt\" (UID: \"6040d8e3-4ec5-4988-8f52-2df87ad31a3e\") " pod="openshift-ingress-canary/ingress-canary-thtdt" Jul 08 18:59:29.161794 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161658 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 18:59:29.161794 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161690 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93793458-6e1c-40f3-90ab-f52bb5c6cb66-ca-trust-extracted\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.161794 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161726 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93793458-6e1c-40f3-90ab-f52bb5c6cb66-image-registry-private-configuration\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.161794 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161754 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-certificates\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.161794 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.161779 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfvn8\" (UniqueName: \"kubernetes.io/projected/6040d8e3-4ec5-4988-8f52-2df87ad31a3e-kube-api-access-cfvn8\") pod \"ingress-canary-thtdt\" (UID: \"6040d8e3-4ec5-4988-8f52-2df87ad31a3e\") " pod="openshift-ingress-canary/ingress-canary-thtdt" Jul 08 18:59:29.262399 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.262364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93793458-6e1c-40f3-90ab-f52bb5c6cb66-image-registry-private-configuration\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.262399 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.262402 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-certificates\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.263021 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.262418 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfvn8\" (UniqueName: \"kubernetes.io/projected/6040d8e3-4ec5-4988-8f52-2df87ad31a3e-kube-api-access-cfvn8\") pod \"ingress-canary-thtdt\" (UID: \"6040d8e3-4ec5-4988-8f52-2df87ad31a3e\") " pod="openshift-ingress-canary/ingress-canary-thtdt" Jul 08 18:59:29.263021 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.262538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93793458-6e1c-40f3-90ab-f52bb5c6cb66-trusted-ca\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.263021 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.262573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:29.263021 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.262602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.263021 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.262627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93793458-6e1c-40f3-90ab-f52bb5c6cb66-installation-pull-secrets\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.263021 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.262655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 18:59:29.263021 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.262705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs7vl\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-kube-api-access-xs7vl\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.263021 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.262748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-bound-sa-token\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.263021 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.262770 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-tmp-dir\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:29.263021 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:29.262828 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:59:29.263021 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:29.262843 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8b77d9f4-kz6lg: secret "image-registry-tls" not found Jul 08 18:59:29.263021 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:29.262895 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls podName:93793458-6e1c-40f3-90ab-f52bb5c6cb66 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:29.762876718 +0000 UTC m=+38.155023502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls") pod "image-registry-b8b77d9f4-kz6lg" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66") : secret "image-registry-tls" not found Jul 08 18:59:29.263021 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.262955 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-certificates\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.263654 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.263048 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-tmp-dir\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:29.263654 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:29.263076 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 18:59:29.263654 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.263112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-config-volume\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:29.263654 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:29.263137 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert podName:ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:29.763117421 +0000 UTC m=+38.155264193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-qxslq" (UID: "ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7") : secret "networking-console-plugin-cert" not found Jul 08 18:59:29.263654 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:29.263146 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:59:29.263654 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.263171 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqbwn\" (UniqueName: \"kubernetes.io/projected/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-kube-api-access-hqbwn\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:29.263654 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:29.263198 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls podName:f24b0dfb-3ed3-4236-ba0e-587f52eb5267 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:29.763183749 +0000 UTC m=+38.155330530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls") pod "dns-default-v5gbg" (UID: "f24b0dfb-3ed3-4236-ba0e-587f52eb5267") : secret "dns-default-metrics-tls" not found Jul 08 18:59:29.263654 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.263215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6040d8e3-4ec5-4988-8f52-2df87ad31a3e-cert\") pod \"ingress-canary-thtdt\" (UID: \"6040d8e3-4ec5-4988-8f52-2df87ad31a3e\") " pod="openshift-ingress-canary/ingress-canary-thtdt" Jul 08 18:59:29.263654 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.263260 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 18:59:29.263654 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.263294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93793458-6e1c-40f3-90ab-f52bb5c6cb66-ca-trust-extracted\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.263654 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.263639 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-config-volume\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:29.264229 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.263672 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93793458-6e1c-40f3-90ab-f52bb5c6cb66-ca-trust-extracted\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.264229 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.264061 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 18:59:29.264229 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.264170 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93793458-6e1c-40f3-90ab-f52bb5c6cb66-trusted-ca\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.267181 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.267155 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93793458-6e1c-40f3-90ab-f52bb5c6cb66-image-registry-private-configuration\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.267181 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.267166 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93793458-6e1c-40f3-90ab-f52bb5c6cb66-installation-pull-secrets\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.267810 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.267714 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6040d8e3-4ec5-4988-8f52-2df87ad31a3e-cert\") pod \"ingress-canary-thtdt\" (UID: \"6040d8e3-4ec5-4988-8f52-2df87ad31a3e\") " pod="openshift-ingress-canary/ingress-canary-thtdt" Jul 08 18:59:29.271952 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.271906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfvn8\" (UniqueName: \"kubernetes.io/projected/6040d8e3-4ec5-4988-8f52-2df87ad31a3e-kube-api-access-cfvn8\") pod \"ingress-canary-thtdt\" (UID: \"6040d8e3-4ec5-4988-8f52-2df87ad31a3e\") " pod="openshift-ingress-canary/ingress-canary-thtdt" Jul 08 18:59:29.272715 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.272672 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-bound-sa-token\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.272899 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.272874 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqbwn\" (UniqueName: \"kubernetes.io/projected/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-kube-api-access-hqbwn\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:29.273156 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.273139 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs7vl\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-kube-api-access-xs7vl\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.320941 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.320905 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-thtdt" Jul 08 18:59:29.500924 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.500748 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-thtdt"] Jul 08 18:59:29.553171 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:59:29.553085 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6040d8e3_4ec5_4988_8f52_2df87ad31a3e.slice/crio-1a3a2c645478ff3879e9ee87f6b91d1577766a3afccdc280d4a6a6b3a12a2474 WatchSource:0}: Error finding container 1a3a2c645478ff3879e9ee87f6b91d1577766a3afccdc280d4a6a6b3a12a2474: Status 404 returned error can't find the container with id 1a3a2c645478ff3879e9ee87f6b91d1577766a3afccdc280d4a6a6b3a12a2474 Jul 08 18:59:29.768573 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.768544 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:29.768700 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.768581 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:29.768700 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:29.768602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 18:59:29.768700 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:29.768692 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 18:59:29.768821 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:29.768698 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:59:29.768821 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:29.768737 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert podName:ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:30.768724815 +0000 UTC m=+39.160871582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-qxslq" (UID: "ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7") : secret "networking-console-plugin-cert" not found Jul 08 18:59:29.768821 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:29.768766 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls podName:f24b0dfb-3ed3-4236-ba0e-587f52eb5267 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:30.76875403 +0000 UTC m=+39.160900797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls") pod "dns-default-v5gbg" (UID: "f24b0dfb-3ed3-4236-ba0e-587f52eb5267") : secret "dns-default-metrics-tls" not found Jul 08 18:59:29.768821 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:29.768702 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:59:29.768821 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:29.768817 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8b77d9f4-kz6lg: secret "image-registry-tls" not found Jul 08 18:59:29.768978 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:29.768897 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls podName:93793458-6e1c-40f3-90ab-f52bb5c6cb66 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:30.768874601 +0000 UTC m=+39.161021409 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls") pod "image-registry-b8b77d9f4-kz6lg" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66") : secret "image-registry-tls" not found Jul 08 18:59:30.219165 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.219125 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:30.219382 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.219125 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:30.219382 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.219125 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:30.221828 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.221811 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 18:59:30.223132 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.223115 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gvgdf\"" Jul 08 18:59:30.223132 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.223130 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 18:59:30.223299 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.223131 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7bzch\"" Jul 08 18:59:30.223299 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.223115 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 18:59:30.223299 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.223244 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 18:59:30.403008 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.402977 2574 generic.go:356] "Generic (PLEG): container finished" podID="14160c19-e852-417e-beee-1bd3f869f339" containerID="e52bb049389219a96a034cc5f39fc4d1acd332a9d231587098d2432b83702eb0" exitCode=0 Jul 08 18:59:30.403609 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.403197 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jggch" event={"ID":"14160c19-e852-417e-beee-1bd3f869f339","Type":"ContainerDied","Data":"e52bb049389219a96a034cc5f39fc4d1acd332a9d231587098d2432b83702eb0"} Jul 08 18:59:30.407762 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.407740 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-thtdt" event={"ID":"6040d8e3-4ec5-4988-8f52-2df87ad31a3e","Type":"ContainerStarted","Data":"1a3a2c645478ff3879e9ee87f6b91d1577766a3afccdc280d4a6a6b3a12a2474"} Jul 08 18:59:30.777586 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.777493 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:30.777586 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.777541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:30.777586 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:30.777575 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 18:59:30.777863 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:30.777739 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:59:30.777863 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:30.777755 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8b77d9f4-kz6lg: secret "image-registry-tls" not found Jul 08 18:59:30.777863 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:30.777769 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:59:30.777863 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:30.777804 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 18:59:30.777863 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:30.777812 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls podName:93793458-6e1c-40f3-90ab-f52bb5c6cb66 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:32.777798201 +0000 UTC m=+41.169944986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls") pod "image-registry-b8b77d9f4-kz6lg" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66") : secret "image-registry-tls" not found Jul 08 18:59:30.777863 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:30.777866 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls podName:f24b0dfb-3ed3-4236-ba0e-587f52eb5267 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:32.777849638 +0000 UTC m=+41.169996403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls") pod "dns-default-v5gbg" (UID: "f24b0dfb-3ed3-4236-ba0e-587f52eb5267") : secret "dns-default-metrics-tls" not found Jul 08 18:59:30.778234 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:30.777882 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert podName:ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:32.777873375 +0000 UTC m=+41.170020145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-qxslq" (UID: "ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7") : secret "networking-console-plugin-cert" not found Jul 08 18:59:31.413958 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:31.413842 2574 generic.go:356] "Generic (PLEG): container finished" podID="14160c19-e852-417e-beee-1bd3f869f339" containerID="b8ea83ecea757a36cc0bae0d424d54dcef6aa7a3e16bf1e0affb7117088347be" exitCode=0 Jul 08 18:59:31.413958 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:31.413926 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jggch" event={"ID":"14160c19-e852-417e-beee-1bd3f869f339","Type":"ContainerDied","Data":"b8ea83ecea757a36cc0bae0d424d54dcef6aa7a3e16bf1e0affb7117088347be"} Jul 08 18:59:32.420953 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:32.420664 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jggch" event={"ID":"14160c19-e852-417e-beee-1bd3f869f339","Type":"ContainerStarted","Data":"f89dd31dc651c4909a965c3df204d7132ff3c68e95524973e3b757e284c1642c"} Jul 08 18:59:32.446887 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:32.446836 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jggch" podStartSLOduration=8.957799473 podStartE2EDuration="40.446819304s" totalImagesPullingTime="31.489019831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:58:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:32.446540489 +0000 UTC m=+40.838687306" watchObservedRunningTime="2026-07-08 18:59:32.446819304 +0000 UTC m=+40.838966092" Jul 08 18:59:32.793826 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:32.793789 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:32.793826 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:32.793832 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:32.794081 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:32.793854 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 18:59:32.794081 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:32.793965 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:59:32.794081 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:32.794046 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls podName:f24b0dfb-3ed3-4236-ba0e-587f52eb5267 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:36.794025265 +0000 UTC m=+45.186172035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls") pod "dns-default-v5gbg" (UID: "f24b0dfb-3ed3-4236-ba0e-587f52eb5267") : secret "dns-default-metrics-tls" not found Jul 08 18:59:32.794081 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:32.793968 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:59:32.794081 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:32.794071 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8b77d9f4-kz6lg: secret "image-registry-tls" not found Jul 08 18:59:32.794268 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:32.794115 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls podName:93793458-6e1c-40f3-90ab-f52bb5c6cb66 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:36.794104027 +0000 UTC m=+45.186250793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls") pod "image-registry-b8b77d9f4-kz6lg" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66") : secret "image-registry-tls" not found Jul 08 18:59:32.794268 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:32.793976 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 18:59:32.794268 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:32.794207 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert podName:ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:36.794187823 +0000 UTC m=+45.186334593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-qxslq" (UID: "ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7") : secret "networking-console-plugin-cert" not found Jul 08 18:59:33.424642 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:33.424606 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-thtdt" event={"ID":"6040d8e3-4ec5-4988-8f52-2df87ad31a3e","Type":"ContainerStarted","Data":"72977a75d557f637d9188022c3b04b11e2ef7bc8320526c0fb37faf909f4d43c"} Jul 08 18:59:33.447184 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:33.446571 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-thtdt" podStartSLOduration=1.7419477890000001 podStartE2EDuration="5.446547865s" totalImagesPullingTime="3.704600076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:33.445603275 +0000 UTC m=+41.837750086" watchObservedRunningTime="2026-07-08 18:59:33.446547865 +0000 UTC m=+41.838694654" Jul 08 18:59:36.820023 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:36.819983 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:36.820023 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:36.820032 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 18:59:36.820686 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:36.820101 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:36.820686 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:36.820192 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:59:36.820686 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:36.820197 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:59:36.820686 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:36.820215 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 18:59:36.820686 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:36.820257 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls podName:f24b0dfb-3ed3-4236-ba0e-587f52eb5267 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:44.820238667 +0000 UTC m=+53.212385444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls") pod "dns-default-v5gbg" (UID: "f24b0dfb-3ed3-4236-ba0e-587f52eb5267") : secret "dns-default-metrics-tls" not found Jul 08 18:59:36.820686 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:36.820221 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8b77d9f4-kz6lg: secret "image-registry-tls" not found Jul 08 18:59:36.820686 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:36.820278 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert podName:ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:44.820267059 +0000 UTC m=+53.212413834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-qxslq" (UID: "ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7") : secret "networking-console-plugin-cert" not found Jul 08 18:59:36.820686 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:36.820301 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls podName:93793458-6e1c-40f3-90ab-f52bb5c6cb66 nodeName:}" failed. No retries permitted until 2026-07-08 18:59:44.820283739 +0000 UTC m=+53.212430520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls") pod "image-registry-b8b77d9f4-kz6lg" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66") : secret "image-registry-tls" not found Jul 08 18:59:44.877039 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:44.876994 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 18:59:44.877039 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:44.877039 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 18:59:44.877519 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:44.877059 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 18:59:44.877519 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:44.877162 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 18:59:44.877519 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:44.877181 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:59:44.877519 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:44.877199 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8b77d9f4-kz6lg: secret "image-registry-tls" not found Jul 08 18:59:44.877519 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:44.877218 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert podName:ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7 nodeName:}" failed. No retries permitted until 2026-07-08 19:00:00.877205 +0000 UTC m=+69.269351766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-qxslq" (UID: "ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7") : secret "networking-console-plugin-cert" not found Jul 08 18:59:44.877519 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:44.877258 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls podName:93793458-6e1c-40f3-90ab-f52bb5c6cb66 nodeName:}" failed. No retries permitted until 2026-07-08 19:00:00.877244395 +0000 UTC m=+69.269391160 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls") pod "image-registry-b8b77d9f4-kz6lg" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66") : secret "image-registry-tls" not found Jul 08 18:59:44.877519 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:44.877260 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:59:44.877519 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:44.877307 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls podName:f24b0dfb-3ed3-4236-ba0e-587f52eb5267 nodeName:}" failed. No retries permitted until 2026-07-08 19:00:00.877296438 +0000 UTC m=+69.269443204 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls") pod "dns-default-v5gbg" (UID: "f24b0dfb-3ed3-4236-ba0e-587f52eb5267") : secret "dns-default-metrics-tls" not found Jul 08 18:59:54.396844 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:54.396815 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqlrv" Jul 08 18:59:57.975212 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:57.975171 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 18:59:57.975677 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:57.975262 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:57.977908 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:57.977888 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 18:59:57.977968 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:57.977958 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 18:59:57.986250 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:57.986224 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 18:59:57.986358 ip-10-0-142-189 kubenswrapper[2574]: E0708 18:59:57.986317 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs podName:9c146ab4-0d07-4951-9d48-bfff5ab7acef nodeName:}" failed. No retries permitted until 2026-07-08 19:01:01.986295527 +0000 UTC m=+130.378442304 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs") pod "network-metrics-daemon-k4pww" (UID: "9c146ab4-0d07-4951-9d48-bfff5ab7acef") : secret "metrics-daemon-secret" not found Jul 08 18:59:57.990036 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:57.990008 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c425d240-601b-44d7-8185-7b4e5f80b9be-original-pull-secret\") pod \"global-pull-secret-syncer-7jmds\" (UID: \"c425d240-601b-44d7-8185-7b4e5f80b9be\") " pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:58.076361 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:58.076314 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnvr2\" (UniqueName: \"kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2\") pod \"network-check-target-5zw8l\" (UID: \"c1ce3bf0-78da-4542-81fa-0dccea93ae8c\") " pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:58.079627 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:58.079610 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 18:59:58.088502 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:58.088487 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 18:59:58.099131 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:58.099112 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnvr2\" (UniqueName: \"kubernetes.io/projected/c1ce3bf0-78da-4542-81fa-0dccea93ae8c-kube-api-access-fnvr2\") pod \"network-check-target-5zw8l\" (UID: \"c1ce3bf0-78da-4542-81fa-0dccea93ae8c\") " pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:58.133950 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:58.133919 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jmds" Jul 08 18:59:58.141459 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:58.141438 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7bzch\"" Jul 08 18:59:58.148792 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:58.148769 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 18:59:58.291698 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:58.291670 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7jmds"] Jul 08 18:59:58.294637 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:59:58.294613 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc425d240_601b_44d7_8185_7b4e5f80b9be.slice/crio-d57d13e006447941e0de7552377f85903cff3eb9cb93668d26009d3caa40bab3 WatchSource:0}: Error finding container d57d13e006447941e0de7552377f85903cff3eb9cb93668d26009d3caa40bab3: Status 404 returned error can't find the container with id d57d13e006447941e0de7552377f85903cff3eb9cb93668d26009d3caa40bab3 Jul 08 18:59:58.305718 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:58.305695 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5zw8l"] Jul 08 18:59:58.308505 ip-10-0-142-189 kubenswrapper[2574]: W0708 18:59:58.308485 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ce3bf0_78da_4542_81fa_0dccea93ae8c.slice/crio-d2a0eb90905c1ad12049d5137ff2dfc733ca0f924d492f5c849547fcc57c75c8 WatchSource:0}: Error finding container d2a0eb90905c1ad12049d5137ff2dfc733ca0f924d492f5c849547fcc57c75c8: Status 404 returned error can't find the container with id d2a0eb90905c1ad12049d5137ff2dfc733ca0f924d492f5c849547fcc57c75c8 Jul 08 18:59:58.481298 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:58.481265 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5zw8l" event={"ID":"c1ce3bf0-78da-4542-81fa-0dccea93ae8c","Type":"ContainerStarted","Data":"d2a0eb90905c1ad12049d5137ff2dfc733ca0f924d492f5c849547fcc57c75c8"} Jul 08 18:59:58.482422 ip-10-0-142-189 kubenswrapper[2574]: I0708 18:59:58.482396 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7jmds" event={"ID":"c425d240-601b-44d7-8185-7b4e5f80b9be","Type":"ContainerStarted","Data":"d57d13e006447941e0de7552377f85903cff3eb9cb93668d26009d3caa40bab3"} Jul 08 19:00:00.904723 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:00.904692 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 19:00:00.904723 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:00.904731 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 19:00:00.905307 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:00.904758 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 19:00:00.905307 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:00:00.904849 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 19:00:00.905307 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:00:00.904872 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:00:00.905307 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:00:00.904895 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8b77d9f4-kz6lg: secret "image-registry-tls" not found Jul 08 19:00:00.905307 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:00:00.904908 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert podName:ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7 nodeName:}" failed. No retries permitted until 2026-07-08 19:00:32.904894439 +0000 UTC m=+101.297041205 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-qxslq" (UID: "ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7") : secret "networking-console-plugin-cert" not found Jul 08 19:00:00.905307 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:00:00.904849 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:00:00.905307 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:00:00.904943 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls podName:93793458-6e1c-40f3-90ab-f52bb5c6cb66 nodeName:}" failed. No retries permitted until 2026-07-08 19:00:32.904930587 +0000 UTC m=+101.297077358 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls") pod "image-registry-b8b77d9f4-kz6lg" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66") : secret "image-registry-tls" not found Jul 08 19:00:00.905307 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:00:00.904974 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls podName:f24b0dfb-3ed3-4236-ba0e-587f52eb5267 nodeName:}" failed. No retries permitted until 2026-07-08 19:00:32.90495942 +0000 UTC m=+101.297106215 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls") pod "dns-default-v5gbg" (UID: "f24b0dfb-3ed3-4236-ba0e-587f52eb5267") : secret "dns-default-metrics-tls" not found Jul 08 19:00:02.816994 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:02.816960 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b"] Jul 08 19:00:02.819116 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:02.819090 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:00:02.821964 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:02.821941 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 19:00:02.822092 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:02.821941 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 19:00:02.822759 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:02.822738 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 08 19:00:02.822867 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:02.822824 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 19:00:02.833316 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:02.833291 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b"] Jul 08 19:00:02.920637 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:02.920601 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e4c33d80-57c3-486c-b034-6f5f4e41aab5-klusterlet-config\") pod \"klusterlet-addon-workmgr-dd559788b-hl59b\" (UID: \"e4c33d80-57c3-486c-b034-6f5f4e41aab5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:00:02.920821 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:02.920724 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lh6g\" (UniqueName: \"kubernetes.io/projected/e4c33d80-57c3-486c-b034-6f5f4e41aab5-kube-api-access-2lh6g\") pod \"klusterlet-addon-workmgr-dd559788b-hl59b\" (UID: \"e4c33d80-57c3-486c-b034-6f5f4e41aab5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:00:02.920821 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:02.920788 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4c33d80-57c3-486c-b034-6f5f4e41aab5-tmp\") pod \"klusterlet-addon-workmgr-dd559788b-hl59b\" (UID: \"e4c33d80-57c3-486c-b034-6f5f4e41aab5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:00:03.021310 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:03.021274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lh6g\" (UniqueName: \"kubernetes.io/projected/e4c33d80-57c3-486c-b034-6f5f4e41aab5-kube-api-access-2lh6g\") pod \"klusterlet-addon-workmgr-dd559788b-hl59b\" (UID: \"e4c33d80-57c3-486c-b034-6f5f4e41aab5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:00:03.021507 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:03.021347 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4c33d80-57c3-486c-b034-6f5f4e41aab5-tmp\") pod \"klusterlet-addon-workmgr-dd559788b-hl59b\" (UID: \"e4c33d80-57c3-486c-b034-6f5f4e41aab5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:00:03.021507 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:03.021382 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e4c33d80-57c3-486c-b034-6f5f4e41aab5-klusterlet-config\") pod \"klusterlet-addon-workmgr-dd559788b-hl59b\" (UID: \"e4c33d80-57c3-486c-b034-6f5f4e41aab5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:00:03.021854 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:03.021831 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4c33d80-57c3-486c-b034-6f5f4e41aab5-tmp\") pod \"klusterlet-addon-workmgr-dd559788b-hl59b\" (UID: \"e4c33d80-57c3-486c-b034-6f5f4e41aab5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:00:03.024233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:03.024209 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e4c33d80-57c3-486c-b034-6f5f4e41aab5-klusterlet-config\") pod \"klusterlet-addon-workmgr-dd559788b-hl59b\" (UID: \"e4c33d80-57c3-486c-b034-6f5f4e41aab5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:00:03.031928 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:03.031897 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lh6g\" (UniqueName: \"kubernetes.io/projected/e4c33d80-57c3-486c-b034-6f5f4e41aab5-kube-api-access-2lh6g\") pod \"klusterlet-addon-workmgr-dd559788b-hl59b\" (UID: \"e4c33d80-57c3-486c-b034-6f5f4e41aab5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:00:03.130209 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:03.130121 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:00:04.480600 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:04.480568 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b"] Jul 08 19:00:04.483930 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:00:04.483904 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c33d80_57c3_486c_b034_6f5f4e41aab5.slice/crio-2c9639eb18cbf5923b4a9a4e4df0d51e209af7d785c060300d2e319aa4543beb WatchSource:0}: Error finding container 2c9639eb18cbf5923b4a9a4e4df0d51e209af7d785c060300d2e319aa4543beb: Status 404 returned error can't find the container with id 2c9639eb18cbf5923b4a9a4e4df0d51e209af7d785c060300d2e319aa4543beb Jul 08 19:00:04.499960 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:04.499927 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" event={"ID":"e4c33d80-57c3-486c-b034-6f5f4e41aab5","Type":"ContainerStarted","Data":"2c9639eb18cbf5923b4a9a4e4df0d51e209af7d785c060300d2e319aa4543beb"} Jul 08 19:00:04.501563 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:04.501537 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5zw8l" event={"ID":"c1ce3bf0-78da-4542-81fa-0dccea93ae8c","Type":"ContainerStarted","Data":"ff35fb26e2f5218dae03d088f71b6c320120f8a3190979a9c42316fd48b4fda8"} Jul 08 19:00:05.505857 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:05.505817 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7jmds" event={"ID":"c425d240-601b-44d7-8185-7b4e5f80b9be","Type":"ContainerStarted","Data":"ad9f38599be6cb61be978fb3f5821d225dce87def7ef5206b99d2a1a549d8066"} Jul 08 19:00:05.522991 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:05.522945 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7jmds" podStartSLOduration=67.455707677 podStartE2EDuration="1m13.52293009s" totalImagesPullingTime="6.067222413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:00:05.521696802 +0000 UTC m=+73.913843589" watchObservedRunningTime="2026-07-08 19:00:05.52293009 +0000 UTC m=+73.915076878" Jul 08 19:00:05.538139 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:05.538092 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5zw8l" podStartSLOduration=67.496901958 podStartE2EDuration="1m13.538075851s" totalImagesPullingTime="6.041173893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:00:05.536827297 +0000 UTC m=+73.928974086" watchObservedRunningTime="2026-07-08 19:00:05.538075851 +0000 UTC m=+73.930222617" Jul 08 19:00:11.521408 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:11.521372 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" event={"ID":"e4c33d80-57c3-486c-b034-6f5f4e41aab5","Type":"ContainerStarted","Data":"4f831a0ed18e954fa63c712d2e1c2b2071e1a9fbf8123c6a874ec5f4a6b8437c"} Jul 08 19:00:11.521809 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:11.521532 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:00:11.523090 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:11.523070 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:00:11.539769 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:11.539717 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" podStartSLOduration=2.828117417 podStartE2EDuration="9.539702639s" totalImagesPullingTime="6.711585222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:00:11.538496777 +0000 UTC m=+79.930643565" watchObservedRunningTime="2026-07-08 19:00:11.539702639 +0000 UTC m=+79.931849427" Jul 08 19:00:15.506894 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:15.506758 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 19:00:32.953608 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:32.953564 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 19:00:32.954034 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:32.953656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 19:00:32.954034 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:32.953680 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 19:00:32.954034 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:00:32.953725 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 19:00:32.954034 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:00:32.953781 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:00:32.954034 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:00:32.953788 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:00:32.954034 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:00:32.953796 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8b77d9f4-kz6lg: secret "image-registry-tls" not found Jul 08 19:00:32.954034 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:00:32.953808 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert podName:ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:36.953791063 +0000 UTC m=+165.345937833 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-qxslq" (UID: "ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7") : secret "networking-console-plugin-cert" not found Jul 08 19:00:32.954034 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:00:32.953839 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls podName:f24b0dfb-3ed3-4236-ba0e-587f52eb5267 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:36.953823637 +0000 UTC m=+165.345970413 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls") pod "dns-default-v5gbg" (UID: "f24b0dfb-3ed3-4236-ba0e-587f52eb5267") : secret "dns-default-metrics-tls" not found Jul 08 19:00:32.954034 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:00:32.953854 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls podName:93793458-6e1c-40f3-90ab-f52bb5c6cb66 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:36.953848012 +0000 UTC m=+165.345994778 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls") pod "image-registry-b8b77d9f4-kz6lg" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66") : secret "image-registry-tls" not found Jul 08 19:00:35.509619 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:00:35.509590 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5zw8l" Jul 08 19:01:02.055771 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:01:02.055734 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 19:01:02.056256 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:01:02.055860 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 19:01:02.056256 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:01:02.055923 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs podName:9c146ab4-0d07-4951-9d48-bfff5ab7acef nodeName:}" failed. No retries permitted until 2026-07-08 19:03:04.055907751 +0000 UTC m=+252.448054517 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs") pod "network-metrics-daemon-k4pww" (UID: "9c146ab4-0d07-4951-9d48-bfff5ab7acef") : secret "metrics-daemon-secret" not found Jul 08 19:01:32.004819 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:01:32.004748 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" podUID="ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7" Jul 08 19:01:32.014043 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:01:32.014010 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" podUID="93793458-6e1c-40f3-90ab-f52bb5c6cb66" Jul 08 19:01:32.028343 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:01:32.028293 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v5gbg" podUID="f24b0dfb-3ed3-4236-ba0e-587f52eb5267" Jul 08 19:01:32.712146 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:01:32.712120 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 19:01:32.712318 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:01:32.712125 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 19:01:32.712318 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:01:32.712125 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v5gbg" Jul 08 19:01:33.228048 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:01:33.228007 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 19:01:37.018640 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:01:37.018589 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 19:01:37.018640 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:01:37.018642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 19:01:37.019150 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:01:37.018671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 19:01:37.019150 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:01:37.018748 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:01:37.019150 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:01:37.018810 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls podName:f24b0dfb-3ed3-4236-ba0e-587f52eb5267 nodeName:}" failed. No retries permitted until 2026-07-08 19:03:39.018797712 +0000 UTC m=+287.410944482 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls") pod "dns-default-v5gbg" (UID: "f24b0dfb-3ed3-4236-ba0e-587f52eb5267") : secret "dns-default-metrics-tls" not found Jul 08 19:01:37.019150 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:01:37.018753 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 19:01:37.019150 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:01:37.018837 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:01:37.019150 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:01:37.018866 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8b77d9f4-kz6lg: secret "image-registry-tls" not found Jul 08 19:01:37.019150 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:01:37.018847 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert podName:ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7 nodeName:}" failed. No retries permitted until 2026-07-08 19:03:39.018838085 +0000 UTC m=+287.410984852 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-qxslq" (UID: "ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7") : secret "networking-console-plugin-cert" not found Jul 08 19:01:37.019150 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:01:37.018947 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls podName:93793458-6e1c-40f3-90ab-f52bb5c6cb66 nodeName:}" failed. No retries permitted until 2026-07-08 19:03:39.018927525 +0000 UTC m=+287.411074291 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls") pod "image-registry-b8b77d9f4-kz6lg" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66") : secret "image-registry-tls" not found Jul 08 19:01:46.222256 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:01:46.222185 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 19:02:11.522557 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:02:11.522498 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" podUID="e4c33d80-57c3-486c-b034-6f5f4e41aab5" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused" Jul 08 19:02:11.806427 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:02:11.806391 2574 generic.go:356] "Generic (PLEG): container finished" podID="e4c33d80-57c3-486c-b034-6f5f4e41aab5" containerID="4f831a0ed18e954fa63c712d2e1c2b2071e1a9fbf8123c6a874ec5f4a6b8437c" exitCode=1 Jul 08 19:02:11.806594 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:02:11.806425 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" event={"ID":"e4c33d80-57c3-486c-b034-6f5f4e41aab5","Type":"ContainerDied","Data":"4f831a0ed18e954fa63c712d2e1c2b2071e1a9fbf8123c6a874ec5f4a6b8437c"} Jul 08 19:02:11.806766 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:02:11.806753 2574 scope.go:117] "RemoveContainer" containerID="4f831a0ed18e954fa63c712d2e1c2b2071e1a9fbf8123c6a874ec5f4a6b8437c" Jul 08 19:02:12.810566 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:02:12.810534 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" event={"ID":"e4c33d80-57c3-486c-b034-6f5f4e41aab5","Type":"ContainerStarted","Data":"2d2bffa15de8ed764baacf25a0baf127d49a5aee36685d4b66f48da69451db09"} Jul 08 19:02:12.810948 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:02:12.810806 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:02:12.811406 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:02:12.811388 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd559788b-hl59b" Jul 08 19:03:04.137622 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:04.137572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 19:03:04.138137 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:04.137734 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 19:03:04.138137 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:04.137805 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs podName:9c146ab4-0d07-4951-9d48-bfff5ab7acef nodeName:}" failed. No retries permitted until 2026-07-08 19:05:06.137786373 +0000 UTC m=+374.529933156 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs") pod "network-metrics-daemon-k4pww" (UID: "9c146ab4-0d07-4951-9d48-bfff5ab7acef") : secret "metrics-daemon-secret" not found Jul 08 19:03:19.731989 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.731911 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sgj7j"] Jul 08 19:03:19.733809 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.733792 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sgj7j" Jul 08 19:03:19.736721 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.736698 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hz4l5\"" Jul 08 19:03:19.736831 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.736752 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:03:19.737705 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.737691 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 08 19:03:19.752004 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.751982 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sgj7j"] Jul 08 19:03:19.820406 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.820374 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-9xbz2"] Jul 08 19:03:19.822098 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.822083 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:19.832012 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.831986 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 19:03:19.838976 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.838954 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 08 19:03:19.839389 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.839372 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 08 19:03:19.839648 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.839632 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 19:03:19.840092 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.840076 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jp7qd\"" Jul 08 19:03:19.841589 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.841562 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 08 19:03:19.842404 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.842383 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-9xbz2"] Jul 08 19:03:19.856472 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.856443 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56hj7\" (UniqueName: \"kubernetes.io/projected/2d4361c7-b563-433e-abe9-e88ccd5d2cda-kube-api-access-56hj7\") pod \"volume-data-source-validator-5d456fdbcd-sgj7j\" (UID: \"2d4361c7-b563-433e-abe9-e88ccd5d2cda\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sgj7j" Jul 08 19:03:19.957550 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.957512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7341c637-b13e-4a5f-b7e5-2701bf8337a4-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:19.957550 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.957546 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d79fz\" (UniqueName: \"kubernetes.io/projected/7341c637-b13e-4a5f-b7e5-2701bf8337a4-kube-api-access-d79fz\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:19.957793 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.957588 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7341c637-b13e-4a5f-b7e5-2701bf8337a4-snapshots\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:19.957793 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.957681 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7341c637-b13e-4a5f-b7e5-2701bf8337a4-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:19.957793 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.957725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56hj7\" (UniqueName: \"kubernetes.io/projected/2d4361c7-b563-433e-abe9-e88ccd5d2cda-kube-api-access-56hj7\") pod \"volume-data-source-validator-5d456fdbcd-sgj7j\" (UID: \"2d4361c7-b563-433e-abe9-e88ccd5d2cda\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sgj7j" Jul 08 19:03:19.957793 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.957741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7341c637-b13e-4a5f-b7e5-2701bf8337a4-tmp\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:19.957978 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.957821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7341c637-b13e-4a5f-b7e5-2701bf8337a4-serving-cert\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:19.967534 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:19.967507 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56hj7\" (UniqueName: \"kubernetes.io/projected/2d4361c7-b563-433e-abe9-e88ccd5d2cda-kube-api-access-56hj7\") pod \"volume-data-source-validator-5d456fdbcd-sgj7j\" (UID: \"2d4361c7-b563-433e-abe9-e88ccd5d2cda\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sgj7j" Jul 08 19:03:20.042398 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.042273 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sgj7j" Jul 08 19:03:20.058358 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.058317 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7341c637-b13e-4a5f-b7e5-2701bf8337a4-serving-cert\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:20.058521 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.058437 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7341c637-b13e-4a5f-b7e5-2701bf8337a4-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:20.058521 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.058457 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d79fz\" (UniqueName: \"kubernetes.io/projected/7341c637-b13e-4a5f-b7e5-2701bf8337a4-kube-api-access-d79fz\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:20.058521 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.058488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7341c637-b13e-4a5f-b7e5-2701bf8337a4-snapshots\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:20.058691 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.058533 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7341c637-b13e-4a5f-b7e5-2701bf8337a4-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:20.058691 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.058577 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7341c637-b13e-4a5f-b7e5-2701bf8337a4-tmp\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:20.059054 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.059024 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7341c637-b13e-4a5f-b7e5-2701bf8337a4-tmp\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:20.059155 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.059124 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7341c637-b13e-4a5f-b7e5-2701bf8337a4-snapshots\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:20.059155 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.059148 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7341c637-b13e-4a5f-b7e5-2701bf8337a4-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:20.059527 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.059510 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7341c637-b13e-4a5f-b7e5-2701bf8337a4-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:20.060701 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.060682 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7341c637-b13e-4a5f-b7e5-2701bf8337a4-serving-cert\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:20.070079 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.070047 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d79fz\" (UniqueName: \"kubernetes.io/projected/7341c637-b13e-4a5f-b7e5-2701bf8337a4-kube-api-access-d79fz\") pod \"insights-operator-5c847dcfc4-9xbz2\" (UID: \"7341c637-b13e-4a5f-b7e5-2701bf8337a4\") " pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:20.130850 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.130817 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" Jul 08 19:03:20.175345 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.175283 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sgj7j"] Jul 08 19:03:20.183411 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:03:20.180929 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4361c7_b563_433e_abe9_e88ccd5d2cda.slice/crio-1502fd928fedafbca11db0d423629f3509865dbd8fe9cd186204cddb1e3df698 WatchSource:0}: Error finding container 1502fd928fedafbca11db0d423629f3509865dbd8fe9cd186204cddb1e3df698: Status 404 returned error can't find the container with id 1502fd928fedafbca11db0d423629f3509865dbd8fe9cd186204cddb1e3df698 Jul 08 19:03:20.266710 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.266675 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-9xbz2"] Jul 08 19:03:20.269533 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:03:20.269504 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7341c637_b13e_4a5f_b7e5_2701bf8337a4.slice/crio-932f2cbdea6b3970598585e7ab61c3c6c4c28de6fcde53817c6dfe9abd27ca4f WatchSource:0}: Error finding container 932f2cbdea6b3970598585e7ab61c3c6c4c28de6fcde53817c6dfe9abd27ca4f: Status 404 returned error can't find the container with id 932f2cbdea6b3970598585e7ab61c3c6c4c28de6fcde53817c6dfe9abd27ca4f Jul 08 19:03:20.977602 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.977562 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" event={"ID":"7341c637-b13e-4a5f-b7e5-2701bf8337a4","Type":"ContainerStarted","Data":"932f2cbdea6b3970598585e7ab61c3c6c4c28de6fcde53817c6dfe9abd27ca4f"} Jul 08 19:03:20.979240 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:20.979208 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sgj7j" event={"ID":"2d4361c7-b563-433e-abe9-e88ccd5d2cda","Type":"ContainerStarted","Data":"1502fd928fedafbca11db0d423629f3509865dbd8fe9cd186204cddb1e3df698"} Jul 08 19:03:21.985673 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:21.985628 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sgj7j" event={"ID":"2d4361c7-b563-433e-abe9-e88ccd5d2cda","Type":"ContainerStarted","Data":"b31fec3d15d6e890044b24cee13b10f8de96adbe10eb673cd9e61454d42dc078"} Jul 08 19:03:22.004035 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:22.003983 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sgj7j" podStartSLOduration=1.648354319 podStartE2EDuration="3.003962771s" totalImagesPullingTime="1.355608452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:03:22.003424702 +0000 UTC m=+270.395571515" watchObservedRunningTime="2026-07-08 19:03:22.003962771 +0000 UTC m=+270.396109562" Jul 08 19:03:22.989585 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:22.989547 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" event={"ID":"7341c637-b13e-4a5f-b7e5-2701bf8337a4","Type":"ContainerStarted","Data":"aac5cb3da156e7dedbb1cc8d5555d29ee05e1df6dddbcd31465aa19356a64cc6"} Jul 08 19:03:23.007599 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:23.007543 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" podStartSLOduration=1.854059422 podStartE2EDuration="4.007525173s" totalImagesPullingTime="2.153465751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:03:23.007389193 +0000 UTC m=+271.399536000" watchObservedRunningTime="2026-07-08 19:03:23.007525173 +0000 UTC m=+271.399671960" Jul 08 19:03:24.263570 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.263531 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wfd56"] Jul 08 19:03:24.265955 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.265936 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.282221 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.282192 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 19:03:24.282554 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.282537 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 19:03:24.282629 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.282544 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v5zgs\"" Jul 08 19:03:24.295235 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.295207 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.295360 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.295238 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd1cc41f-157d-4890-adda-df6d4341f8bb-crio-socket\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.295360 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.295258 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.295440 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.295410 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd1cc41f-157d-4890-adda-df6d4341f8bb-data-volume\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.295440 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.295427 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fqvf\" (UniqueName: \"kubernetes.io/projected/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-api-access-8fqvf\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.334847 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.334816 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wfd56"] Jul 08 19:03:24.395884 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.395844 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd1cc41f-157d-4890-adda-df6d4341f8bb-data-volume\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.396037 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.395891 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fqvf\" (UniqueName: \"kubernetes.io/projected/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-api-access-8fqvf\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.396037 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.395944 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.396037 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.395968 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd1cc41f-157d-4890-adda-df6d4341f8bb-crio-socket\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.396037 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.395992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.396193 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:24.396087 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:03:24.396193 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:24.396107 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:03:24.396193 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.396095 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd1cc41f-157d-4890-adda-df6d4341f8bb-crio-socket\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.396193 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:24.396150 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls podName:fd1cc41f-157d-4890-adda-df6d4341f8bb nodeName:}" failed. No retries permitted until 2026-07-08 19:03:24.896137072 +0000 UTC m=+273.288283841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfd56" (UID: "fd1cc41f-157d-4890-adda-df6d4341f8bb") : secret "insights-runtime-extractor-tls" not found Jul 08 19:03:24.396193 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.396172 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd1cc41f-157d-4890-adda-df6d4341f8bb-data-volume\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.396193 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:24.396191 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm podName:fd1cc41f-157d-4890-adda-df6d4341f8bb nodeName:}" failed. No retries permitted until 2026-07-08 19:03:24.896172796 +0000 UTC m=+273.288319569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfd56" (UID: "fd1cc41f-157d-4890-adda-df6d4341f8bb") : configmap "kube-rbac-proxy" not found Jul 08 19:03:24.405410 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.405382 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fqvf\" (UniqueName: \"kubernetes.io/projected/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-api-access-8fqvf\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.900103 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.900059 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.900103 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:24.900105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:24.900312 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:24.900197 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:03:24.900312 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:24.900219 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:03:24.900312 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:24.900264 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm podName:fd1cc41f-157d-4890-adda-df6d4341f8bb nodeName:}" failed. No retries permitted until 2026-07-08 19:03:25.900247788 +0000 UTC m=+274.292394560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfd56" (UID: "fd1cc41f-157d-4890-adda-df6d4341f8bb") : configmap "kube-rbac-proxy" not found Jul 08 19:03:24.900312 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:24.900280 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls podName:fd1cc41f-157d-4890-adda-df6d4341f8bb nodeName:}" failed. No retries permitted until 2026-07-08 19:03:25.900273828 +0000 UTC m=+274.292420599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfd56" (UID: "fd1cc41f-157d-4890-adda-df6d4341f8bb") : secret "insights-runtime-extractor-tls" not found Jul 08 19:03:25.548859 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:25.548826 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zzss"] Jul 08 19:03:25.550872 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:25.550856 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zzss" Jul 08 19:03:25.553317 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:25.553297 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 08 19:03:25.554495 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:25.554474 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 08 19:03:25.554613 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:25.554541 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-s4gpw\"" Jul 08 19:03:25.563370 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:25.563311 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zzss"] Jul 08 19:03:25.606997 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:25.606961 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxx7g\" (UniqueName: \"kubernetes.io/projected/c1e48217-767d-4b12-9195-bff1573993d6-kube-api-access-jxx7g\") pod \"migrator-d57d58cc9-4zzss\" (UID: \"c1e48217-767d-4b12-9195-bff1573993d6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zzss" Jul 08 19:03:25.708265 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:25.708222 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxx7g\" (UniqueName: \"kubernetes.io/projected/c1e48217-767d-4b12-9195-bff1573993d6-kube-api-access-jxx7g\") pod \"migrator-d57d58cc9-4zzss\" (UID: \"c1e48217-767d-4b12-9195-bff1573993d6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zzss" Jul 08 19:03:25.717487 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:25.717454 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxx7g\" (UniqueName: \"kubernetes.io/projected/c1e48217-767d-4b12-9195-bff1573993d6-kube-api-access-jxx7g\") pod \"migrator-d57d58cc9-4zzss\" (UID: \"c1e48217-767d-4b12-9195-bff1573993d6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zzss" Jul 08 19:03:25.860240 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:25.860132 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zzss" Jul 08 19:03:25.909674 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:25.909639 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:25.909821 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:25.909695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:25.910012 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:25.909929 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:03:25.910012 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:25.909978 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:03:25.910012 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:25.910011 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls podName:fd1cc41f-157d-4890-adda-df6d4341f8bb nodeName:}" failed. No retries permitted until 2026-07-08 19:03:27.909991525 +0000 UTC m=+276.302138312 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfd56" (UID: "fd1cc41f-157d-4890-adda-df6d4341f8bb") : secret "insights-runtime-extractor-tls" not found Jul 08 19:03:25.910250 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:25.910063 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm podName:fd1cc41f-157d-4890-adda-df6d4341f8bb nodeName:}" failed. No retries permitted until 2026-07-08 19:03:27.91004193 +0000 UTC m=+276.302188710 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfd56" (UID: "fd1cc41f-157d-4890-adda-df6d4341f8bb") : configmap "kube-rbac-proxy" not found Jul 08 19:03:25.987311 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:25.987278 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zzss"] Jul 08 19:03:25.990026 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:03:25.990002 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e48217_767d_4b12_9195_bff1573993d6.slice/crio-144f96a18f716208f31a4d2cf9ece2946bc0c4d0c9dfdf249623582346f01f90 WatchSource:0}: Error finding container 144f96a18f716208f31a4d2cf9ece2946bc0c4d0c9dfdf249623582346f01f90: Status 404 returned error can't find the container with id 144f96a18f716208f31a4d2cf9ece2946bc0c4d0c9dfdf249623582346f01f90 Jul 08 19:03:26.000697 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:26.000670 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zzss" event={"ID":"c1e48217-767d-4b12-9195-bff1573993d6","Type":"ContainerStarted","Data":"144f96a18f716208f31a4d2cf9ece2946bc0c4d0c9dfdf249623582346f01f90"} Jul 08 19:03:26.389724 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:26.389697 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s9c56_bf533b5c-6379-40d6-bd6d-1cf429b2ef2e/dns-node-resolver/0.log" Jul 08 19:03:27.389085 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:27.389057 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p7px9_fa3a6023-79bf-4124-91a9-68653cd84334/node-ca/0.log" Jul 08 19:03:27.925544 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:27.925447 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:27.925544 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:27.925489 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:27.925777 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:27.925563 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:03:27.925777 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:27.925582 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:03:27.925777 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:27.925622 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm podName:fd1cc41f-157d-4890-adda-df6d4341f8bb nodeName:}" failed. No retries permitted until 2026-07-08 19:03:31.925606387 +0000 UTC m=+280.317753156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfd56" (UID: "fd1cc41f-157d-4890-adda-df6d4341f8bb") : configmap "kube-rbac-proxy" not found Jul 08 19:03:27.925777 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:27.925700 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls podName:fd1cc41f-157d-4890-adda-df6d4341f8bb nodeName:}" failed. No retries permitted until 2026-07-08 19:03:31.92567576 +0000 UTC m=+280.317822530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfd56" (UID: "fd1cc41f-157d-4890-adda-df6d4341f8bb") : secret "insights-runtime-extractor-tls" not found Jul 08 19:03:28.007922 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:28.007887 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zzss" event={"ID":"c1e48217-767d-4b12-9195-bff1573993d6","Type":"ContainerStarted","Data":"8c4e89e988a780cb772f62a024e67c2f332e201f0a5fcc0dd3a7a43f610c6382"} Jul 08 19:03:28.008082 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:28.007937 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zzss" event={"ID":"c1e48217-767d-4b12-9195-bff1573993d6","Type":"ContainerStarted","Data":"c31283bc2b7ee1a02f87ba12e461a0bfb7b0b30f9b627872134604600360b8cc"} Jul 08 19:03:28.028575 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:28.028526 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zzss" podStartSLOduration=1.4084704559999999 podStartE2EDuration="3.02851031s" totalImagesPullingTime="1.620039854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:03:28.027541971 +0000 UTC m=+276.419688780" watchObservedRunningTime="2026-07-08 19:03:28.02851031 +0000 UTC m=+276.420657099" Jul 08 19:03:28.189635 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:28.189549 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-thtdt_6040d8e3-4ec5-4988-8f52-2df87ad31a3e/serve-healthcheck-canary/0.log" Jul 08 19:03:31.957993 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:31.957950 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:31.958449 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:31.958001 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:31.958449 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:31.958079 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:03:31.958449 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:31.958150 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm podName:fd1cc41f-157d-4890-adda-df6d4341f8bb nodeName:}" failed. No retries permitted until 2026-07-08 19:03:39.95813338 +0000 UTC m=+288.350280149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfd56" (UID: "fd1cc41f-157d-4890-adda-df6d4341f8bb") : configmap "kube-rbac-proxy" not found Jul 08 19:03:31.958449 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:31.958166 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:03:31.958449 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:31.958217 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls podName:fd1cc41f-157d-4890-adda-df6d4341f8bb nodeName:}" failed. No retries permitted until 2026-07-08 19:03:39.95820447 +0000 UTC m=+288.350351239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfd56" (UID: "fd1cc41f-157d-4890-adda-df6d4341f8bb") : secret "insights-runtime-extractor-tls" not found Jul 08 19:03:35.713003 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:35.712945 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v5gbg" podUID="f24b0dfb-3ed3-4236-ba0e-587f52eb5267" Jul 08 19:03:35.713003 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:35.712945 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" podUID="93793458-6e1c-40f3-90ab-f52bb5c6cb66" Jul 08 19:03:35.713003 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:35.712944 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" podUID="ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7" Jul 08 19:03:36.030919 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:36.030882 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 19:03:36.031215 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:36.030888 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 19:03:36.031215 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:36.030887 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v5gbg" Jul 08 19:03:39.118541 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:39.118501 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 19:03:39.118541 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:39.118538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 19:03:39.119040 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:39.118560 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 19:03:39.119040 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:39.118645 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 19:03:39.119040 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:39.118726 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert podName:ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7 nodeName:}" failed. No retries permitted until 2026-07-08 19:05:41.118710176 +0000 UTC m=+409.510856949 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-qxslq" (UID: "ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7") : secret "networking-console-plugin-cert" not found Jul 08 19:03:39.120791 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:39.120767 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f24b0dfb-3ed3-4236-ba0e-587f52eb5267-metrics-tls\") pod \"dns-default-v5gbg\" (UID: \"f24b0dfb-3ed3-4236-ba0e-587f52eb5267\") " pod="openshift-dns/dns-default-v5gbg" Jul 08 19:03:39.120963 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:39.120945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls\") pod \"image-registry-b8b77d9f4-kz6lg\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 19:03:39.335302 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:39.335256 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2n9mw\"" Jul 08 19:03:39.335302 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:39.335256 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-97fdz\"" Jul 08 19:03:39.342529 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:39.342504 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 19:03:39.342612 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:39.342547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v5gbg" Jul 08 19:03:39.489381 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:39.489351 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b8b77d9f4-kz6lg"] Jul 08 19:03:39.492487 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:03:39.492463 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93793458_6e1c_40f3_90ab_f52bb5c6cb66.slice/crio-8d86e1b552a480698157fc9c9cad4150c0e9b005229fbd92977da405e46f0a6f WatchSource:0}: Error finding container 8d86e1b552a480698157fc9c9cad4150c0e9b005229fbd92977da405e46f0a6f: Status 404 returned error can't find the container with id 8d86e1b552a480698157fc9c9cad4150c0e9b005229fbd92977da405e46f0a6f Jul 08 19:03:39.499744 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:39.499724 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v5gbg"] Jul 08 19:03:39.504159 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:03:39.504130 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf24b0dfb_3ed3_4236_ba0e_587f52eb5267.slice/crio-bff78754007b946f9944a21eed642ddd98446828f12655e05bac9c8973796c0f WatchSource:0}: Error finding container bff78754007b946f9944a21eed642ddd98446828f12655e05bac9c8973796c0f: Status 404 returned error can't find the container with id bff78754007b946f9944a21eed642ddd98446828f12655e05bac9c8973796c0f Jul 08 19:03:40.027259 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:40.027217 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:40.027259 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:40.027272 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:40.027530 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:40.027447 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:03:40.027530 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:40.027512 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls podName:fd1cc41f-157d-4890-adda-df6d4341f8bb nodeName:}" failed. No retries permitted until 2026-07-08 19:03:56.027495625 +0000 UTC m=+304.419642391 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfd56" (UID: "fd1cc41f-157d-4890-adda-df6d4341f8bb") : secret "insights-runtime-extractor-tls" not found Jul 08 19:03:40.027795 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:40.027776 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd1cc41f-157d-4890-adda-df6d4341f8bb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:40.043660 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:40.043624 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v5gbg" event={"ID":"f24b0dfb-3ed3-4236-ba0e-587f52eb5267","Type":"ContainerStarted","Data":"bff78754007b946f9944a21eed642ddd98446828f12655e05bac9c8973796c0f"} Jul 08 19:03:40.044985 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:40.044962 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" event={"ID":"93793458-6e1c-40f3-90ab-f52bb5c6cb66","Type":"ContainerStarted","Data":"33e541d7c40f5f296a46b1a05845583c4ae621e869df53f1f16b66814c310d15"} Jul 08 19:03:40.045106 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:40.045003 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" event={"ID":"93793458-6e1c-40f3-90ab-f52bb5c6cb66","Type":"ContainerStarted","Data":"8d86e1b552a480698157fc9c9cad4150c0e9b005229fbd92977da405e46f0a6f"} Jul 08 19:03:40.045106 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:40.045075 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 19:03:40.071284 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:40.071227 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" podStartSLOduration=288.071211289 podStartE2EDuration="4m48.071211289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:58:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:03:40.069723985 +0000 UTC m=+288.461870772" watchObservedRunningTime="2026-07-08 19:03:40.071211289 +0000 UTC m=+288.463358076" Jul 08 19:03:42.053714 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:42.053685 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v5gbg" event={"ID":"f24b0dfb-3ed3-4236-ba0e-587f52eb5267","Type":"ContainerStarted","Data":"2c7f583b8d545428c144d945fc2089c87db0cee3bc08b86f1ce30d1464e83fcc"} Jul 08 19:03:43.058460 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:43.058425 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v5gbg" event={"ID":"f24b0dfb-3ed3-4236-ba0e-587f52eb5267","Type":"ContainerStarted","Data":"0649221515daece1a99bc59c3d9091aee65eafdc4ec51dfd522f1a75f5e95ce1"} Jul 08 19:03:43.058923 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:43.058547 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v5gbg" Jul 08 19:03:43.078761 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:43.078709 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v5gbg" podStartSLOduration=252.675904855 podStartE2EDuration="4m15.078693079s" totalImagesPullingTime="2.402788224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:03:43.077852135 +0000 UTC m=+291.469998944" watchObservedRunningTime="2026-07-08 19:03:43.078693079 +0000 UTC m=+291.470839866" Jul 08 19:03:49.223211 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:03:49.223161 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-k4pww" podUID="9c146ab4-0d07-4951-9d48-bfff5ab7acef" Jul 08 19:03:52.082931 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:52.082905 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 19:03:53.063490 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:53.063450 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v5gbg" Jul 08 19:03:54.694570 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:54.694528 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzs6t"] Jul 08 19:03:54.697513 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:54.697497 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzs6t" Jul 08 19:03:54.700138 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:54.700113 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 19:03:54.700282 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:54.700151 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mbtd6\"" Jul 08 19:03:54.707354 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:54.707306 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzs6t"] Jul 08 19:03:54.864372 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:54.864307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2872402b-914a-49c6-83f4-a7945ba3ca7c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dzs6t\" (UID: \"2872402b-914a-49c6-83f4-a7945ba3ca7c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzs6t" Jul 08 19:03:54.965701 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:54.965618 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2872402b-914a-49c6-83f4-a7945ba3ca7c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dzs6t\" (UID: \"2872402b-914a-49c6-83f4-a7945ba3ca7c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzs6t" Jul 08 19:03:54.968047 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:54.968014 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2872402b-914a-49c6-83f4-a7945ba3ca7c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dzs6t\" (UID: \"2872402b-914a-49c6-83f4-a7945ba3ca7c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzs6t" Jul 08 19:03:55.006590 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:55.006553 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzs6t" Jul 08 19:03:55.139126 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:55.139096 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzs6t"] Jul 08 19:03:55.141775 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:03:55.141747 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2872402b_914a_49c6_83f4_a7945ba3ca7c.slice/crio-1eca8c38d0d2aa0307615aae64d0b3a791b4a38561f17a3b143840d1890e4606 WatchSource:0}: Error finding container 1eca8c38d0d2aa0307615aae64d0b3a791b4a38561f17a3b143840d1890e4606: Status 404 returned error can't find the container with id 1eca8c38d0d2aa0307615aae64d0b3a791b4a38561f17a3b143840d1890e4606 Jul 08 19:03:55.143761 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:55.143747 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:03:56.074138 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:56.074098 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:56.076966 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:56.076931 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd1cc41f-157d-4890-adda-df6d4341f8bb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfd56\" (UID: \"fd1cc41f-157d-4890-adda-df6d4341f8bb\") " pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:56.097938 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:56.097901 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzs6t" event={"ID":"2872402b-914a-49c6-83f4-a7945ba3ca7c","Type":"ContainerStarted","Data":"1eca8c38d0d2aa0307615aae64d0b3a791b4a38561f17a3b143840d1890e4606"} Jul 08 19:03:56.378290 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:56.378218 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v5zgs\"" Jul 08 19:03:56.385648 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:56.385620 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wfd56" Jul 08 19:03:56.720556 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:56.720524 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wfd56"] Jul 08 19:03:56.724931 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:03:56.724897 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1cc41f_157d_4890_adda_df6d4341f8bb.slice/crio-161037a3ceb1102e464e8bd2bd619e89ede6f33dbc32acb3478670fd70ebca41 WatchSource:0}: Error finding container 161037a3ceb1102e464e8bd2bd619e89ede6f33dbc32acb3478670fd70ebca41: Status 404 returned error can't find the container with id 161037a3ceb1102e464e8bd2bd619e89ede6f33dbc32acb3478670fd70ebca41 Jul 08 19:03:57.102394 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:57.102357 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfd56" event={"ID":"fd1cc41f-157d-4890-adda-df6d4341f8bb","Type":"ContainerStarted","Data":"161037a3ceb1102e464e8bd2bd619e89ede6f33dbc32acb3478670fd70ebca41"} Jul 08 19:03:57.103746 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:57.103719 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzs6t" event={"ID":"2872402b-914a-49c6-83f4-a7945ba3ca7c","Type":"ContainerStarted","Data":"f3598b67729aaab6318168333cf0eec02f1f5eced695bea506d75b270d492cad"} Jul 08 19:03:57.103958 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:57.103939 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzs6t" Jul 08 19:03:57.108676 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:57.108657 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzs6t" Jul 08 19:03:57.124343 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:57.124281 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzs6t" podStartSLOduration=1.6330712410000001 podStartE2EDuration="3.124266633s" totalImagesPullingTime="1.491195392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:03:57.123267278 +0000 UTC m=+305.515414090" watchObservedRunningTime="2026-07-08 19:03:57.124266633 +0000 UTC m=+305.516413418" Jul 08 19:03:59.349740 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:59.349706 2574 patch_prober.go:28] interesting pod/image-registry-b8b77d9f4-kz6lg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 19:03:59.350120 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:03:59.349767 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" podUID="93793458-6e1c-40f3-90ab-f52bb5c6cb66" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 19:04:01.053351 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:01.053301 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 19:04:01.120556 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:01.120479 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfd56" event={"ID":"fd1cc41f-157d-4890-adda-df6d4341f8bb","Type":"ContainerStarted","Data":"e2ad2a35a291c4e2211e9737db045935fc9b9899c3c2b6bf539118dce9426091"} Jul 08 19:04:01.218921 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:01.218885 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 19:04:02.125154 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:02.125116 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfd56" event={"ID":"fd1cc41f-157d-4890-adda-df6d4341f8bb","Type":"ContainerStarted","Data":"35d9db957c5cd9b799156c2648df650eb0eb48e8f73a78692cb09b6817e8bd00"} Jul 08 19:04:04.705564 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:04.705526 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-qv8f9"] Jul 08 19:04:04.708507 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:04.708491 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-qv8f9" Jul 08 19:04:04.711760 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:04.711730 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 19:04:04.711858 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:04.711813 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 19:04:04.711858 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:04.711821 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fq7pq\"" Jul 08 19:04:04.722395 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:04.722371 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-qv8f9"] Jul 08 19:04:04.849229 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:04.849137 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcxmz\" (UniqueName: \"kubernetes.io/projected/a9d1bd10-8b64-42ae-b83b-25a35131743b-kube-api-access-vcxmz\") pod \"downloads-685bfb5f64-qv8f9\" (UID: \"a9d1bd10-8b64-42ae-b83b-25a35131743b\") " pod="openshift-console/downloads-685bfb5f64-qv8f9" Jul 08 19:04:04.950081 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:04.950045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcxmz\" (UniqueName: \"kubernetes.io/projected/a9d1bd10-8b64-42ae-b83b-25a35131743b-kube-api-access-vcxmz\") pod \"downloads-685bfb5f64-qv8f9\" (UID: \"a9d1bd10-8b64-42ae-b83b-25a35131743b\") " pod="openshift-console/downloads-685bfb5f64-qv8f9" Jul 08 19:04:04.960901 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:04.960874 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcxmz\" (UniqueName: \"kubernetes.io/projected/a9d1bd10-8b64-42ae-b83b-25a35131743b-kube-api-access-vcxmz\") pod \"downloads-685bfb5f64-qv8f9\" (UID: \"a9d1bd10-8b64-42ae-b83b-25a35131743b\") " pod="openshift-console/downloads-685bfb5f64-qv8f9" Jul 08 19:04:05.017833 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:05.017795 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-qv8f9" Jul 08 19:04:05.137881 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:05.137802 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfd56" event={"ID":"fd1cc41f-157d-4890-adda-df6d4341f8bb","Type":"ContainerStarted","Data":"1cff92360c852b9beee282686e8b97264296d9183ee3f82de5fce76d7e051c2b"} Jul 08 19:04:05.157256 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:05.157222 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-qv8f9"] Jul 08 19:04:05.160661 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:04:05.160632 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d1bd10_8b64_42ae_b83b_25a35131743b.slice/crio-10597fd8df2bc95574d43d5b2ad88d10ae762004e0b8d55bedace3451124b750 WatchSource:0}: Error finding container 10597fd8df2bc95574d43d5b2ad88d10ae762004e0b8d55bedace3451124b750: Status 404 returned error can't find the container with id 10597fd8df2bc95574d43d5b2ad88d10ae762004e0b8d55bedace3451124b750 Jul 08 19:04:05.166853 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:05.166806 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wfd56" podStartSLOduration=33.449243935 podStartE2EDuration="41.166789267s" totalImagesPullingTime="7.717545332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:03:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:04:05.165779441 +0000 UTC m=+313.557926229" watchObservedRunningTime="2026-07-08 19:04:05.166789267 +0000 UTC m=+313.558936064" Jul 08 19:04:06.143003 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.142956 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-qv8f9" event={"ID":"a9d1bd10-8b64-42ae-b83b-25a35131743b","Type":"ContainerStarted","Data":"10597fd8df2bc95574d43d5b2ad88d10ae762004e0b8d55bedace3451124b750"} Jul 08 19:04:06.172242 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.172207 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7"] Jul 08 19:04:06.175494 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.175473 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:06.178031 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.178011 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 08 19:04:06.179305 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.179287 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 19:04:06.179495 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.179478 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 08 19:04:06.180310 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.180282 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-d54rw\"" Jul 08 19:04:06.180399 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.180319 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 19:04:06.180399 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.180324 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 19:04:06.194295 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.194265 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7"] Jul 08 19:04:06.215906 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.215869 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf"] Jul 08 19:04:06.219619 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.219598 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.222490 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.222443 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 19:04:06.222663 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.222566 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 19:04:06.222741 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.222682 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 19:04:06.222800 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.222781 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bhxg7\"" Jul 08 19:04:06.235703 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.235673 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf"] Jul 08 19:04:06.243382 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.243358 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-942n2"] Jul 08 19:04:06.246839 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.246819 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.251026 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.251002 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s95pz\"" Jul 08 19:04:06.251149 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.251053 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 19:04:06.251590 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.251571 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 19:04:06.251701 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.251610 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 19:04:06.361517 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.361486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8ed8e70-095c-4c79-b114-32d5de5f24b1-sys\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.361679 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.361523 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.361679 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.361546 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtqwc\" (UniqueName: \"kubernetes.io/projected/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-kube-api-access-wtqwc\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.361679 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.361583 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crw6r\" (UniqueName: \"kubernetes.io/projected/48fe2128-ab3d-419d-bb99-cf48834612a7-kube-api-access-crw6r\") pod \"openshift-state-metrics-54cf96dfcf-45jh7\" (UID: \"48fe2128-ab3d-419d-bb99-cf48834612a7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:06.361679 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.361607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.361679 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.361626 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8ed8e70-095c-4c79-b114-32d5de5f24b1-metrics-client-ca\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.361679 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.361651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.361884 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.361741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48fe2128-ab3d-419d-bb99-cf48834612a7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-45jh7\" (UID: \"48fe2128-ab3d-419d-bb99-cf48834612a7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:06.361884 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.361786 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.361884 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.361821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-tls\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.361884 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.361848 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.361884 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.361876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-wtmp\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.362111 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.361922 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/48fe2128-ab3d-419d-bb99-cf48834612a7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-45jh7\" (UID: \"48fe2128-ab3d-419d-bb99-cf48834612a7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:06.362111 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.361951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf22m\" (UniqueName: \"kubernetes.io/projected/f8ed8e70-095c-4c79-b114-32d5de5f24b1-kube-api-access-nf22m\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.362111 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.362009 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48fe2128-ab3d-419d-bb99-cf48834612a7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-45jh7\" (UID: \"48fe2128-ab3d-419d-bb99-cf48834612a7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:06.362111 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.362054 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.362111 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.362085 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8ed8e70-095c-4c79-b114-32d5de5f24b1-root\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.362268 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.362118 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-textfile\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.362268 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.362164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.463376 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.463376 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463296 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8ed8e70-095c-4c79-b114-32d5de5f24b1-root\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.463376 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463314 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-textfile\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.463376 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463358 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.463720 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463384 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8ed8e70-095c-4c79-b114-32d5de5f24b1-sys\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.463720 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463407 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8ed8e70-095c-4c79-b114-32d5de5f24b1-root\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.463720 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463413 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.463720 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463474 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtqwc\" (UniqueName: \"kubernetes.io/projected/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-kube-api-access-wtqwc\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.463720 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463478 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8ed8e70-095c-4c79-b114-32d5de5f24b1-sys\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.463720 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crw6r\" (UniqueName: \"kubernetes.io/projected/48fe2128-ab3d-419d-bb99-cf48834612a7-kube-api-access-crw6r\") pod \"openshift-state-metrics-54cf96dfcf-45jh7\" (UID: \"48fe2128-ab3d-419d-bb99-cf48834612a7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:06.463720 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.463720 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463548 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8ed8e70-095c-4c79-b114-32d5de5f24b1-metrics-client-ca\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.463720 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.463720 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463641 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48fe2128-ab3d-419d-bb99-cf48834612a7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-45jh7\" (UID: \"48fe2128-ab3d-419d-bb99-cf48834612a7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:06.463720 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.463720 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-tls\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.464367 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463739 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.464367 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463767 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-wtmp\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.464367 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/48fe2128-ab3d-419d-bb99-cf48834612a7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-45jh7\" (UID: \"48fe2128-ab3d-419d-bb99-cf48834612a7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:06.464367 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463873 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf22m\" (UniqueName: \"kubernetes.io/projected/f8ed8e70-095c-4c79-b114-32d5de5f24b1-kube-api-access-nf22m\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.464367 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463901 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.464367 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48fe2128-ab3d-419d-bb99-cf48834612a7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-45jh7\" (UID: \"48fe2128-ab3d-419d-bb99-cf48834612a7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:06.464367 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.464168 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.464367 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.463738 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-textfile\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.464367 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:04:06.464231 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 19:04:06.464367 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.464273 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.464367 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:04:06.464287 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-tls podName:f8ed8e70-095c-4c79-b114-32d5de5f24b1 nodeName:}" failed. No retries permitted until 2026-07-08 19:04:06.964269522 +0000 UTC m=+315.356416302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-tls") pod "node-exporter-942n2" (UID: "f8ed8e70-095c-4c79-b114-32d5de5f24b1") : secret "node-exporter-tls" not found Jul 08 19:04:06.464367 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.464296 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8ed8e70-095c-4c79-b114-32d5de5f24b1-metrics-client-ca\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.464990 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:04:06.464384 2574 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 08 19:04:06.464990 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:04:06.464433 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48fe2128-ab3d-419d-bb99-cf48834612a7-openshift-state-metrics-tls podName:48fe2128-ab3d-419d-bb99-cf48834612a7 nodeName:}" failed. No retries permitted until 2026-07-08 19:04:06.964416387 +0000 UTC m=+315.356563163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/48fe2128-ab3d-419d-bb99-cf48834612a7-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-45jh7" (UID: "48fe2128-ab3d-419d-bb99-cf48834612a7") : secret "openshift-state-metrics-tls" not found Jul 08 19:04:06.464990 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.464383 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.464990 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.464451 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-wtmp\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.464990 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.464742 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48fe2128-ab3d-419d-bb99-cf48834612a7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-45jh7\" (UID: \"48fe2128-ab3d-419d-bb99-cf48834612a7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:06.466267 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.466237 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.466533 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.466502 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.466635 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.466508 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.466700 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.466684 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48fe2128-ab3d-419d-bb99-cf48834612a7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-45jh7\" (UID: \"48fe2128-ab3d-419d-bb99-cf48834612a7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:06.475601 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.475568 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf22m\" (UniqueName: \"kubernetes.io/projected/f8ed8e70-095c-4c79-b114-32d5de5f24b1-kube-api-access-nf22m\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.475892 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.475873 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crw6r\" (UniqueName: \"kubernetes.io/projected/48fe2128-ab3d-419d-bb99-cf48834612a7-kube-api-access-crw6r\") pod \"openshift-state-metrics-54cf96dfcf-45jh7\" (UID: \"48fe2128-ab3d-419d-bb99-cf48834612a7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:06.476750 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.476725 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtqwc\" (UniqueName: \"kubernetes.io/projected/578fa707-8fdd-4bc2-81ae-e64e60d6dfe3-kube-api-access-wtqwc\") pod \"kube-state-metrics-7c9dbb8b7d-b9cqf\" (UID: \"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.529977 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.529943 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" Jul 08 19:04:06.679073 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.679038 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf"] Jul 08 19:04:06.682325 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:04:06.682293 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578fa707_8fdd_4bc2_81ae_e64e60d6dfe3.slice/crio-e30be204ce9e11621b770b236d202f5bda39c63045f88a607172b9f0e2c46e35 WatchSource:0}: Error finding container e30be204ce9e11621b770b236d202f5bda39c63045f88a607172b9f0e2c46e35: Status 404 returned error can't find the container with id e30be204ce9e11621b770b236d202f5bda39c63045f88a607172b9f0e2c46e35 Jul 08 19:04:06.968732 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.968692 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-tls\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.969020 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.968756 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/48fe2128-ab3d-419d-bb99-cf48834612a7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-45jh7\" (UID: \"48fe2128-ab3d-419d-bb99-cf48834612a7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:06.971437 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.971409 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8ed8e70-095c-4c79-b114-32d5de5f24b1-node-exporter-tls\") pod \"node-exporter-942n2\" (UID: \"f8ed8e70-095c-4c79-b114-32d5de5f24b1\") " pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:06.971639 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:06.971616 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/48fe2128-ab3d-419d-bb99-cf48834612a7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-45jh7\" (UID: \"48fe2128-ab3d-419d-bb99-cf48834612a7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:07.084963 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.084922 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" Jul 08 19:04:07.148366 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.148316 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" event={"ID":"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3","Type":"ContainerStarted","Data":"e30be204ce9e11621b770b236d202f5bda39c63045f88a607172b9f0e2c46e35"} Jul 08 19:04:07.157545 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.157514 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-942n2" Jul 08 19:04:07.169971 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:04:07.169942 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ed8e70_095c_4c79_b114_32d5de5f24b1.slice/crio-9333bbf04396e0804cbd088c93017996a279a0644aaf3dae6baff8f13aa07559 WatchSource:0}: Error finding container 9333bbf04396e0804cbd088c93017996a279a0644aaf3dae6baff8f13aa07559: Status 404 returned error can't find the container with id 9333bbf04396e0804cbd088c93017996a279a0644aaf3dae6baff8f13aa07559 Jul 08 19:04:07.225069 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.225040 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7"] Jul 08 19:04:07.228786 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:04:07.228754 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48fe2128_ab3d_419d_bb99_cf48834612a7.slice/crio-a137b10f0bee199ffc371f901c5d4b77fa5133bbfbd2a02c8741b7793eb780bd WatchSource:0}: Error finding container a137b10f0bee199ffc371f901c5d4b77fa5133bbfbd2a02c8741b7793eb780bd: Status 404 returned error can't find the container with id a137b10f0bee199ffc371f901c5d4b77fa5133bbfbd2a02c8741b7793eb780bd Jul 08 19:04:07.299614 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.299591 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:04:07.303717 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.303682 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.306006 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.305976 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 19:04:07.307135 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.306214 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 19:04:07.307135 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.306299 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 19:04:07.307135 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.306428 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 19:04:07.307135 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.306624 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 19:04:07.307135 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.306656 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 19:04:07.307135 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.306681 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 19:04:07.307135 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.306705 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 19:04:07.307135 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.306660 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rcxr8\"" Jul 08 19:04:07.307135 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.306910 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 19:04:07.320776 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.320746 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:04:07.372214 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.372156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62ee4492-fa30-4cef-91f6-53b456f7981a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.372370 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.372220 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.372370 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.372248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zknw9\" (UniqueName: \"kubernetes.io/projected/62ee4492-fa30-4cef-91f6-53b456f7981a-kube-api-access-zknw9\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.372370 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.372287 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62ee4492-fa30-4cef-91f6-53b456f7981a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.372370 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.372360 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-web-config\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.372598 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.372399 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-config-volume\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.372598 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.372425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62ee4492-fa30-4cef-91f6-53b456f7981a-config-out\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.372598 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.372450 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.372598 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.372483 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.372598 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.372513 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62ee4492-fa30-4cef-91f6-53b456f7981a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.372598 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.372541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.372598 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.372585 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.372890 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.372615 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62ee4492-fa30-4cef-91f6-53b456f7981a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.473400 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.473351 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.473589 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.473411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zknw9\" (UniqueName: \"kubernetes.io/projected/62ee4492-fa30-4cef-91f6-53b456f7981a-kube-api-access-zknw9\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.473589 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.473449 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62ee4492-fa30-4cef-91f6-53b456f7981a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.473589 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.473500 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-web-config\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.473589 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.473536 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-config-volume\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.473589 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.473562 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62ee4492-fa30-4cef-91f6-53b456f7981a-config-out\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.473589 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.473586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.473903 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.473615 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.473903 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.473646 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62ee4492-fa30-4cef-91f6-53b456f7981a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.473903 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.473673 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.473903 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.473713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.473903 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.473741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62ee4492-fa30-4cef-91f6-53b456f7981a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.473903 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.473774 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62ee4492-fa30-4cef-91f6-53b456f7981a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.474849 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.474819 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62ee4492-fa30-4cef-91f6-53b456f7981a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.477295 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.477239 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62ee4492-fa30-4cef-91f6-53b456f7981a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.477519 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.477494 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.477914 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.477895 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62ee4492-fa30-4cef-91f6-53b456f7981a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.478096 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.477914 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.478346 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.478309 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62ee4492-fa30-4cef-91f6-53b456f7981a-config-out\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.479213 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.479187 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-config-volume\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.479770 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.479730 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-web-config\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.479923 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.479897 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.480262 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.480238 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62ee4492-fa30-4cef-91f6-53b456f7981a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.480423 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.480388 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.481223 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.481202 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.483662 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.483614 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zknw9\" (UniqueName: \"kubernetes.io/projected/62ee4492-fa30-4cef-91f6-53b456f7981a-kube-api-access-zknw9\") pod \"alertmanager-main-0\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.615457 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.615422 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:04:07.787393 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:07.787367 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:04:07.789785 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:04:07.789743 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ee4492_fa30_4cef_91f6_53b456f7981a.slice/crio-fb6dbded1f2618d16d16dfef957387bc81e7f598bfcb309ea4fda2fbd6bef1d2 WatchSource:0}: Error finding container fb6dbded1f2618d16d16dfef957387bc81e7f598bfcb309ea4fda2fbd6bef1d2: Status 404 returned error can't find the container with id fb6dbded1f2618d16d16dfef957387bc81e7f598bfcb309ea4fda2fbd6bef1d2 Jul 08 19:04:08.157085 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:08.156989 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" event={"ID":"48fe2128-ab3d-419d-bb99-cf48834612a7","Type":"ContainerStarted","Data":"8fdb8b900bcd9ac539710ad7debaff4012dc7e905f57a8b70633b69e8ddb7b39"} Jul 08 19:04:08.157085 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:08.157066 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" event={"ID":"48fe2128-ab3d-419d-bb99-cf48834612a7","Type":"ContainerStarted","Data":"72aa21525485d78ec1a676a44eeaf94da5b391a3a79de65d5cdd631b3e156b08"} Jul 08 19:04:08.157615 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:08.157096 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" event={"ID":"48fe2128-ab3d-419d-bb99-cf48834612a7","Type":"ContainerStarted","Data":"a137b10f0bee199ffc371f901c5d4b77fa5133bbfbd2a02c8741b7793eb780bd"} Jul 08 19:04:08.160035 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:08.159939 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerStarted","Data":"fb6dbded1f2618d16d16dfef957387bc81e7f598bfcb309ea4fda2fbd6bef1d2"} Jul 08 19:04:08.161504 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:08.161469 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-942n2" event={"ID":"f8ed8e70-095c-4c79-b114-32d5de5f24b1","Type":"ContainerStarted","Data":"9333bbf04396e0804cbd088c93017996a279a0644aaf3dae6baff8f13aa07559"} Jul 08 19:04:09.170236 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:09.170192 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" event={"ID":"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3","Type":"ContainerStarted","Data":"115347b38a141951372406590990636c6d441a753137afd2146716f5bbd6efb8"} Jul 08 19:04:09.170699 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:09.170306 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" event={"ID":"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3","Type":"ContainerStarted","Data":"abab0faed85daaa207f75674a6965b72073228bbfd47516e650b31247974c32e"} Jul 08 19:04:09.170699 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:09.170344 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" event={"ID":"578fa707-8fdd-4bc2-81ae-e64e60d6dfe3","Type":"ContainerStarted","Data":"4a037e835fc762e7f40e5a8b0ebfef7f927eb422adba6866883c967fffcde878"} Jul 08 19:04:09.172053 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:09.172023 2574 generic.go:356] "Generic (PLEG): container finished" podID="f8ed8e70-095c-4c79-b114-32d5de5f24b1" containerID="aa19e5e7106895dbe15ecc183fbf3a2f327eadd32b3e8e62afabe41703ed4e7e" exitCode=0 Jul 08 19:04:09.172184 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:09.172106 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-942n2" event={"ID":"f8ed8e70-095c-4c79-b114-32d5de5f24b1","Type":"ContainerDied","Data":"aa19e5e7106895dbe15ecc183fbf3a2f327eadd32b3e8e62afabe41703ed4e7e"} Jul 08 19:04:09.175122 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:09.175075 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" event={"ID":"48fe2128-ab3d-419d-bb99-cf48834612a7","Type":"ContainerStarted","Data":"5eb85f84a20fc2326571bd538d9ed29d660d97f897bca50ce0a68377573bb843"} Jul 08 19:04:09.197276 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:09.197215 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b9cqf" podStartSLOduration=1.032716402 podStartE2EDuration="3.197193609s" totalImagesPullingTime="2.164477207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:04:09.195385474 +0000 UTC m=+317.587532286" watchObservedRunningTime="2026-07-08 19:04:09.197193609 +0000 UTC m=+317.589340402" Jul 08 19:04:09.270318 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:09.270272 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-45jh7" podStartSLOduration=1.784805407 podStartE2EDuration="3.270254401s" totalImagesPullingTime="1.485448994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:04:09.22693664 +0000 UTC m=+317.619083429" watchObservedRunningTime="2026-07-08 19:04:09.270254401 +0000 UTC m=+317.662401188" Jul 08 19:04:10.180629 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.180593 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-942n2" event={"ID":"f8ed8e70-095c-4c79-b114-32d5de5f24b1","Type":"ContainerStarted","Data":"a367496a2f0b0f28022b7b46f6f94048def08c670aae9c950844ced4e3f3c4be"} Jul 08 19:04:10.180960 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.180661 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-942n2" event={"ID":"f8ed8e70-095c-4c79-b114-32d5de5f24b1","Type":"ContainerStarted","Data":"54acb066dfff6481c811fcd4f385312d720b30edbf88c5c14b87b435741cfd9e"} Jul 08 19:04:10.208712 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.208663 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-942n2" podStartSLOduration=2.427253759 podStartE2EDuration="4.208646212s" totalImagesPullingTime="1.675857366s" totalInitContainerRuntime="105.535087ms" isStatefulPod=true podCreationTimestamp="2026-07-08 19:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:04:10.207967293 +0000 UTC m=+318.600114083" watchObservedRunningTime="2026-07-08 19:04:10.208646212 +0000 UTC m=+318.600793000" Jul 08 19:04:10.687446 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.687408 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-55b4797f49-nmvbf"] Jul 08 19:04:10.690641 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.690618 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.694666 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.694610 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 19:04:10.694666 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.694607 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 08 19:04:10.694907 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.694609 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rbxqf\"" Jul 08 19:04:10.694907 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.694714 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bild5nd27o9sd\"" Jul 08 19:04:10.694907 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.694622 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 08 19:04:10.694907 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.694607 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 08 19:04:10.703557 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.703532 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7b0ad615-5c96-4b10-9d86-9c50ce582b06-audit-log\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.703677 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.703570 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5ss6\" (UniqueName: \"kubernetes.io/projected/7b0ad615-5c96-4b10-9d86-9c50ce582b06-kube-api-access-z5ss6\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.703677 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.703598 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b0ad615-5c96-4b10-9d86-9c50ce582b06-client-ca-bundle\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.703756 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.703677 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7b0ad615-5c96-4b10-9d86-9c50ce582b06-metrics-server-audit-profiles\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.703756 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.703740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0ad615-5c96-4b10-9d86-9c50ce582b06-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.703823 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.703770 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7b0ad615-5c96-4b10-9d86-9c50ce582b06-secret-metrics-server-tls\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.703823 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.703788 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7b0ad615-5c96-4b10-9d86-9c50ce582b06-secret-metrics-server-client-certs\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.709001 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.708975 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55b4797f49-nmvbf"] Jul 08 19:04:10.804754 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.804721 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b0ad615-5c96-4b10-9d86-9c50ce582b06-client-ca-bundle\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.804945 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.804770 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7b0ad615-5c96-4b10-9d86-9c50ce582b06-metrics-server-audit-profiles\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.804945 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.804826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0ad615-5c96-4b10-9d86-9c50ce582b06-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.804945 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.804860 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7b0ad615-5c96-4b10-9d86-9c50ce582b06-secret-metrics-server-tls\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.804945 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.804911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7b0ad615-5c96-4b10-9d86-9c50ce582b06-secret-metrics-server-client-certs\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.805106 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.804971 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7b0ad615-5c96-4b10-9d86-9c50ce582b06-audit-log\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.805106 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.805004 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5ss6\" (UniqueName: \"kubernetes.io/projected/7b0ad615-5c96-4b10-9d86-9c50ce582b06-kube-api-access-z5ss6\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.805486 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.805460 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7b0ad615-5c96-4b10-9d86-9c50ce582b06-audit-log\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.805712 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.805692 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0ad615-5c96-4b10-9d86-9c50ce582b06-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.806164 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.806140 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7b0ad615-5c96-4b10-9d86-9c50ce582b06-metrics-server-audit-profiles\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.807371 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.807345 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7b0ad615-5c96-4b10-9d86-9c50ce582b06-secret-metrics-server-tls\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.807444 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.807403 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b0ad615-5c96-4b10-9d86-9c50ce582b06-client-ca-bundle\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.807508 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.807491 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7b0ad615-5c96-4b10-9d86-9c50ce582b06-secret-metrics-server-client-certs\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:10.814367 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:10.814344 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5ss6\" (UniqueName: \"kubernetes.io/projected/7b0ad615-5c96-4b10-9d86-9c50ce582b06-kube-api-access-z5ss6\") pod \"metrics-server-55b4797f49-nmvbf\" (UID: \"7b0ad615-5c96-4b10-9d86-9c50ce582b06\") " pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:11.000178 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:11.000139 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:11.138581 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:11.138550 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55b4797f49-nmvbf"] Jul 08 19:04:11.141942 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:04:11.141913 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b0ad615_5c96_4b10_9d86_9c50ce582b06.slice/crio-01c4e09ab16431ab8a6c4c77a3315ba8498022ab452f455421ac6aa0cc198f5f WatchSource:0}: Error finding container 01c4e09ab16431ab8a6c4c77a3315ba8498022ab452f455421ac6aa0cc198f5f: Status 404 returned error can't find the container with id 01c4e09ab16431ab8a6c4c77a3315ba8498022ab452f455421ac6aa0cc198f5f Jul 08 19:04:11.187811 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:11.187780 2574 generic.go:356] "Generic (PLEG): container finished" podID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerID="2a28db66f1932c664e705094491c1c970f47c819b47eec08fb61b14116bde217" exitCode=0 Jul 08 19:04:11.188255 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:11.187876 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerDied","Data":"2a28db66f1932c664e705094491c1c970f47c819b47eec08fb61b14116bde217"} Jul 08 19:04:11.189315 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:11.189288 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" event={"ID":"7b0ad615-5c96-4b10-9d86-9c50ce582b06","Type":"ContainerStarted","Data":"01c4e09ab16431ab8a6c4c77a3315ba8498022ab452f455421ac6aa0cc198f5f"} Jul 08 19:04:12.545640 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.545603 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:04:12.557302 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.557276 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.563840 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.563642 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 19:04:12.563840 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.563683 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 19:04:12.563840 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.563715 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 19:04:12.564358 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.564294 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 19:04:12.564723 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.564702 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 19:04:12.564894 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.564834 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 19:04:12.564995 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.564978 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 19:04:12.565049 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.565035 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 19:04:12.565428 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.565173 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 19:04:12.565428 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.565182 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 19:04:12.565428 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.565405 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-70vaqsj00e7c5\"" Jul 08 19:04:12.565589 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.565441 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hfqcc\"" Jul 08 19:04:12.565767 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.565668 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 19:04:12.568232 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.568213 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 19:04:12.569279 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.569259 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 19:04:12.570638 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.570619 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 19:04:12.579954 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.579924 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:04:12.619002 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.618965 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.619287 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.619430 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.619430 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619378 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.619575 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.619575 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619497 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.619675 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619554 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z74z9\" (UniqueName: \"kubernetes.io/projected/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-kube-api-access-z74z9\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.619675 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.619675 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619634 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.619825 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.619825 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.619924 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619840 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.619924 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619878 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.619924 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.620055 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619949 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.620055 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.619978 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.620055 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.620005 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.620055 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.620035 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.620246 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.620095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.620246 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.620154 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-config\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.721627 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.721588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.721793 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.721655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-config\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.721793 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.721691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.721793 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.721720 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.721793 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.721747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.721793 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.721793 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.722077 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.721834 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.722077 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.721872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.722077 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.721901 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z74z9\" (UniqueName: \"kubernetes.io/projected/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-kube-api-access-z74z9\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.722077 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.721931 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.722077 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.721962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.722077 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.722019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.722077 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.722047 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.722077 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.722077 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.722485 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.722115 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.722485 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.722146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.722485 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.722180 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.722485 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.722209 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.722485 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.722244 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.722485 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.722279 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.723667 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.722948 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.724944 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.724571 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.725406 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.725256 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.725406 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.725271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.725406 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.725386 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.725717 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.725693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-config\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.726346 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.726297 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.727167 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.727121 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.729581 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.728716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.730139 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.730095 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.730924 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.730893 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.730993 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.730900 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.730993 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.730969 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.730993 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.730974 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.731491 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.731310 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.731569 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.731520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.731569 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.731551 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.731694 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.731602 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.733563 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.733535 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.734028 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.734008 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z74z9\" (UniqueName: \"kubernetes.io/projected/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-kube-api-access-z74z9\") pod \"prometheus-k8s-0\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:12.869967 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:12.869875 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:13.189375 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:13.188950 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:04:13.200399 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:13.200368 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" event={"ID":"7b0ad615-5c96-4b10-9d86-9c50ce582b06","Type":"ContainerStarted","Data":"26ec9390c5e75dc64a67574bef993a25f65a1427e304c94c5f2f11e2abb3ef88"} Jul 08 19:04:13.201728 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:13.201702 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerStarted","Data":"1254210d2bcb12f7c1aa5df5cf38d30369fdf294c82c0335bc306342f7c0f827"} Jul 08 19:04:13.234987 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:13.234933 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" podStartSLOduration=1.345098091 podStartE2EDuration="3.234917582s" totalImagesPullingTime="1.889819491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:04:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:04:13.232732622 +0000 UTC m=+321.624879410" watchObservedRunningTime="2026-07-08 19:04:13.234917582 +0000 UTC m=+321.627064420" Jul 08 19:04:14.210965 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:14.210929 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerStarted","Data":"ec12c9713ce3b829dfbda44cfdb4d53ed75e8cd6cb75a3b0c28dfbb4ec50e3e7"} Jul 08 19:04:14.211456 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:14.211012 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerStarted","Data":"78deb2d711b86672d02c844f8043b2ecf052cd9c92b68caa79725756b6a1c2ce"} Jul 08 19:04:14.211456 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:14.211044 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerStarted","Data":"6ac847c8332434a2dad60ca2a21a36c325cf248556a1669c28273c9157329422"} Jul 08 19:04:14.211456 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:14.211084 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerStarted","Data":"211fde5e7616a56d89e571425f7bad3cfe31008e9237131e6753d2ef38a7da26"} Jul 08 19:04:14.211456 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:14.211130 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerStarted","Data":"70318fd3090796240c3c5874b9be3c0a7d111d1755ba7c1d03cb0a8381d68f0d"} Jul 08 19:04:14.212799 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:14.212733 2574 generic.go:356] "Generic (PLEG): container finished" podID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerID="16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990" exitCode=0 Jul 08 19:04:14.213053 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:14.212825 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerDied","Data":"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990"} Jul 08 19:04:14.452019 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:14.451982 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b8b77d9f4-kz6lg"] Jul 08 19:04:15.219979 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:15.219881 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerStarted","Data":"cb9849b8be6540b2ef61c7a632337b0202956f2e1c053ed186d825238acf80e3"} Jul 08 19:04:15.253365 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:15.253283 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.537878165 podStartE2EDuration="8.253268235s" totalImagesPullingTime="5.696784138s" totalInitContainerRuntime="18.605932ms" isStatefulPod=false podCreationTimestamp="2026-07-08 19:04:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:04:15.251957673 +0000 UTC m=+323.644104463" watchObservedRunningTime="2026-07-08 19:04:15.253268235 +0000 UTC m=+323.645415055" Jul 08 19:04:18.237318 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:18.237167 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerStarted","Data":"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010"} Jul 08 19:04:18.237318 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:18.237269 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerStarted","Data":"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b"} Jul 08 19:04:20.251282 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:20.251247 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerStarted","Data":"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63"} Jul 08 19:04:21.257945 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:21.257911 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerStarted","Data":"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120"} Jul 08 19:04:21.258364 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:21.257973 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerStarted","Data":"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae"} Jul 08 19:04:21.258364 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:21.257999 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerStarted","Data":"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84"} Jul 08 19:04:21.291467 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:21.291400 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.489783315 podStartE2EDuration="9.291377535s" totalImagesPullingTime="5.781485592s" totalInitContainerRuntime="20.108628ms" isStatefulPod=false podCreationTimestamp="2026-07-08 19:04:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:04:21.289060162 +0000 UTC m=+329.681206949" watchObservedRunningTime="2026-07-08 19:04:21.291377535 +0000 UTC m=+329.683524324" Jul 08 19:04:22.869974 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:22.869941 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:04:31.000262 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:31.000222 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:31.000773 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:31.000298 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:32.310598 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:32.310558 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-qv8f9" event={"ID":"a9d1bd10-8b64-42ae-b83b-25a35131743b","Type":"ContainerStarted","Data":"c53ba5d3b3c1f6e2221849ba189430f0e633ec5add16e71c427f3c7377ac2193"} Jul 08 19:04:32.311016 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:32.310998 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-qv8f9" Jul 08 19:04:32.312483 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:32.312452 2574 patch_prober.go:28] interesting pod/downloads-685bfb5f64-qv8f9 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.16:8080/\": dial tcp 10.132.0.16:8080: connect: connection refused" start-of-body= Jul 08 19:04:32.312626 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:32.312504 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-qv8f9" podUID="a9d1bd10-8b64-42ae-b83b-25a35131743b" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.16:8080/\": dial tcp 10.132.0.16:8080: connect: connection refused" Jul 08 19:04:32.336753 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:32.336655 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-qv8f9" podStartSLOduration=1.432617684 podStartE2EDuration="28.3366385s" totalImagesPullingTime="26.904020816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:04:32.335046242 +0000 UTC m=+340.727193047" watchObservedRunningTime="2026-07-08 19:04:32.3366385 +0000 UTC m=+340.728785319" Jul 08 19:04:33.331086 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:33.331057 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-qv8f9" Jul 08 19:04:39.479147 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.479081 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" podUID="93793458-6e1c-40f3-90ab-f52bb5c6cb66" containerName="registry" containerID="cri-o://33e541d7c40f5f296a46b1a05845583c4ae621e869df53f1f16b66814c310d15" gracePeriod=30 Jul 08 19:04:39.782847 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.782810 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 19:04:39.899861 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.899823 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93793458-6e1c-40f3-90ab-f52bb5c6cb66-ca-trust-extracted\") pod \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " Jul 08 19:04:39.900045 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.899892 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls\") pod \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " Jul 08 19:04:39.900045 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.899942 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs7vl\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-kube-api-access-xs7vl\") pod \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " Jul 08 19:04:39.900045 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.899969 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93793458-6e1c-40f3-90ab-f52bb5c6cb66-trusted-ca\") pod \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " Jul 08 19:04:39.900045 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.900018 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93793458-6e1c-40f3-90ab-f52bb5c6cb66-image-registry-private-configuration\") pod \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " Jul 08 19:04:39.900271 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.900047 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-bound-sa-token\") pod \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " Jul 08 19:04:39.900271 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.900070 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-certificates\") pod \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " Jul 08 19:04:39.900271 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.900129 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93793458-6e1c-40f3-90ab-f52bb5c6cb66-installation-pull-secrets\") pod \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\" (UID: \"93793458-6e1c-40f3-90ab-f52bb5c6cb66\") " Jul 08 19:04:39.902984 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.901392 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93793458-6e1c-40f3-90ab-f52bb5c6cb66-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "93793458-6e1c-40f3-90ab-f52bb5c6cb66" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:04:39.902984 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.901473 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "93793458-6e1c-40f3-90ab-f52bb5c6cb66" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:04:39.902984 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.901802 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-certificates\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:04:39.902984 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.901823 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93793458-6e1c-40f3-90ab-f52bb5c6cb66-trusted-ca\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:04:39.909855 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.909410 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "93793458-6e1c-40f3-90ab-f52bb5c6cb66" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:04:39.910397 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.910343 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93793458-6e1c-40f3-90ab-f52bb5c6cb66-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "93793458-6e1c-40f3-90ab-f52bb5c6cb66" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:04:39.911669 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.911635 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "93793458-6e1c-40f3-90ab-f52bb5c6cb66" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:04:39.912499 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.912305 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93793458-6e1c-40f3-90ab-f52bb5c6cb66-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "93793458-6e1c-40f3-90ab-f52bb5c6cb66" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:04:39.913740 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.913703 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-kube-api-access-xs7vl" (OuterVolumeSpecName: "kube-api-access-xs7vl") pod "93793458-6e1c-40f3-90ab-f52bb5c6cb66" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66"). InnerVolumeSpecName "kube-api-access-xs7vl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:04:39.918977 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:39.918950 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93793458-6e1c-40f3-90ab-f52bb5c6cb66-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "93793458-6e1c-40f3-90ab-f52bb5c6cb66" (UID: "93793458-6e1c-40f3-90ab-f52bb5c6cb66"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:04:40.002961 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.002874 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93793458-6e1c-40f3-90ab-f52bb5c6cb66-installation-pull-secrets\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:04:40.002961 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.002905 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93793458-6e1c-40f3-90ab-f52bb5c6cb66-ca-trust-extracted\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:04:40.002961 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.002916 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-registry-tls\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:04:40.002961 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.002924 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs7vl\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-kube-api-access-xs7vl\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:04:40.002961 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.002934 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93793458-6e1c-40f3-90ab-f52bb5c6cb66-image-registry-private-configuration\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:04:40.002961 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.002943 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93793458-6e1c-40f3-90ab-f52bb5c6cb66-bound-sa-token\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:04:40.356648 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.356565 2574 generic.go:356] "Generic (PLEG): container finished" podID="93793458-6e1c-40f3-90ab-f52bb5c6cb66" containerID="33e541d7c40f5f296a46b1a05845583c4ae621e869df53f1f16b66814c310d15" exitCode=0 Jul 08 19:04:40.356648 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.356636 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" Jul 08 19:04:40.356867 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.356636 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" event={"ID":"93793458-6e1c-40f3-90ab-f52bb5c6cb66","Type":"ContainerDied","Data":"33e541d7c40f5f296a46b1a05845583c4ae621e869df53f1f16b66814c310d15"} Jul 08 19:04:40.356867 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.356706 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8b77d9f4-kz6lg" event={"ID":"93793458-6e1c-40f3-90ab-f52bb5c6cb66","Type":"ContainerDied","Data":"8d86e1b552a480698157fc9c9cad4150c0e9b005229fbd92977da405e46f0a6f"} Jul 08 19:04:40.356867 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.356729 2574 scope.go:117] "RemoveContainer" containerID="33e541d7c40f5f296a46b1a05845583c4ae621e869df53f1f16b66814c310d15" Jul 08 19:04:40.366565 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.366542 2574 scope.go:117] "RemoveContainer" containerID="33e541d7c40f5f296a46b1a05845583c4ae621e869df53f1f16b66814c310d15" Jul 08 19:04:40.366957 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:04:40.366931 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33e541d7c40f5f296a46b1a05845583c4ae621e869df53f1f16b66814c310d15\": container with ID starting with 33e541d7c40f5f296a46b1a05845583c4ae621e869df53f1f16b66814c310d15 not found: ID does not exist" containerID="33e541d7c40f5f296a46b1a05845583c4ae621e869df53f1f16b66814c310d15" Jul 08 19:04:40.367039 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.366974 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e541d7c40f5f296a46b1a05845583c4ae621e869df53f1f16b66814c310d15"} err="failed to get container status \"33e541d7c40f5f296a46b1a05845583c4ae621e869df53f1f16b66814c310d15\": rpc error: code = NotFound desc = could not find container \"33e541d7c40f5f296a46b1a05845583c4ae621e869df53f1f16b66814c310d15\": container with ID starting with 33e541d7c40f5f296a46b1a05845583c4ae621e869df53f1f16b66814c310d15 not found: ID does not exist" Jul 08 19:04:40.374920 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.374893 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b8b77d9f4-kz6lg"] Jul 08 19:04:40.379600 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:40.379575 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b8b77d9f4-kz6lg"] Jul 08 19:04:42.224465 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:42.224431 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93793458-6e1c-40f3-90ab-f52bb5c6cb66" path="/var/lib/kubelet/pods/93793458-6e1c-40f3-90ab-f52bb5c6cb66/volumes" Jul 08 19:04:43.370383 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:43.370314 2574 generic.go:356] "Generic (PLEG): container finished" podID="7341c637-b13e-4a5f-b7e5-2701bf8337a4" containerID="aac5cb3da156e7dedbb1cc8d5555d29ee05e1df6dddbcd31465aa19356a64cc6" exitCode=0 Jul 08 19:04:43.370788 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:43.370393 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" event={"ID":"7341c637-b13e-4a5f-b7e5-2701bf8337a4","Type":"ContainerDied","Data":"aac5cb3da156e7dedbb1cc8d5555d29ee05e1df6dddbcd31465aa19356a64cc6"} Jul 08 19:04:43.370788 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:43.370773 2574 scope.go:117] "RemoveContainer" containerID="aac5cb3da156e7dedbb1cc8d5555d29ee05e1df6dddbcd31465aa19356a64cc6" Jul 08 19:04:43.989485 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:43.989457 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-thtdt_6040d8e3-4ec5-4988-8f52-2df87ad31a3e/serve-healthcheck-canary/0.log" Jul 08 19:04:44.376813 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:44.376732 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-9xbz2" event={"ID":"7341c637-b13e-4a5f-b7e5-2701bf8337a4","Type":"ContainerStarted","Data":"b6d37548bb9f096b58261319d9e39e9afc221ab1b197ed50c9f4bb141723462a"} Jul 08 19:04:51.006318 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:51.006285 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:04:51.010246 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:04:51.010218 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-55b4797f49-nmvbf" Jul 08 19:05:06.229926 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:06.229892 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 19:05:06.232240 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:06.232214 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c146ab4-0d07-4951-9d48-bfff5ab7acef-metrics-certs\") pod \"network-metrics-daemon-k4pww\" (UID: \"9c146ab4-0d07-4951-9d48-bfff5ab7acef\") " pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 19:05:06.322186 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:06.322158 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gvgdf\"" Jul 08 19:05:06.330188 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:06.330163 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4pww" Jul 08 19:05:06.500704 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:06.500602 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k4pww"] Jul 08 19:05:06.504207 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:05:06.504177 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c146ab4_0d07_4951_9d48_bfff5ab7acef.slice/crio-9b2faf9999709e067fd8166cd6d2a0fd60875ee1cbec67e35b404f880d319839 WatchSource:0}: Error finding container 9b2faf9999709e067fd8166cd6d2a0fd60875ee1cbec67e35b404f880d319839: Status 404 returned error can't find the container with id 9b2faf9999709e067fd8166cd6d2a0fd60875ee1cbec67e35b404f880d319839 Jul 08 19:05:07.476643 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:07.476601 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k4pww" event={"ID":"9c146ab4-0d07-4951-9d48-bfff5ab7acef","Type":"ContainerStarted","Data":"9b2faf9999709e067fd8166cd6d2a0fd60875ee1cbec67e35b404f880d319839"} Jul 08 19:05:09.485640 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:09.485599 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k4pww" event={"ID":"9c146ab4-0d07-4951-9d48-bfff5ab7acef","Type":"ContainerStarted","Data":"e4f5b8074c1c0fb4dc8e4d9849cd9adce8fc5cccbbd054b0687ea613c1306e44"} Jul 08 19:05:09.486044 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:09.485668 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k4pww" event={"ID":"9c146ab4-0d07-4951-9d48-bfff5ab7acef","Type":"ContainerStarted","Data":"1bc18b92f7354b272ddbdc4257d8945e7b2c1a9cf3357eefd9e7b44a47994d8b"} Jul 08 19:05:09.507634 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:09.507581 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k4pww" podStartSLOduration=375.629469021 podStartE2EDuration="6m17.507564586s" totalImagesPullingTime="1.878095565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:09.506385165 +0000 UTC m=+377.898531975" watchObservedRunningTime="2026-07-08 19:05:09.507564586 +0000 UTC m=+377.899711373" Jul 08 19:05:12.870105 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:12.870064 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:12.938642 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:12.938616 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:13.516025 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:13.515997 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:26.533455 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:26.533419 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:05:26.550164 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:26.550124 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="alertmanager" containerID="cri-o://70318fd3090796240c3c5874b9be3c0a7d111d1755ba7c1d03cb0a8381d68f0d" gracePeriod=120 Jul 08 19:05:26.550411 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:26.550191 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="kube-rbac-proxy-metric" containerID="cri-o://ec12c9713ce3b829dfbda44cfdb4d53ed75e8cd6cb75a3b0c28dfbb4ec50e3e7" gracePeriod=120 Jul 08 19:05:26.550411 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:26.550215 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="prom-label-proxy" containerID="cri-o://cb9849b8be6540b2ef61c7a632337b0202956f2e1c053ed186d825238acf80e3" gracePeriod=120 Jul 08 19:05:26.550411 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:26.550244 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="config-reloader" containerID="cri-o://211fde5e7616a56d89e571425f7bad3cfe31008e9237131e6753d2ef38a7da26" gracePeriod=120 Jul 08 19:05:26.550411 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:26.550247 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="kube-rbac-proxy-web" containerID="cri-o://6ac847c8332434a2dad60ca2a21a36c325cf248556a1669c28273c9157329422" gracePeriod=120 Jul 08 19:05:26.550411 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:26.550322 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="kube-rbac-proxy" containerID="cri-o://78deb2d711b86672d02c844f8043b2ecf052cd9c92b68caa79725756b6a1c2ce" gracePeriod=120 Jul 08 19:05:27.557517 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.557486 2574 generic.go:356] "Generic (PLEG): container finished" podID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerID="cb9849b8be6540b2ef61c7a632337b0202956f2e1c053ed186d825238acf80e3" exitCode=0 Jul 08 19:05:27.557517 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.557510 2574 generic.go:356] "Generic (PLEG): container finished" podID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerID="ec12c9713ce3b829dfbda44cfdb4d53ed75e8cd6cb75a3b0c28dfbb4ec50e3e7" exitCode=0 Jul 08 19:05:27.557517 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.557518 2574 generic.go:356] "Generic (PLEG): container finished" podID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerID="78deb2d711b86672d02c844f8043b2ecf052cd9c92b68caa79725756b6a1c2ce" exitCode=0 Jul 08 19:05:27.557517 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.557523 2574 generic.go:356] "Generic (PLEG): container finished" podID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerID="211fde5e7616a56d89e571425f7bad3cfe31008e9237131e6753d2ef38a7da26" exitCode=0 Jul 08 19:05:27.558087 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.557529 2574 generic.go:356] "Generic (PLEG): container finished" podID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerID="70318fd3090796240c3c5874b9be3c0a7d111d1755ba7c1d03cb0a8381d68f0d" exitCode=0 Jul 08 19:05:27.558087 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.557556 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerDied","Data":"cb9849b8be6540b2ef61c7a632337b0202956f2e1c053ed186d825238acf80e3"} Jul 08 19:05:27.558087 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.557636 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerDied","Data":"ec12c9713ce3b829dfbda44cfdb4d53ed75e8cd6cb75a3b0c28dfbb4ec50e3e7"} Jul 08 19:05:27.558087 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.557683 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerDied","Data":"78deb2d711b86672d02c844f8043b2ecf052cd9c92b68caa79725756b6a1c2ce"} Jul 08 19:05:27.558087 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.557722 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerDied","Data":"211fde5e7616a56d89e571425f7bad3cfe31008e9237131e6753d2ef38a7da26"} Jul 08 19:05:27.558087 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.557762 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerDied","Data":"70318fd3090796240c3c5874b9be3c0a7d111d1755ba7c1d03cb0a8381d68f0d"} Jul 08 19:05:27.790006 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.789979 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:27.925312 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.925218 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62ee4492-fa30-4cef-91f6-53b456f7981a-metrics-client-ca\") pod \"62ee4492-fa30-4cef-91f6-53b456f7981a\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " Jul 08 19:05:27.925312 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.925278 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy\") pod \"62ee4492-fa30-4cef-91f6-53b456f7981a\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " Jul 08 19:05:27.925312 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.925311 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-web-config\") pod \"62ee4492-fa30-4cef-91f6-53b456f7981a\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " Jul 08 19:05:27.925614 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.925369 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"62ee4492-fa30-4cef-91f6-53b456f7981a\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " Jul 08 19:05:27.925614 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.925393 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-cluster-tls-config\") pod \"62ee4492-fa30-4cef-91f6-53b456f7981a\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " Jul 08 19:05:27.925614 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.925422 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62ee4492-fa30-4cef-91f6-53b456f7981a-tls-assets\") pod \"62ee4492-fa30-4cef-91f6-53b456f7981a\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " Jul 08 19:05:27.925614 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.925467 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-main-tls\") pod \"62ee4492-fa30-4cef-91f6-53b456f7981a\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " Jul 08 19:05:27.925614 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.925500 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62ee4492-fa30-4cef-91f6-53b456f7981a-alertmanager-trusted-ca-bundle\") pod \"62ee4492-fa30-4cef-91f6-53b456f7981a\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " Jul 08 19:05:27.925614 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.925546 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62ee4492-fa30-4cef-91f6-53b456f7981a-alertmanager-main-db\") pod \"62ee4492-fa30-4cef-91f6-53b456f7981a\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " Jul 08 19:05:27.925614 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.925569 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-config-volume\") pod \"62ee4492-fa30-4cef-91f6-53b456f7981a\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " Jul 08 19:05:27.925614 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.925603 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy-web\") pod \"62ee4492-fa30-4cef-91f6-53b456f7981a\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " Jul 08 19:05:27.926028 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.925659 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62ee4492-fa30-4cef-91f6-53b456f7981a-config-out\") pod \"62ee4492-fa30-4cef-91f6-53b456f7981a\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " Jul 08 19:05:27.926028 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.925699 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62ee4492-fa30-4cef-91f6-53b456f7981a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "62ee4492-fa30-4cef-91f6-53b456f7981a" (UID: "62ee4492-fa30-4cef-91f6-53b456f7981a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:05:27.926028 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.925711 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zknw9\" (UniqueName: \"kubernetes.io/projected/62ee4492-fa30-4cef-91f6-53b456f7981a-kube-api-access-zknw9\") pod \"62ee4492-fa30-4cef-91f6-53b456f7981a\" (UID: \"62ee4492-fa30-4cef-91f6-53b456f7981a\") " Jul 08 19:05:27.926028 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.926000 2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62ee4492-fa30-4cef-91f6-53b456f7981a-metrics-client-ca\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:27.926282 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.926254 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ee4492-fa30-4cef-91f6-53b456f7981a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "62ee4492-fa30-4cef-91f6-53b456f7981a" (UID: "62ee4492-fa30-4cef-91f6-53b456f7981a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:05:27.926477 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.926429 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62ee4492-fa30-4cef-91f6-53b456f7981a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "62ee4492-fa30-4cef-91f6-53b456f7981a" (UID: "62ee4492-fa30-4cef-91f6-53b456f7981a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:05:27.928633 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.928444 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "62ee4492-fa30-4cef-91f6-53b456f7981a" (UID: "62ee4492-fa30-4cef-91f6-53b456f7981a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:27.928928 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.928815 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62ee4492-fa30-4cef-91f6-53b456f7981a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "62ee4492-fa30-4cef-91f6-53b456f7981a" (UID: "62ee4492-fa30-4cef-91f6-53b456f7981a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:05:27.929107 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.929070 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "62ee4492-fa30-4cef-91f6-53b456f7981a" (UID: "62ee4492-fa30-4cef-91f6-53b456f7981a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:27.929180 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.929157 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "62ee4492-fa30-4cef-91f6-53b456f7981a" (UID: "62ee4492-fa30-4cef-91f6-53b456f7981a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:27.929246 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.929218 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "62ee4492-fa30-4cef-91f6-53b456f7981a" (UID: "62ee4492-fa30-4cef-91f6-53b456f7981a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:27.929681 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.929656 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ee4492-fa30-4cef-91f6-53b456f7981a-config-out" (OuterVolumeSpecName: "config-out") pod "62ee4492-fa30-4cef-91f6-53b456f7981a" (UID: "62ee4492-fa30-4cef-91f6-53b456f7981a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:05:27.929800 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.929665 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62ee4492-fa30-4cef-91f6-53b456f7981a-kube-api-access-zknw9" (OuterVolumeSpecName: "kube-api-access-zknw9") pod "62ee4492-fa30-4cef-91f6-53b456f7981a" (UID: "62ee4492-fa30-4cef-91f6-53b456f7981a"). InnerVolumeSpecName "kube-api-access-zknw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:05:27.930073 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.930049 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-config-volume" (OuterVolumeSpecName: "config-volume") pod "62ee4492-fa30-4cef-91f6-53b456f7981a" (UID: "62ee4492-fa30-4cef-91f6-53b456f7981a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:27.933073 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.933040 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "62ee4492-fa30-4cef-91f6-53b456f7981a" (UID: "62ee4492-fa30-4cef-91f6-53b456f7981a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:27.941119 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:27.941083 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-web-config" (OuterVolumeSpecName: "web-config") pod "62ee4492-fa30-4cef-91f6-53b456f7981a" (UID: "62ee4492-fa30-4cef-91f6-53b456f7981a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:28.027091 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.027061 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-main-tls\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:28.027091 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.027086 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62ee4492-fa30-4cef-91f6-53b456f7981a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:28.027091 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.027096 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62ee4492-fa30-4cef-91f6-53b456f7981a-alertmanager-main-db\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:28.027316 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.027105 2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-config-volume\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:28.027316 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.027114 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:28.027316 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.027122 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62ee4492-fa30-4cef-91f6-53b456f7981a-config-out\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:28.027316 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.027131 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zknw9\" (UniqueName: \"kubernetes.io/projected/62ee4492-fa30-4cef-91f6-53b456f7981a-kube-api-access-zknw9\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:28.027316 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.027139 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:28.027316 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.027149 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-web-config\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:28.027316 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.027158 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:28.027316 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.027166 2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62ee4492-fa30-4cef-91f6-53b456f7981a-cluster-tls-config\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:28.027316 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.027177 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62ee4492-fa30-4cef-91f6-53b456f7981a-tls-assets\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:28.564689 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.564600 2574 generic.go:356] "Generic (PLEG): container finished" podID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerID="6ac847c8332434a2dad60ca2a21a36c325cf248556a1669c28273c9157329422" exitCode=0 Jul 08 19:05:28.565052 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.564678 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerDied","Data":"6ac847c8332434a2dad60ca2a21a36c325cf248556a1669c28273c9157329422"} Jul 08 19:05:28.565052 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.564695 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.565052 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.564792 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62ee4492-fa30-4cef-91f6-53b456f7981a","Type":"ContainerDied","Data":"fb6dbded1f2618d16d16dfef957387bc81e7f598bfcb309ea4fda2fbd6bef1d2"} Jul 08 19:05:28.565052 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.564842 2574 scope.go:117] "RemoveContainer" containerID="cb9849b8be6540b2ef61c7a632337b0202956f2e1c053ed186d825238acf80e3" Jul 08 19:05:28.574250 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.574231 2574 scope.go:117] "RemoveContainer" containerID="ec12c9713ce3b829dfbda44cfdb4d53ed75e8cd6cb75a3b0c28dfbb4ec50e3e7" Jul 08 19:05:28.581528 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.581508 2574 scope.go:117] "RemoveContainer" containerID="78deb2d711b86672d02c844f8043b2ecf052cd9c92b68caa79725756b6a1c2ce" Jul 08 19:05:28.588243 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.588192 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:05:28.590368 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.590347 2574 scope.go:117] "RemoveContainer" containerID="6ac847c8332434a2dad60ca2a21a36c325cf248556a1669c28273c9157329422" Jul 08 19:05:28.592075 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.592055 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:05:28.597742 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.597724 2574 scope.go:117] "RemoveContainer" containerID="211fde5e7616a56d89e571425f7bad3cfe31008e9237131e6753d2ef38a7da26" Jul 08 19:05:28.604936 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.604914 2574 scope.go:117] "RemoveContainer" containerID="70318fd3090796240c3c5874b9be3c0a7d111d1755ba7c1d03cb0a8381d68f0d" Jul 08 19:05:28.612190 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.612168 2574 scope.go:117] "RemoveContainer" containerID="2a28db66f1932c664e705094491c1c970f47c819b47eec08fb61b14116bde217" Jul 08 19:05:28.619123 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.619106 2574 scope.go:117] "RemoveContainer" containerID="cb9849b8be6540b2ef61c7a632337b0202956f2e1c053ed186d825238acf80e3" Jul 08 19:05:28.619426 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:28.619396 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb9849b8be6540b2ef61c7a632337b0202956f2e1c053ed186d825238acf80e3\": container with ID starting with cb9849b8be6540b2ef61c7a632337b0202956f2e1c053ed186d825238acf80e3 not found: ID does not exist" containerID="cb9849b8be6540b2ef61c7a632337b0202956f2e1c053ed186d825238acf80e3" Jul 08 19:05:28.619518 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.619439 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb9849b8be6540b2ef61c7a632337b0202956f2e1c053ed186d825238acf80e3"} err="failed to get container status \"cb9849b8be6540b2ef61c7a632337b0202956f2e1c053ed186d825238acf80e3\": rpc error: code = NotFound desc = could not find container \"cb9849b8be6540b2ef61c7a632337b0202956f2e1c053ed186d825238acf80e3\": container with ID starting with cb9849b8be6540b2ef61c7a632337b0202956f2e1c053ed186d825238acf80e3 not found: ID does not exist" Jul 08 19:05:28.619518 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.619469 2574 scope.go:117] "RemoveContainer" containerID="ec12c9713ce3b829dfbda44cfdb4d53ed75e8cd6cb75a3b0c28dfbb4ec50e3e7" Jul 08 19:05:28.619730 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:28.619712 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec12c9713ce3b829dfbda44cfdb4d53ed75e8cd6cb75a3b0c28dfbb4ec50e3e7\": container with ID starting with ec12c9713ce3b829dfbda44cfdb4d53ed75e8cd6cb75a3b0c28dfbb4ec50e3e7 not found: ID does not exist" containerID="ec12c9713ce3b829dfbda44cfdb4d53ed75e8cd6cb75a3b0c28dfbb4ec50e3e7" Jul 08 19:05:28.619773 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.619736 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec12c9713ce3b829dfbda44cfdb4d53ed75e8cd6cb75a3b0c28dfbb4ec50e3e7"} err="failed to get container status \"ec12c9713ce3b829dfbda44cfdb4d53ed75e8cd6cb75a3b0c28dfbb4ec50e3e7\": rpc error: code = NotFound desc = could not find container \"ec12c9713ce3b829dfbda44cfdb4d53ed75e8cd6cb75a3b0c28dfbb4ec50e3e7\": container with ID starting with ec12c9713ce3b829dfbda44cfdb4d53ed75e8cd6cb75a3b0c28dfbb4ec50e3e7 not found: ID does not exist" Jul 08 19:05:28.619773 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.619751 2574 scope.go:117] "RemoveContainer" containerID="78deb2d711b86672d02c844f8043b2ecf052cd9c92b68caa79725756b6a1c2ce" Jul 08 19:05:28.619988 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:28.619967 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78deb2d711b86672d02c844f8043b2ecf052cd9c92b68caa79725756b6a1c2ce\": container with ID starting with 78deb2d711b86672d02c844f8043b2ecf052cd9c92b68caa79725756b6a1c2ce not found: ID does not exist" containerID="78deb2d711b86672d02c844f8043b2ecf052cd9c92b68caa79725756b6a1c2ce" Jul 08 19:05:28.620031 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.619995 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78deb2d711b86672d02c844f8043b2ecf052cd9c92b68caa79725756b6a1c2ce"} err="failed to get container status \"78deb2d711b86672d02c844f8043b2ecf052cd9c92b68caa79725756b6a1c2ce\": rpc error: code = NotFound desc = could not find container \"78deb2d711b86672d02c844f8043b2ecf052cd9c92b68caa79725756b6a1c2ce\": container with ID starting with 78deb2d711b86672d02c844f8043b2ecf052cd9c92b68caa79725756b6a1c2ce not found: ID does not exist" Jul 08 19:05:28.620031 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.620009 2574 scope.go:117] "RemoveContainer" containerID="6ac847c8332434a2dad60ca2a21a36c325cf248556a1669c28273c9157329422" Jul 08 19:05:28.620239 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:28.620215 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ac847c8332434a2dad60ca2a21a36c325cf248556a1669c28273c9157329422\": container with ID starting with 6ac847c8332434a2dad60ca2a21a36c325cf248556a1669c28273c9157329422 not found: ID does not exist" containerID="6ac847c8332434a2dad60ca2a21a36c325cf248556a1669c28273c9157329422" Jul 08 19:05:28.620275 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.620243 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ac847c8332434a2dad60ca2a21a36c325cf248556a1669c28273c9157329422"} err="failed to get container status \"6ac847c8332434a2dad60ca2a21a36c325cf248556a1669c28273c9157329422\": rpc error: code = NotFound desc = could not find container \"6ac847c8332434a2dad60ca2a21a36c325cf248556a1669c28273c9157329422\": container with ID starting with 6ac847c8332434a2dad60ca2a21a36c325cf248556a1669c28273c9157329422 not found: ID does not exist" Jul 08 19:05:28.620275 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.620257 2574 scope.go:117] "RemoveContainer" containerID="211fde5e7616a56d89e571425f7bad3cfe31008e9237131e6753d2ef38a7da26" Jul 08 19:05:28.620481 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:28.620453 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"211fde5e7616a56d89e571425f7bad3cfe31008e9237131e6753d2ef38a7da26\": container with ID starting with 211fde5e7616a56d89e571425f7bad3cfe31008e9237131e6753d2ef38a7da26 not found: ID does not exist" containerID="211fde5e7616a56d89e571425f7bad3cfe31008e9237131e6753d2ef38a7da26" Jul 08 19:05:28.620561 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.620478 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211fde5e7616a56d89e571425f7bad3cfe31008e9237131e6753d2ef38a7da26"} err="failed to get container status \"211fde5e7616a56d89e571425f7bad3cfe31008e9237131e6753d2ef38a7da26\": rpc error: code = NotFound desc = could not find container \"211fde5e7616a56d89e571425f7bad3cfe31008e9237131e6753d2ef38a7da26\": container with ID starting with 211fde5e7616a56d89e571425f7bad3cfe31008e9237131e6753d2ef38a7da26 not found: ID does not exist" Jul 08 19:05:28.620561 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.620500 2574 scope.go:117] "RemoveContainer" containerID="70318fd3090796240c3c5874b9be3c0a7d111d1755ba7c1d03cb0a8381d68f0d" Jul 08 19:05:28.620741 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:28.620726 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70318fd3090796240c3c5874b9be3c0a7d111d1755ba7c1d03cb0a8381d68f0d\": container with ID starting with 70318fd3090796240c3c5874b9be3c0a7d111d1755ba7c1d03cb0a8381d68f0d not found: ID does not exist" containerID="70318fd3090796240c3c5874b9be3c0a7d111d1755ba7c1d03cb0a8381d68f0d" Jul 08 19:05:28.620778 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.620745 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70318fd3090796240c3c5874b9be3c0a7d111d1755ba7c1d03cb0a8381d68f0d"} err="failed to get container status \"70318fd3090796240c3c5874b9be3c0a7d111d1755ba7c1d03cb0a8381d68f0d\": rpc error: code = NotFound desc = could not find container \"70318fd3090796240c3c5874b9be3c0a7d111d1755ba7c1d03cb0a8381d68f0d\": container with ID starting with 70318fd3090796240c3c5874b9be3c0a7d111d1755ba7c1d03cb0a8381d68f0d not found: ID does not exist" Jul 08 19:05:28.620778 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.620757 2574 scope.go:117] "RemoveContainer" containerID="2a28db66f1932c664e705094491c1c970f47c819b47eec08fb61b14116bde217" Jul 08 19:05:28.620988 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:28.620973 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a28db66f1932c664e705094491c1c970f47c819b47eec08fb61b14116bde217\": container with ID starting with 2a28db66f1932c664e705094491c1c970f47c819b47eec08fb61b14116bde217 not found: ID does not exist" containerID="2a28db66f1932c664e705094491c1c970f47c819b47eec08fb61b14116bde217" Jul 08 19:05:28.621041 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.620991 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a28db66f1932c664e705094491c1c970f47c819b47eec08fb61b14116bde217"} err="failed to get container status \"2a28db66f1932c664e705094491c1c970f47c819b47eec08fb61b14116bde217\": rpc error: code = NotFound desc = could not find container \"2a28db66f1932c664e705094491c1c970f47c819b47eec08fb61b14116bde217\": container with ID starting with 2a28db66f1932c664e705094491c1c970f47c819b47eec08fb61b14116bde217 not found: ID does not exist" Jul 08 19:05:28.650921 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.650893 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:05:28.651255 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651238 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="alertmanager" Jul 08 19:05:28.651358 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651257 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="alertmanager" Jul 08 19:05:28.651358 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651278 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="config-reloader" Jul 08 19:05:28.651358 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651287 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="config-reloader" Jul 08 19:05:28.651358 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651299 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="prom-label-proxy" Jul 08 19:05:28.651358 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651308 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="prom-label-proxy" Jul 08 19:05:28.651358 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651320 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="kube-rbac-proxy-web" Jul 08 19:05:28.651358 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651356 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="kube-rbac-proxy-web" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651368 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="init-config-reloader" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651376 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="init-config-reloader" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651390 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="kube-rbac-proxy-metric" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651398 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="kube-rbac-proxy-metric" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651409 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93793458-6e1c-40f3-90ab-f52bb5c6cb66" containerName="registry" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651417 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="93793458-6e1c-40f3-90ab-f52bb5c6cb66" containerName="registry" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651431 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="kube-rbac-proxy" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651440 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="kube-rbac-proxy" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651527 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="kube-rbac-proxy-web" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651541 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="93793458-6e1c-40f3-90ab-f52bb5c6cb66" containerName="registry" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651550 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="kube-rbac-proxy" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651559 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="prom-label-proxy" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651568 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="alertmanager" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651578 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="config-reloader" Jul 08 19:05:28.651696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.651588 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" containerName="kube-rbac-proxy-metric" Jul 08 19:05:28.655659 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.655639 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.658440 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.658415 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 19:05:28.658582 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.658422 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 19:05:28.658582 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.658422 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 19:05:28.658582 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.658562 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 19:05:28.658823 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.658637 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 19:05:28.658891 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.658878 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 19:05:28.658891 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.658884 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 19:05:28.659046 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.658878 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 19:05:28.659502 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.659482 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rcxr8\"" Jul 08 19:05:28.663424 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.663407 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 19:05:28.673065 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.673043 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:05:28.733142 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.733106 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.733142 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.733143 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-config-volume\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.733379 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.733170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.733379 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.733240 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326e5237-8973-48d9-9ad3-5a7aab78f994-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.733379 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.733308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/326e5237-8973-48d9-9ad3-5a7aab78f994-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.733379 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.733355 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.733528 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.733394 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.733528 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.733420 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/326e5237-8973-48d9-9ad3-5a7aab78f994-config-out\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.733528 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.733438 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6c5z\" (UniqueName: \"kubernetes.io/projected/326e5237-8973-48d9-9ad3-5a7aab78f994-kube-api-access-v6c5z\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.733626 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.733532 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.733626 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.733567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-web-config\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.733626 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.733590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/326e5237-8973-48d9-9ad3-5a7aab78f994-tls-assets\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.733626 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.733620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/326e5237-8973-48d9-9ad3-5a7aab78f994-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.834966 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.834890 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/326e5237-8973-48d9-9ad3-5a7aab78f994-tls-assets\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.834966 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.834937 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/326e5237-8973-48d9-9ad3-5a7aab78f994-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.834966 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.834955 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.835205 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.834986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-config-volume\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.835205 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.835008 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.835205 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.835026 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326e5237-8973-48d9-9ad3-5a7aab78f994-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.835205 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.835056 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/326e5237-8973-48d9-9ad3-5a7aab78f994-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.835205 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.835085 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.835205 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.835116 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.835536 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.835410 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/326e5237-8973-48d9-9ad3-5a7aab78f994-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.836498 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.835883 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/326e5237-8973-48d9-9ad3-5a7aab78f994-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.836498 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.835941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/326e5237-8973-48d9-9ad3-5a7aab78f994-config-out\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.836498 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.835975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6c5z\" (UniqueName: \"kubernetes.io/projected/326e5237-8973-48d9-9ad3-5a7aab78f994-kube-api-access-v6c5z\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.836498 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.836038 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.836498 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.836080 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-web-config\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.836498 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.836120 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326e5237-8973-48d9-9ad3-5a7aab78f994-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.838028 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.838006 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.838181 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.838155 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-config-volume\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.838223 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.838178 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.838320 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.838294 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.838852 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.838831 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.838963 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.838861 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/326e5237-8973-48d9-9ad3-5a7aab78f994-tls-assets\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.839057 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.839037 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/326e5237-8973-48d9-9ad3-5a7aab78f994-config-out\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.839057 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.839052 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-web-config\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.839643 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.839626 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/326e5237-8973-48d9-9ad3-5a7aab78f994-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.845700 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.845679 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6c5z\" (UniqueName: \"kubernetes.io/projected/326e5237-8973-48d9-9ad3-5a7aab78f994-kube-api-access-v6c5z\") pod \"alertmanager-main-0\" (UID: \"326e5237-8973-48d9-9ad3-5a7aab78f994\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:28.964543 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:28.964503 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:05:29.104196 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:29.104109 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:05:29.107677 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:05:29.107653 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod326e5237_8973_48d9_9ad3_5a7aab78f994.slice/crio-dea73c38c548f2ba08ac2b796c55f22a439746be12c7d257ad89c5a636c22557 WatchSource:0}: Error finding container dea73c38c548f2ba08ac2b796c55f22a439746be12c7d257ad89c5a636c22557: Status 404 returned error can't find the container with id dea73c38c548f2ba08ac2b796c55f22a439746be12c7d257ad89c5a636c22557 Jul 08 19:05:29.571594 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:29.571562 2574 generic.go:356] "Generic (PLEG): container finished" podID="326e5237-8973-48d9-9ad3-5a7aab78f994" containerID="9948a4038cd60bc4ba30f69ffe0a238390010f2ed31219291783d08c81c4ef3d" exitCode=0 Jul 08 19:05:29.571981 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:29.571612 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"326e5237-8973-48d9-9ad3-5a7aab78f994","Type":"ContainerDied","Data":"9948a4038cd60bc4ba30f69ffe0a238390010f2ed31219291783d08c81c4ef3d"} Jul 08 19:05:29.571981 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:29.571662 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"326e5237-8973-48d9-9ad3-5a7aab78f994","Type":"ContainerStarted","Data":"dea73c38c548f2ba08ac2b796c55f22a439746be12c7d257ad89c5a636c22557"} Jul 08 19:05:30.223898 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.223858 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62ee4492-fa30-4cef-91f6-53b456f7981a" path="/var/lib/kubelet/pods/62ee4492-fa30-4cef-91f6-53b456f7981a/volumes" Jul 08 19:05:30.558604 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.558507 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-69978c7fd6-zvcpg"] Jul 08 19:05:30.561361 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.561321 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.564702 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.564675 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 08 19:05:30.564702 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.564678 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 08 19:05:30.564891 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.564737 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 08 19:05:30.565103 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.565084 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bm65t\"" Jul 08 19:05:30.565166 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.565089 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 08 19:05:30.565166 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.565089 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 08 19:05:30.570179 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.570160 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 08 19:05:30.579872 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.579838 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"326e5237-8973-48d9-9ad3-5a7aab78f994","Type":"ContainerStarted","Data":"564e1db8049585016b7ab671ce3c93e896e1e8a40cb9849f03cd5ca60c24bc31"} Jul 08 19:05:30.580212 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.579910 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"326e5237-8973-48d9-9ad3-5a7aab78f994","Type":"ContainerStarted","Data":"3fb3ee6495c8ed0d0a33bcbaa21a2bb08f3a43c88cc36965b10dadac2a2a643c"} Jul 08 19:05:30.580212 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.579937 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"326e5237-8973-48d9-9ad3-5a7aab78f994","Type":"ContainerStarted","Data":"8104745de6f8f35ce94f4e2719a32becc76a64601ffe563b2d20dd204d259b08"} Jul 08 19:05:30.580212 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.579966 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"326e5237-8973-48d9-9ad3-5a7aab78f994","Type":"ContainerStarted","Data":"607478de4e5ca2591b43991cce465d161369b92220cbfdbbc0cbdfe1a1e058bd"} Jul 08 19:05:30.580212 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.579991 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"326e5237-8973-48d9-9ad3-5a7aab78f994","Type":"ContainerStarted","Data":"c09c81bf64b08754dc0b794e8b8b5d6da216be5f6f244d7e5c1b4c06ab9209db"} Jul 08 19:05:30.580212 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.580014 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"326e5237-8973-48d9-9ad3-5a7aab78f994","Type":"ContainerStarted","Data":"2c81966ec78055c87b31aa83ab4939af15ba54c7c4c9199e8acdbe78b90dcd53"} Jul 08 19:05:30.580584 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.580566 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69978c7fd6-zvcpg"] Jul 08 19:05:30.652889 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.652855 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/609935c0-68c3-49e5-ad61-f25a2dcdd308-federate-client-tls\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.652889 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.652892 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/609935c0-68c3-49e5-ad61-f25a2dcdd308-serving-certs-ca-bundle\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.653154 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.652913 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/609935c0-68c3-49e5-ad61-f25a2dcdd308-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.653154 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.652931 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/609935c0-68c3-49e5-ad61-f25a2dcdd308-metrics-client-ca\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.653154 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.653037 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/609935c0-68c3-49e5-ad61-f25a2dcdd308-secret-telemeter-client\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.653154 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.653073 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/609935c0-68c3-49e5-ad61-f25a2dcdd308-telemeter-client-tls\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.653154 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.653102 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjb4t\" (UniqueName: \"kubernetes.io/projected/609935c0-68c3-49e5-ad61-f25a2dcdd308-kube-api-access-jjb4t\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.653154 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.653153 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/609935c0-68c3-49e5-ad61-f25a2dcdd308-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.658747 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.658684 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.644937134 podStartE2EDuration="2.658662662s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.725528ms" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:30.656911074 +0000 UTC m=+399.049057861" watchObservedRunningTime="2026-07-08 19:05:30.658662662 +0000 UTC m=+399.050809451" Jul 08 19:05:30.754700 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.754653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjb4t\" (UniqueName: \"kubernetes.io/projected/609935c0-68c3-49e5-ad61-f25a2dcdd308-kube-api-access-jjb4t\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.754920 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.754759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/609935c0-68c3-49e5-ad61-f25a2dcdd308-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.754987 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.754940 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/609935c0-68c3-49e5-ad61-f25a2dcdd308-federate-client-tls\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.755365 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.755313 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/609935c0-68c3-49e5-ad61-f25a2dcdd308-serving-certs-ca-bundle\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.755482 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.755408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/609935c0-68c3-49e5-ad61-f25a2dcdd308-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.755482 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.755443 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/609935c0-68c3-49e5-ad61-f25a2dcdd308-metrics-client-ca\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.755598 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.755505 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/609935c0-68c3-49e5-ad61-f25a2dcdd308-secret-telemeter-client\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.755598 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.755545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/609935c0-68c3-49e5-ad61-f25a2dcdd308-telemeter-client-tls\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.756110 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.756085 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/609935c0-68c3-49e5-ad61-f25a2dcdd308-serving-certs-ca-bundle\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.756351 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.756313 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/609935c0-68c3-49e5-ad61-f25a2dcdd308-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.756447 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.756425 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/609935c0-68c3-49e5-ad61-f25a2dcdd308-metrics-client-ca\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.757885 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.757854 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/609935c0-68c3-49e5-ad61-f25a2dcdd308-federate-client-tls\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.758164 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.758146 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/609935c0-68c3-49e5-ad61-f25a2dcdd308-secret-telemeter-client\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.758234 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.758215 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/609935c0-68c3-49e5-ad61-f25a2dcdd308-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.758350 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.758307 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/609935c0-68c3-49e5-ad61-f25a2dcdd308-telemeter-client-tls\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.763538 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.763518 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjb4t\" (UniqueName: \"kubernetes.io/projected/609935c0-68c3-49e5-ad61-f25a2dcdd308-kube-api-access-jjb4t\") pod \"telemeter-client-69978c7fd6-zvcpg\" (UID: \"609935c0-68c3-49e5-ad61-f25a2dcdd308\") " pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:30.861813 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.861725 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:05:30.862049 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.862001 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="prometheus" containerID="cri-o://46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b" gracePeriod=600 Jul 08 19:05:30.862049 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.862016 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="kube-rbac-proxy" containerID="cri-o://c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae" gracePeriod=600 Jul 08 19:05:30.862192 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.862043 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="thanos-sidecar" containerID="cri-o://adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63" gracePeriod=600 Jul 08 19:05:30.862192 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.862057 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="kube-rbac-proxy-web" containerID="cri-o://e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84" gracePeriod=600 Jul 08 19:05:30.862192 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.862089 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="config-reloader" containerID="cri-o://7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010" gracePeriod=600 Jul 08 19:05:30.862192 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.862116 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120" gracePeriod=600 Jul 08 19:05:30.871321 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:30.871235 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" Jul 08 19:05:31.025694 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.025630 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69978c7fd6-zvcpg"] Jul 08 19:05:31.126244 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.126218 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.260162 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.260123 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-metrics-client-ca\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.260162 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.260159 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-config\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.260399 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.260182 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-metrics-client-certs\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.260399 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.260210 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-config-out\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.260399 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.260371 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-grpc-tls\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.260581 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.260417 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-thanos-prometheus-http-client-file\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.260581 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.260459 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-kubelet-serving-ca-bundle\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.260581 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.260496 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.260581 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.260524 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-1\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.260581 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.260557 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-db\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.260581 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.260562 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:05:31.260894 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.260586 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.261008 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.260980 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:05:31.261081 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.261036 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-0\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.261140 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.261078 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-tls-assets\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.261140 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.261111 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-tls\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.261301 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.261145 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-web-config\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.261301 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.261183 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-kube-rbac-proxy\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.261301 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.261219 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-trusted-ca-bundle\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.261301 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.261247 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-serving-certs-ca-bundle\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.261301 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.261287 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-2\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.261606 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.261322 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z74z9\" (UniqueName: \"kubernetes.io/projected/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-kube-api-access-z74z9\") pod \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\" (UID: \"dfd3fb17-ac07-4906-8c8c-a9477a5965f7\") " Jul 08 19:05:31.261682 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.261664 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-metrics-client-ca\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.261743 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.261689 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.262941 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.262909 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:31.263051 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.262806 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:31.263122 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.263054 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:05:31.263184 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.263168 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:05:31.263244 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.263212 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:31.263601 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.263452 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-config-out" (OuterVolumeSpecName: "config-out") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:05:31.263775 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.263752 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:05:31.263838 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.263752 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:05:31.263838 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.263796 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:31.263838 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.263812 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:31.264538 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.264508 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-kube-api-access-z74z9" (OuterVolumeSpecName: "kube-api-access-z74z9") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "kube-api-access-z74z9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:05:31.264622 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.264539 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:05:31.264768 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.264746 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-config" (OuterVolumeSpecName: "config") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:31.264869 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.264835 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:05:31.265446 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.265421 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:31.265795 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.265780 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:05:31.265953 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.265933 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:31.275703 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.275677 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-web-config" (OuterVolumeSpecName: "web-config") pod "dfd3fb17-ac07-4906-8c8c-a9477a5965f7" (UID: "dfd3fb17-ac07-4906-8c8c-a9477a5965f7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:05:31.362996 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.362955 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-grpc-tls\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.362996 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.362989 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.362996 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363001 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363010 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363020 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-db\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363028 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363036 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363048 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-tls-assets\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363058 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363066 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-web-config\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363076 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-kube-rbac-proxy\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363083 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363092 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363100 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363108 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z74z9\" (UniqueName: \"kubernetes.io/projected/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-kube-api-access-z74z9\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363116 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-config\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363124 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-secret-metrics-client-certs\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.363233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.363131 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfd3fb17-ac07-4906-8c8c-a9477a5965f7-config-out\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:05:31.588077 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588041 2574 generic.go:356] "Generic (PLEG): container finished" podID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerID="f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120" exitCode=0 Jul 08 19:05:31.588077 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588069 2574 generic.go:356] "Generic (PLEG): container finished" podID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerID="c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae" exitCode=0 Jul 08 19:05:31.588077 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588078 2574 generic.go:356] "Generic (PLEG): container finished" podID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerID="e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84" exitCode=0 Jul 08 19:05:31.588077 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588086 2574 generic.go:356] "Generic (PLEG): container finished" podID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerID="adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63" exitCode=0 Jul 08 19:05:31.588729 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588093 2574 generic.go:356] "Generic (PLEG): container finished" podID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerID="7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010" exitCode=0 Jul 08 19:05:31.588729 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588101 2574 generic.go:356] "Generic (PLEG): container finished" podID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerID="46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b" exitCode=0 Jul 08 19:05:31.588729 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588112 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.588729 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588124 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerDied","Data":"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120"} Jul 08 19:05:31.588729 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588193 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerDied","Data":"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae"} Jul 08 19:05:31.588729 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588222 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerDied","Data":"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84"} Jul 08 19:05:31.588729 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588247 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerDied","Data":"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63"} Jul 08 19:05:31.588729 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588270 2574 scope.go:117] "RemoveContainer" containerID="f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120" Jul 08 19:05:31.588729 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588278 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerDied","Data":"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010"} Jul 08 19:05:31.588729 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588309 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerDied","Data":"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b"} Jul 08 19:05:31.588729 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.588373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfd3fb17-ac07-4906-8c8c-a9477a5965f7","Type":"ContainerDied","Data":"1254210d2bcb12f7c1aa5df5cf38d30369fdf294c82c0335bc306342f7c0f827"} Jul 08 19:05:31.589610 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.589580 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" event={"ID":"609935c0-68c3-49e5-ad61-f25a2dcdd308","Type":"ContainerStarted","Data":"e9de99f7cc5105f7c59198a12231a7d775b3f4ec06f6fa5073077a44dd73156e"} Jul 08 19:05:31.599377 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.597567 2574 scope.go:117] "RemoveContainer" containerID="c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae" Jul 08 19:05:31.606938 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.606920 2574 scope.go:117] "RemoveContainer" containerID="e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84" Jul 08 19:05:31.614099 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.614080 2574 scope.go:117] "RemoveContainer" containerID="adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63" Jul 08 19:05:31.621171 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.621157 2574 scope.go:117] "RemoveContainer" containerID="7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010" Jul 08 19:05:31.623934 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.623909 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:05:31.628767 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.628750 2574 scope.go:117] "RemoveContainer" containerID="46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b" Jul 08 19:05:31.632283 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.632259 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:05:31.636696 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.636677 2574 scope.go:117] "RemoveContainer" containerID="16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990" Jul 08 19:05:31.661670 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.661649 2574 scope.go:117] "RemoveContainer" containerID="f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120" Jul 08 19:05:31.662059 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:31.662029 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120\": container with ID starting with f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120 not found: ID does not exist" containerID="f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120" Jul 08 19:05:31.662201 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.662071 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120"} err="failed to get container status \"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120\": rpc error: code = NotFound desc = could not find container \"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120\": container with ID starting with f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120 not found: ID does not exist" Jul 08 19:05:31.662201 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.662098 2574 scope.go:117] "RemoveContainer" containerID="c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae" Jul 08 19:05:31.662605 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:31.662587 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae\": container with ID starting with c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae not found: ID does not exist" containerID="c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae" Jul 08 19:05:31.662662 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.662611 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae"} err="failed to get container status \"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae\": rpc error: code = NotFound desc = could not find container \"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae\": container with ID starting with c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae not found: ID does not exist" Jul 08 19:05:31.662662 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.662626 2574 scope.go:117] "RemoveContainer" containerID="e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84" Jul 08 19:05:31.662941 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:31.662923 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84\": container with ID starting with e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84 not found: ID does not exist" containerID="e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84" Jul 08 19:05:31.662983 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.662947 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84"} err="failed to get container status \"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84\": rpc error: code = NotFound desc = could not find container \"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84\": container with ID starting with e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84 not found: ID does not exist" Jul 08 19:05:31.662983 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.662962 2574 scope.go:117] "RemoveContainer" containerID="adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63" Jul 08 19:05:31.663239 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:31.663219 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63\": container with ID starting with adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63 not found: ID does not exist" containerID="adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63" Jul 08 19:05:31.663276 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.663246 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63"} err="failed to get container status \"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63\": rpc error: code = NotFound desc = could not find container \"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63\": container with ID starting with adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63 not found: ID does not exist" Jul 08 19:05:31.663276 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.663263 2574 scope.go:117] "RemoveContainer" containerID="7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010" Jul 08 19:05:31.663548 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:31.663532 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010\": container with ID starting with 7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010 not found: ID does not exist" containerID="7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010" Jul 08 19:05:31.663591 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.663553 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010"} err="failed to get container status \"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010\": rpc error: code = NotFound desc = could not find container \"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010\": container with ID starting with 7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010 not found: ID does not exist" Jul 08 19:05:31.663591 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.663567 2574 scope.go:117] "RemoveContainer" containerID="46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b" Jul 08 19:05:31.663828 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:31.663806 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b\": container with ID starting with 46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b not found: ID does not exist" containerID="46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b" Jul 08 19:05:31.663918 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.663829 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b"} err="failed to get container status \"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b\": rpc error: code = NotFound desc = could not find container \"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b\": container with ID starting with 46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b not found: ID does not exist" Jul 08 19:05:31.663918 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.663844 2574 scope.go:117] "RemoveContainer" containerID="16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990" Jul 08 19:05:31.664094 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:31.664076 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990\": container with ID starting with 16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990 not found: ID does not exist" containerID="16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990" Jul 08 19:05:31.664131 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.664098 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990"} err="failed to get container status \"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990\": rpc error: code = NotFound desc = could not find container \"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990\": container with ID starting with 16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990 not found: ID does not exist" Jul 08 19:05:31.664131 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.664110 2574 scope.go:117] "RemoveContainer" containerID="f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120" Jul 08 19:05:31.664324 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.664306 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120"} err="failed to get container status \"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120\": rpc error: code = NotFound desc = could not find container \"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120\": container with ID starting with f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120 not found: ID does not exist" Jul 08 19:05:31.664398 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.664325 2574 scope.go:117] "RemoveContainer" containerID="c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae" Jul 08 19:05:31.664615 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.664596 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae"} err="failed to get container status \"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae\": rpc error: code = NotFound desc = could not find container \"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae\": container with ID starting with c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae not found: ID does not exist" Jul 08 19:05:31.664658 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.664616 2574 scope.go:117] "RemoveContainer" containerID="e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84" Jul 08 19:05:31.664859 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.664841 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84"} err="failed to get container status \"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84\": rpc error: code = NotFound desc = could not find container \"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84\": container with ID starting with e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84 not found: ID does not exist" Jul 08 19:05:31.664905 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.664860 2574 scope.go:117] "RemoveContainer" containerID="adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63" Jul 08 19:05:31.665087 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.665067 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63"} err="failed to get container status \"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63\": rpc error: code = NotFound desc = could not find container \"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63\": container with ID starting with adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63 not found: ID does not exist" Jul 08 19:05:31.665087 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.665085 2574 scope.go:117] "RemoveContainer" containerID="7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010" Jul 08 19:05:31.665308 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.665289 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010"} err="failed to get container status \"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010\": rpc error: code = NotFound desc = could not find container \"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010\": container with ID starting with 7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010 not found: ID does not exist" Jul 08 19:05:31.665381 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.665309 2574 scope.go:117] "RemoveContainer" containerID="46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b" Jul 08 19:05:31.665554 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.665535 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b"} err="failed to get container status \"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b\": rpc error: code = NotFound desc = could not find container \"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b\": container with ID starting with 46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b not found: ID does not exist" Jul 08 19:05:31.665619 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.665557 2574 scope.go:117] "RemoveContainer" containerID="16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990" Jul 08 19:05:31.665786 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.665768 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990"} err="failed to get container status \"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990\": rpc error: code = NotFound desc = could not find container \"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990\": container with ID starting with 16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990 not found: ID does not exist" Jul 08 19:05:31.665840 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.665786 2574 scope.go:117] "RemoveContainer" containerID="f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120" Jul 08 19:05:31.666001 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.665985 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120"} err="failed to get container status \"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120\": rpc error: code = NotFound desc = could not find container \"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120\": container with ID starting with f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120 not found: ID does not exist" Jul 08 19:05:31.666041 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.666003 2574 scope.go:117] "RemoveContainer" containerID="c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae" Jul 08 19:05:31.666205 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.666172 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae"} err="failed to get container status \"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae\": rpc error: code = NotFound desc = could not find container \"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae\": container with ID starting with c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae not found: ID does not exist" Jul 08 19:05:31.666205 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.666198 2574 scope.go:117] "RemoveContainer" containerID="e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84" Jul 08 19:05:31.666413 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.666390 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84"} err="failed to get container status \"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84\": rpc error: code = NotFound desc = could not find container \"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84\": container with ID starting with e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84 not found: ID does not exist" Jul 08 19:05:31.666462 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.666414 2574 scope.go:117] "RemoveContainer" containerID="adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63" Jul 08 19:05:31.666613 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.666595 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63"} err="failed to get container status \"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63\": rpc error: code = NotFound desc = could not find container \"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63\": container with ID starting with adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63 not found: ID does not exist" Jul 08 19:05:31.666657 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.666614 2574 scope.go:117] "RemoveContainer" containerID="7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010" Jul 08 19:05:31.666841 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.666820 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010"} err="failed to get container status \"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010\": rpc error: code = NotFound desc = could not find container \"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010\": container with ID starting with 7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010 not found: ID does not exist" Jul 08 19:05:31.666880 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.666843 2574 scope.go:117] "RemoveContainer" containerID="46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b" Jul 08 19:05:31.667042 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.667025 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b"} err="failed to get container status \"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b\": rpc error: code = NotFound desc = could not find container \"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b\": container with ID starting with 46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b not found: ID does not exist" Jul 08 19:05:31.667097 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.667042 2574 scope.go:117] "RemoveContainer" containerID="16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990" Jul 08 19:05:31.667215 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.667199 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990"} err="failed to get container status \"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990\": rpc error: code = NotFound desc = could not find container \"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990\": container with ID starting with 16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990 not found: ID does not exist" Jul 08 19:05:31.667252 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.667216 2574 scope.go:117] "RemoveContainer" containerID="f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120" Jul 08 19:05:31.667427 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.667410 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120"} err="failed to get container status \"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120\": rpc error: code = NotFound desc = could not find container \"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120\": container with ID starting with f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120 not found: ID does not exist" Jul 08 19:05:31.667427 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.667426 2574 scope.go:117] "RemoveContainer" containerID="c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae" Jul 08 19:05:31.667651 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.667633 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae"} err="failed to get container status \"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae\": rpc error: code = NotFound desc = could not find container \"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae\": container with ID starting with c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae not found: ID does not exist" Jul 08 19:05:31.667707 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.667651 2574 scope.go:117] "RemoveContainer" containerID="e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84" Jul 08 19:05:31.667872 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.667839 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84"} err="failed to get container status \"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84\": rpc error: code = NotFound desc = could not find container \"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84\": container with ID starting with e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84 not found: ID does not exist" Jul 08 19:05:31.667872 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.667857 2574 scope.go:117] "RemoveContainer" containerID="adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63" Jul 08 19:05:31.668060 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.668041 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63"} err="failed to get container status \"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63\": rpc error: code = NotFound desc = could not find container \"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63\": container with ID starting with adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63 not found: ID does not exist" Jul 08 19:05:31.668104 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.668062 2574 scope.go:117] "RemoveContainer" containerID="7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010" Jul 08 19:05:31.668242 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.668223 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010"} err="failed to get container status \"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010\": rpc error: code = NotFound desc = could not find container \"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010\": container with ID starting with 7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010 not found: ID does not exist" Jul 08 19:05:31.668306 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.668244 2574 scope.go:117] "RemoveContainer" containerID="46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b" Jul 08 19:05:31.668500 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.668484 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b"} err="failed to get container status \"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b\": rpc error: code = NotFound desc = could not find container \"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b\": container with ID starting with 46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b not found: ID does not exist" Jul 08 19:05:31.668537 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.668501 2574 scope.go:117] "RemoveContainer" containerID="16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990" Jul 08 19:05:31.668715 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.668698 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990"} err="failed to get container status \"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990\": rpc error: code = NotFound desc = could not find container \"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990\": container with ID starting with 16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990 not found: ID does not exist" Jul 08 19:05:31.668777 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.668716 2574 scope.go:117] "RemoveContainer" containerID="f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120" Jul 08 19:05:31.668904 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.668890 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120"} err="failed to get container status \"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120\": rpc error: code = NotFound desc = could not find container \"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120\": container with ID starting with f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120 not found: ID does not exist" Jul 08 19:05:31.668960 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.668906 2574 scope.go:117] "RemoveContainer" containerID="c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae" Jul 08 19:05:31.669132 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.669114 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae"} err="failed to get container status \"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae\": rpc error: code = NotFound desc = could not find container \"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae\": container with ID starting with c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae not found: ID does not exist" Jul 08 19:05:31.669186 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.669135 2574 scope.go:117] "RemoveContainer" containerID="e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84" Jul 08 19:05:31.669389 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.669371 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84"} err="failed to get container status \"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84\": rpc error: code = NotFound desc = could not find container \"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84\": container with ID starting with e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84 not found: ID does not exist" Jul 08 19:05:31.669445 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.669390 2574 scope.go:117] "RemoveContainer" containerID="adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63" Jul 08 19:05:31.669588 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.669572 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63"} err="failed to get container status \"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63\": rpc error: code = NotFound desc = could not find container \"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63\": container with ID starting with adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63 not found: ID does not exist" Jul 08 19:05:31.669647 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.669590 2574 scope.go:117] "RemoveContainer" containerID="7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010" Jul 08 19:05:31.669827 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.669807 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010"} err="failed to get container status \"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010\": rpc error: code = NotFound desc = could not find container \"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010\": container with ID starting with 7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010 not found: ID does not exist" Jul 08 19:05:31.669874 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.669827 2574 scope.go:117] "RemoveContainer" containerID="46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b" Jul 08 19:05:31.670060 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.670043 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b"} err="failed to get container status \"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b\": rpc error: code = NotFound desc = could not find container \"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b\": container with ID starting with 46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b not found: ID does not exist" Jul 08 19:05:31.670105 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.670061 2574 scope.go:117] "RemoveContainer" containerID="16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990" Jul 08 19:05:31.670234 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.670218 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990"} err="failed to get container status \"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990\": rpc error: code = NotFound desc = could not find container \"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990\": container with ID starting with 16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990 not found: ID does not exist" Jul 08 19:05:31.670279 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.670234 2574 scope.go:117] "RemoveContainer" containerID="f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120" Jul 08 19:05:31.670476 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.670458 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120"} err="failed to get container status \"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120\": rpc error: code = NotFound desc = could not find container \"f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120\": container with ID starting with f61672d29f1e6b2d8a4ec7b1eca7cd93bf178e1672753b0d0169e9e00f10e120 not found: ID does not exist" Jul 08 19:05:31.670557 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.670477 2574 scope.go:117] "RemoveContainer" containerID="c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae" Jul 08 19:05:31.670779 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.670757 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae"} err="failed to get container status \"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae\": rpc error: code = NotFound desc = could not find container \"c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae\": container with ID starting with c0529673bf929a9f375a1ccea3609e263b9e58d70ba60fab80e193a5def9aeae not found: ID does not exist" Jul 08 19:05:31.670850 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.670780 2574 scope.go:117] "RemoveContainer" containerID="e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84" Jul 08 19:05:31.671121 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.671084 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84"} err="failed to get container status \"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84\": rpc error: code = NotFound desc = could not find container \"e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84\": container with ID starting with e3be26375474c69ce6d8f8fcb4c54ac3c1b1ee2cd2b8fd9238c258943191fb84 not found: ID does not exist" Jul 08 19:05:31.671121 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.671110 2574 scope.go:117] "RemoveContainer" containerID="adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63" Jul 08 19:05:31.671554 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.671528 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63"} err="failed to get container status \"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63\": rpc error: code = NotFound desc = could not find container \"adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63\": container with ID starting with adae06f17efc300115f26ca2aaa43d1c6d336de3dbf99c92d90d9c32c03aab63 not found: ID does not exist" Jul 08 19:05:31.671663 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.671556 2574 scope.go:117] "RemoveContainer" containerID="7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010" Jul 08 19:05:31.671905 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.671882 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010"} err="failed to get container status \"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010\": rpc error: code = NotFound desc = could not find container \"7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010\": container with ID starting with 7ab335403445e811028d6639562e41c16da4ae58659586494c5219c6a6e2a010 not found: ID does not exist" Jul 08 19:05:31.671967 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.671908 2574 scope.go:117] "RemoveContainer" containerID="46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b" Jul 08 19:05:31.672199 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.672179 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b"} err="failed to get container status \"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b\": rpc error: code = NotFound desc = could not find container \"46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b\": container with ID starting with 46d3d4bbe6806b3ea21f0c2c3771115154b6f700c48bd120a7076078dd97977b not found: ID does not exist" Jul 08 19:05:31.672252 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.672199 2574 scope.go:117] "RemoveContainer" containerID="16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990" Jul 08 19:05:31.672492 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.672470 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990"} err="failed to get container status \"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990\": rpc error: code = NotFound desc = could not find container \"16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990\": container with ID starting with 16dcbdc44710d2d069fee8ba16fdcf61053cf423731081ba8039100b6ee5e990 not found: ID does not exist" Jul 08 19:05:31.672993 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.672973 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:05:31.673307 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673296 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="config-reloader" Jul 08 19:05:31.673358 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673310 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="config-reloader" Jul 08 19:05:31.673358 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673322 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="prometheus" Jul 08 19:05:31.673358 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673344 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="prometheus" Jul 08 19:05:31.673358 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673354 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="init-config-reloader" Jul 08 19:05:31.673481 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673361 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="init-config-reloader" Jul 08 19:05:31.673481 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673368 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="thanos-sidecar" Jul 08 19:05:31.673481 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673373 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="thanos-sidecar" Jul 08 19:05:31.673481 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673379 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="kube-rbac-proxy-web" Jul 08 19:05:31.673481 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673384 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="kube-rbac-proxy-web" Jul 08 19:05:31.673481 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673390 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="kube-rbac-proxy-thanos" Jul 08 19:05:31.673481 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673395 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="kube-rbac-proxy-thanos" Jul 08 19:05:31.673481 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673408 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="kube-rbac-proxy" Jul 08 19:05:31.673481 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673413 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="kube-rbac-proxy" Jul 08 19:05:31.673481 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673465 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="kube-rbac-proxy-thanos" Jul 08 19:05:31.673481 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673473 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="kube-rbac-proxy-web" Jul 08 19:05:31.673481 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673480 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="prometheus" Jul 08 19:05:31.673481 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673486 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="kube-rbac-proxy" Jul 08 19:05:31.673839 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673492 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="thanos-sidecar" Jul 08 19:05:31.673839 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.673498 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" containerName="config-reloader" Jul 08 19:05:31.676940 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.676925 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.679546 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.679528 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 19:05:31.679631 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.679567 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 19:05:31.680283 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.680264 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 19:05:31.680815 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.680317 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 19:05:31.680815 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.680305 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hfqcc\"" Jul 08 19:05:31.680815 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.680374 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 19:05:31.680815 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.680374 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 19:05:31.680815 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.680486 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-70vaqsj00e7c5\"" Jul 08 19:05:31.680815 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.680490 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 19:05:31.680815 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.680633 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 19:05:31.680815 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.680637 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 19:05:31.680815 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.680710 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 19:05:31.680815 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.680743 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 19:05:31.681239 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.680904 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 19:05:31.683141 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.683120 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 19:05:31.688166 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.688149 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 19:05:31.713414 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.713351 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:05:31.766070 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766032 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.766231 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766110 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.766231 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766174 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.766231 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766223 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.766476 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766293 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.766562 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766540 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f74b3ca-31c7-4750-ad77-50f984a1ba14-config-out\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.766635 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766616 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.766695 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766681 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.766746 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.766800 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.766849 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766799 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-web-config\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.766889 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f74b3ca-31c7-4750-ad77-50f984a1ba14-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.766923 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766895 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.766923 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766917 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.766980 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.766934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.767022 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.767004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.767058 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.767034 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-config\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.767092 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.767070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.767136 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.767119 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.767168 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.767152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcfrv\" (UniqueName: \"kubernetes.io/projected/6f74b3ca-31c7-4750-ad77-50f984a1ba14-kube-api-access-rcfrv\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.868625 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.868516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f74b3ca-31c7-4750-ad77-50f984a1ba14-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.868625 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.868572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.868625 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.868600 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.868625 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.868622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.868953 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.868659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.868953 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.868683 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-config\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.868953 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.868808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.868953 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.868853 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.868953 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.868872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcfrv\" (UniqueName: \"kubernetes.io/projected/6f74b3ca-31c7-4750-ad77-50f984a1ba14-kube-api-access-rcfrv\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.868953 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.868897 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.868953 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.868923 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.869296 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.868965 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.869296 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.869006 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.869296 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.869040 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.869296 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.869093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f74b3ca-31c7-4750-ad77-50f984a1ba14-config-out\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.869296 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.869140 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.869296 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.869180 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.869296 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.869225 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.869296 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.869257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.869296 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.869280 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-web-config\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.871935 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.871903 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.872055 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.871954 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.872055 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.871989 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f74b3ca-31c7-4750-ad77-50f984a1ba14-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.872739 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.872495 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.872739 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.872645 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.872972 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.872821 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.872972 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.872918 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.872972 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.872936 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.873127 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.873059 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.873653 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.873480 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-config\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.873653 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.873493 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.873653 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.873610 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.874442 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.873895 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-web-config\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.874442 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.873942 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.874442 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.874276 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.874442 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.874391 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.875064 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.875041 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f74b3ca-31c7-4750-ad77-50f984a1ba14-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.875551 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.875531 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f74b3ca-31c7-4750-ad77-50f984a1ba14-config-out\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.876532 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.876508 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6f74b3ca-31c7-4750-ad77-50f984a1ba14-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.884066 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.883831 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcfrv\" (UniqueName: \"kubernetes.io/projected/6f74b3ca-31c7-4750-ad77-50f984a1ba14-kube-api-access-rcfrv\") pod \"prometheus-k8s-0\" (UID: \"6f74b3ca-31c7-4750-ad77-50f984a1ba14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:31.987307 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:31.987268 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:32.152220 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:32.152175 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:05:32.154807 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:05:32.154776 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f74b3ca_31c7_4750_ad77_50f984a1ba14.slice/crio-ef790622ff21dd21136afc1311cb2ac58f0b1ffbed3e06f5ea7008849c564466 WatchSource:0}: Error finding container ef790622ff21dd21136afc1311cb2ac58f0b1ffbed3e06f5ea7008849c564466: Status 404 returned error can't find the container with id ef790622ff21dd21136afc1311cb2ac58f0b1ffbed3e06f5ea7008849c564466 Jul 08 19:05:32.230895 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:32.230866 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfd3fb17-ac07-4906-8c8c-a9477a5965f7" path="/var/lib/kubelet/pods/dfd3fb17-ac07-4906-8c8c-a9477a5965f7/volumes" Jul 08 19:05:32.597957 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:32.597924 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f74b3ca-31c7-4750-ad77-50f984a1ba14" containerID="bd4b156b68ae5542e3c47899fc6421f516d00e5f9b21f9eb360ff2334caaddeb" exitCode=0 Jul 08 19:05:32.598426 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:32.597987 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f74b3ca-31c7-4750-ad77-50f984a1ba14","Type":"ContainerDied","Data":"bd4b156b68ae5542e3c47899fc6421f516d00e5f9b21f9eb360ff2334caaddeb"} Jul 08 19:05:32.598426 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:32.598051 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f74b3ca-31c7-4750-ad77-50f984a1ba14","Type":"ContainerStarted","Data":"ef790622ff21dd21136afc1311cb2ac58f0b1ffbed3e06f5ea7008849c564466"} Jul 08 19:05:33.607111 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:33.607074 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f74b3ca-31c7-4750-ad77-50f984a1ba14","Type":"ContainerStarted","Data":"b8a868c5d4ef7492680c63a0aa8fd4790e345a24bcf3d4b6a173c1b9034c3788"} Jul 08 19:05:33.607526 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:33.607171 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f74b3ca-31c7-4750-ad77-50f984a1ba14","Type":"ContainerStarted","Data":"649a3572dea7fa9f0c85515331d28d225287c90bb6256998fef0b8dcda22e157"} Jul 08 19:05:33.607526 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:33.607223 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f74b3ca-31c7-4750-ad77-50f984a1ba14","Type":"ContainerStarted","Data":"723d027922520cdbb0970620c77b1ad7626b8245011f3546af15d6f974449fa6"} Jul 08 19:05:33.607526 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:33.607261 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f74b3ca-31c7-4750-ad77-50f984a1ba14","Type":"ContainerStarted","Data":"b488a56dc6e1c630470beda167e083b564a9a2c48cc1bed2b5b1b85114eaab9c"} Jul 08 19:05:33.607526 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:33.607302 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f74b3ca-31c7-4750-ad77-50f984a1ba14","Type":"ContainerStarted","Data":"65ced668995fdd177664dda12a7589533ce941d5fc6c14d0868b3df5bf3f2e5e"} Jul 08 19:05:33.607526 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:33.607373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f74b3ca-31c7-4750-ad77-50f984a1ba14","Type":"ContainerStarted","Data":"fd8befee2e2e718c05b271e6f3f8dab8c419cb141bc32fd2a8df0d511d98db48"} Jul 08 19:05:33.609494 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:33.609473 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" event={"ID":"609935c0-68c3-49e5-ad61-f25a2dcdd308","Type":"ContainerStarted","Data":"126e7672e58a02251ff50378dd7607ea8da9c614e90d8ba39b4452dbd3d01e99"} Jul 08 19:05:33.609599 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:33.609521 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" event={"ID":"609935c0-68c3-49e5-ad61-f25a2dcdd308","Type":"ContainerStarted","Data":"8609397d2657c944b5392ab5954ec94640b7751df1392fc4e438060d16ea861a"} Jul 08 19:05:33.640808 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:33.640668 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.6183776 podStartE2EDuration="2.640646829s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.269229ms" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:33.639016592 +0000 UTC m=+402.031163404" watchObservedRunningTime="2026-07-08 19:05:33.640646829 +0000 UTC m=+402.032793618" Jul 08 19:05:34.616202 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:34.616169 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" event={"ID":"609935c0-68c3-49e5-ad61-f25a2dcdd308","Type":"ContainerStarted","Data":"bee9076b259a87f8d7a022a2e59c24c8b877f16285b9e8762d964f7b32e26517"} Jul 08 19:05:34.642425 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:34.642367 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-69978c7fd6-zvcpg" podStartSLOduration=2.20233412 podStartE2EDuration="4.642349296s" totalImagesPullingTime="2.440015176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:34.640800452 +0000 UTC m=+403.032947239" watchObservedRunningTime="2026-07-08 19:05:34.642349296 +0000 UTC m=+403.034496086" Jul 08 19:05:36.988311 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:36.988267 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:05:39.031738 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:05:39.031694 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" podUID="ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7" Jul 08 19:05:39.636890 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:39.636858 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 19:05:41.150506 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:41.150459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 19:05:41.153046 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:41.153018 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qxslq\" (UID: \"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 19:05:41.441431 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:41.441352 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bwhqh\"" Jul 08 19:05:41.448462 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:41.448436 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" Jul 08 19:05:41.581879 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:41.581842 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-qxslq"] Jul 08 19:05:41.584929 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:05:41.584897 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca5a01cc_2e9b_485f_b5d3_b52f5c76a9c7.slice/crio-0a955ed577454fc472481b15f0b2c6d5ed48547b310195b5782fb54fd30f085b WatchSource:0}: Error finding container 0a955ed577454fc472481b15f0b2c6d5ed48547b310195b5782fb54fd30f085b: Status 404 returned error can't find the container with id 0a955ed577454fc472481b15f0b2c6d5ed48547b310195b5782fb54fd30f085b Jul 08 19:05:41.646157 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:41.646120 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" event={"ID":"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7","Type":"ContainerStarted","Data":"0a955ed577454fc472481b15f0b2c6d5ed48547b310195b5782fb54fd30f085b"} Jul 08 19:05:43.655397 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:05:43.655365 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" event={"ID":"ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7","Type":"ContainerStarted","Data":"4491adf9bc687f016f2b2b1e52a96ebf3f38bf1295b0e4e020e3338e5b2f1f5c"} Jul 08 19:06:31.987828 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:06:31.987785 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:06:32.003887 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:06:32.003843 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:06:32.050416 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:06:32.050361 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qxslq" podStartSLOduration=437.956623607 podStartE2EDuration="7m19.05031782s" totalImagesPullingTime="1.093694213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:43.686738525 +0000 UTC m=+412.078885334" watchObservedRunningTime="2026-07-08 19:06:32.05031782 +0000 UTC m=+460.442464608" Jul 08 19:06:32.873023 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:06:32.872996 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:08:35.759225 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:35.759189 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vds7p"] Jul 08 19:08:35.762527 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:35.762509 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vds7p" Jul 08 19:08:35.765657 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:35.765634 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qcp49\"" Jul 08 19:08:35.765772 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:35.765668 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 19:08:35.766614 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:35.766597 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 19:08:35.775439 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:35.775419 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vds7p"] Jul 08 19:08:35.874709 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:35.874664 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/409cc5f5-a8c2-4d86-8898-40dd7b1019d3-bound-sa-token\") pod \"cert-manager-55b4d954d5-vds7p\" (UID: \"409cc5f5-a8c2-4d86-8898-40dd7b1019d3\") " pod="cert-manager/cert-manager-55b4d954d5-vds7p" Jul 08 19:08:35.874890 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:35.874737 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr8ln\" (UniqueName: \"kubernetes.io/projected/409cc5f5-a8c2-4d86-8898-40dd7b1019d3-kube-api-access-jr8ln\") pod \"cert-manager-55b4d954d5-vds7p\" (UID: \"409cc5f5-a8c2-4d86-8898-40dd7b1019d3\") " pod="cert-manager/cert-manager-55b4d954d5-vds7p" Jul 08 19:08:35.976053 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:35.976009 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8ln\" (UniqueName: \"kubernetes.io/projected/409cc5f5-a8c2-4d86-8898-40dd7b1019d3-kube-api-access-jr8ln\") pod \"cert-manager-55b4d954d5-vds7p\" (UID: \"409cc5f5-a8c2-4d86-8898-40dd7b1019d3\") " pod="cert-manager/cert-manager-55b4d954d5-vds7p" Jul 08 19:08:35.976231 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:35.976173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/409cc5f5-a8c2-4d86-8898-40dd7b1019d3-bound-sa-token\") pod \"cert-manager-55b4d954d5-vds7p\" (UID: \"409cc5f5-a8c2-4d86-8898-40dd7b1019d3\") " pod="cert-manager/cert-manager-55b4d954d5-vds7p" Jul 08 19:08:35.985618 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:35.985587 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr8ln\" (UniqueName: \"kubernetes.io/projected/409cc5f5-a8c2-4d86-8898-40dd7b1019d3-kube-api-access-jr8ln\") pod \"cert-manager-55b4d954d5-vds7p\" (UID: \"409cc5f5-a8c2-4d86-8898-40dd7b1019d3\") " pod="cert-manager/cert-manager-55b4d954d5-vds7p" Jul 08 19:08:35.985769 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:35.985749 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/409cc5f5-a8c2-4d86-8898-40dd7b1019d3-bound-sa-token\") pod \"cert-manager-55b4d954d5-vds7p\" (UID: \"409cc5f5-a8c2-4d86-8898-40dd7b1019d3\") " pod="cert-manager/cert-manager-55b4d954d5-vds7p" Jul 08 19:08:36.079499 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:36.079404 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vds7p" Jul 08 19:08:36.213517 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:36.213490 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vds7p"] Jul 08 19:08:36.216453 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:08:36.216424 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod409cc5f5_a8c2_4d86_8898_40dd7b1019d3.slice/crio-660af3e964b0b8db0d7b1cc1e5c7387d505f524f0d5a4427c77af5af414eadea WatchSource:0}: Error finding container 660af3e964b0b8db0d7b1cc1e5c7387d505f524f0d5a4427c77af5af414eadea: Status 404 returned error can't find the container with id 660af3e964b0b8db0d7b1cc1e5c7387d505f524f0d5a4427c77af5af414eadea Jul 08 19:08:36.356699 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:36.356610 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vds7p" event={"ID":"409cc5f5-a8c2-4d86-8898-40dd7b1019d3","Type":"ContainerStarted","Data":"660af3e964b0b8db0d7b1cc1e5c7387d505f524f0d5a4427c77af5af414eadea"} Jul 08 19:08:39.373733 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:39.373646 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vds7p" event={"ID":"409cc5f5-a8c2-4d86-8898-40dd7b1019d3","Type":"ContainerStarted","Data":"a34abdb92ccc754fe83f5458144240cf238340bc185ecabb2b439e70a875a855"} Jul 08 19:08:39.394020 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:08:39.393969 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-vds7p" podStartSLOduration=1.586752963 podStartE2EDuration="4.393952786s" totalImagesPullingTime="2.807199823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:08:39.393310789 +0000 UTC m=+587.785457578" watchObservedRunningTime="2026-07-08 19:08:39.393952786 +0000 UTC m=+587.786099573" Jul 08 19:09:02.333373 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.333324 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk"] Jul 08 19:09:02.336492 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.336426 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.341872 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.341843 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 19:09:02.342197 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.342182 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 19:09:02.342277 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.342224 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 19:09:02.342903 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.342887 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5zlwm\"" Jul 08 19:09:02.342966 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.342897 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 19:09:02.363227 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.363188 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk"] Jul 08 19:09:02.395221 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.395190 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlbfs\" (UniqueName: \"kubernetes.io/projected/5c835a57-8183-4579-9a7e-b202a05dcfe0-kube-api-access-jlbfs\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.395429 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.395269 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c835a57-8183-4579-9a7e-b202a05dcfe0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.395429 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.395307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5c835a57-8183-4579-9a7e-b202a05dcfe0-manifests\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.395429 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.395350 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c835a57-8183-4579-9a7e-b202a05dcfe0-tmp\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.395591 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.395450 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c835a57-8183-4579-9a7e-b202a05dcfe0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.496864 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.496829 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c835a57-8183-4579-9a7e-b202a05dcfe0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.497066 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.496880 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5c835a57-8183-4579-9a7e-b202a05dcfe0-manifests\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.497066 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.496902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c835a57-8183-4579-9a7e-b202a05dcfe0-tmp\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.497066 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.496942 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c835a57-8183-4579-9a7e-b202a05dcfe0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.497066 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.496964 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlbfs\" (UniqueName: \"kubernetes.io/projected/5c835a57-8183-4579-9a7e-b202a05dcfe0-kube-api-access-jlbfs\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.497436 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.497414 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5c835a57-8183-4579-9a7e-b202a05dcfe0-manifests\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.499381 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.499351 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c835a57-8183-4579-9a7e-b202a05dcfe0-tmp\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.499495 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.499426 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c835a57-8183-4579-9a7e-b202a05dcfe0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.499495 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.499490 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c835a57-8183-4579-9a7e-b202a05dcfe0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.512392 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.512356 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlbfs\" (UniqueName: \"kubernetes.io/projected/5c835a57-8183-4579-9a7e-b202a05dcfe0-kube-api-access-jlbfs\") pod \"opendatahub-operator-controller-manager-7dd7775959-vrnjk\" (UID: \"5c835a57-8183-4579-9a7e-b202a05dcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.647261 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.647169 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:02.796024 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.795927 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk"] Jul 08 19:09:02.798513 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:09:02.798479 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c835a57_8183_4579_9a7e_b202a05dcfe0.slice/crio-f71115e0169c63c2dc58cd5421aa172ff4b6d1d08b612668494940165864e218 WatchSource:0}: Error finding container f71115e0169c63c2dc58cd5421aa172ff4b6d1d08b612668494940165864e218: Status 404 returned error can't find the container with id f71115e0169c63c2dc58cd5421aa172ff4b6d1d08b612668494940165864e218 Jul 08 19:09:02.800248 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:02.800228 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:09:03.476183 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:03.476149 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" event={"ID":"5c835a57-8183-4579-9a7e-b202a05dcfe0","Type":"ContainerStarted","Data":"f71115e0169c63c2dc58cd5421aa172ff4b6d1d08b612668494940165864e218"} Jul 08 19:09:06.494010 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:06.493973 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" event={"ID":"5c835a57-8183-4579-9a7e-b202a05dcfe0","Type":"ContainerStarted","Data":"8407cdd3a522ccaabc2c18c09db062e7fbb1b5ef0dded641ce4f3c0d8fe63f97"} Jul 08 19:09:07.499919 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:07.499886 2574 generic.go:356] "Generic (PLEG): container finished" podID="5c835a57-8183-4579-9a7e-b202a05dcfe0" containerID="8407cdd3a522ccaabc2c18c09db062e7fbb1b5ef0dded641ce4f3c0d8fe63f97" exitCode=0 Jul 08 19:09:07.500294 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:07.499950 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" event={"ID":"5c835a57-8183-4579-9a7e-b202a05dcfe0","Type":"ContainerDied","Data":"8407cdd3a522ccaabc2c18c09db062e7fbb1b5ef0dded641ce4f3c0d8fe63f97"} Jul 08 19:09:08.506656 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:08.506617 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" event={"ID":"5c835a57-8183-4579-9a7e-b202a05dcfe0","Type":"ContainerStarted","Data":"5f4c2f58903cd5d773eebd2c470f53fe83bac58d7b2b5676d289b5dd2d13f15f"} Jul 08 19:09:08.507036 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:08.506706 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:08.534116 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:08.534063 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" podStartSLOduration=1.992894045 podStartE2EDuration="6.534047266s" totalImagesPullingTime="3.419041112s" totalInitContainerRuntime="1.122112109s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:08.533665624 +0000 UTC m=+616.925812412" watchObservedRunningTime="2026-07-08 19:09:08.534047266 +0000 UTC m=+616.926194054" Jul 08 19:09:19.513520 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:19.513438 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd7775959-vrnjk" Jul 08 19:09:32.332426 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.332392 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b"] Jul 08 19:09:32.335692 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.335675 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:32.339682 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.339658 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q9mlg\"" Jul 08 19:09:32.341089 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.341069 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 19:09:32.348466 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.348446 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 19:09:32.348828 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.348813 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 19:09:32.374468 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.374432 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 19:09:32.374661 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.374517 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:09:32.376313 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.376290 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b"] Jul 08 19:09:32.471368 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.471319 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92fc1942-7c34-4189-b164-3b9681418430-cert\") pod \"lws-controller-manager-5bfc697457-hsl8b\" (UID: \"92fc1942-7c34-4189-b164-3b9681418430\") " pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:32.471530 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.471385 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/92fc1942-7c34-4189-b164-3b9681418430-metrics-cert\") pod \"lws-controller-manager-5bfc697457-hsl8b\" (UID: \"92fc1942-7c34-4189-b164-3b9681418430\") " pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:32.471530 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.471425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftfz2\" (UniqueName: \"kubernetes.io/projected/92fc1942-7c34-4189-b164-3b9681418430-kube-api-access-ftfz2\") pod \"lws-controller-manager-5bfc697457-hsl8b\" (UID: \"92fc1942-7c34-4189-b164-3b9681418430\") " pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:32.471530 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.471509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/92fc1942-7c34-4189-b164-3b9681418430-manager-config\") pod \"lws-controller-manager-5bfc697457-hsl8b\" (UID: \"92fc1942-7c34-4189-b164-3b9681418430\") " pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:32.572491 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.572459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92fc1942-7c34-4189-b164-3b9681418430-cert\") pod \"lws-controller-manager-5bfc697457-hsl8b\" (UID: \"92fc1942-7c34-4189-b164-3b9681418430\") " pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:32.572647 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.572499 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/92fc1942-7c34-4189-b164-3b9681418430-metrics-cert\") pod \"lws-controller-manager-5bfc697457-hsl8b\" (UID: \"92fc1942-7c34-4189-b164-3b9681418430\") " pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:32.572647 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.572532 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftfz2\" (UniqueName: \"kubernetes.io/projected/92fc1942-7c34-4189-b164-3b9681418430-kube-api-access-ftfz2\") pod \"lws-controller-manager-5bfc697457-hsl8b\" (UID: \"92fc1942-7c34-4189-b164-3b9681418430\") " pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:32.572647 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.572579 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/92fc1942-7c34-4189-b164-3b9681418430-manager-config\") pod \"lws-controller-manager-5bfc697457-hsl8b\" (UID: \"92fc1942-7c34-4189-b164-3b9681418430\") " pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:32.573309 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.573281 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/92fc1942-7c34-4189-b164-3b9681418430-manager-config\") pod \"lws-controller-manager-5bfc697457-hsl8b\" (UID: \"92fc1942-7c34-4189-b164-3b9681418430\") " pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:32.574898 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.574865 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92fc1942-7c34-4189-b164-3b9681418430-cert\") pod \"lws-controller-manager-5bfc697457-hsl8b\" (UID: \"92fc1942-7c34-4189-b164-3b9681418430\") " pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:32.575095 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.575073 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/92fc1942-7c34-4189-b164-3b9681418430-metrics-cert\") pod \"lws-controller-manager-5bfc697457-hsl8b\" (UID: \"92fc1942-7c34-4189-b164-3b9681418430\") " pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:32.585872 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.585805 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftfz2\" (UniqueName: \"kubernetes.io/projected/92fc1942-7c34-4189-b164-3b9681418430-kube-api-access-ftfz2\") pod \"lws-controller-manager-5bfc697457-hsl8b\" (UID: \"92fc1942-7c34-4189-b164-3b9681418430\") " pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:32.645495 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.645460 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:32.797667 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:32.797635 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b"] Jul 08 19:09:32.800716 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:09:32.800689 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92fc1942_7c34_4189_b164_3b9681418430.slice/crio-adcb228f335c7b56fd50d9e32f6073ad74c1093a7ddd02475656939bcdf9954e WatchSource:0}: Error finding container adcb228f335c7b56fd50d9e32f6073ad74c1093a7ddd02475656939bcdf9954e: Status 404 returned error can't find the container with id adcb228f335c7b56fd50d9e32f6073ad74c1093a7ddd02475656939bcdf9954e Jul 08 19:09:33.627502 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:33.627462 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" event={"ID":"92fc1942-7c34-4189-b164-3b9681418430","Type":"ContainerStarted","Data":"adcb228f335c7b56fd50d9e32f6073ad74c1093a7ddd02475656939bcdf9954e"} Jul 08 19:09:34.698664 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.698609 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl"] Jul 08 19:09:34.709687 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.709653 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd"] Jul 08 19:09:34.709873 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.709813 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl" Jul 08 19:09:34.713953 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.713837 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 08 19:09:34.713953 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.713942 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dc6m2\"" Jul 08 19:09:34.714951 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.714932 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd" Jul 08 19:09:34.717441 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.717419 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jzzx8\"" Jul 08 19:09:34.717590 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.717502 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 08 19:09:34.730955 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.729874 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl"] Jul 08 19:09:34.732369 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.732344 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd"] Jul 08 19:09:34.796850 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.796803 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8cq7\" (UniqueName: \"kubernetes.io/projected/d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea-kube-api-access-t8cq7\") pod \"kserve-controller-manager-d6f4b65b8-7jrtd\" (UID: \"d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd" Jul 08 19:09:34.796850 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.796849 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d359a37-063a-4748-991f-3a69c35126c5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8x6jl\" (UID: \"3d359a37-063a-4748-991f-3a69c35126c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl" Jul 08 19:09:34.797087 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.797005 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmvth\" (UniqueName: \"kubernetes.io/projected/3d359a37-063a-4748-991f-3a69c35126c5-kube-api-access-qmvth\") pod \"llmisvc-controller-manager-777c6bd7d5-8x6jl\" (UID: \"3d359a37-063a-4748-991f-3a69c35126c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl" Jul 08 19:09:34.797087 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.797044 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea-cert\") pod \"kserve-controller-manager-d6f4b65b8-7jrtd\" (UID: \"d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd" Jul 08 19:09:34.898527 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.898483 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmvth\" (UniqueName: \"kubernetes.io/projected/3d359a37-063a-4748-991f-3a69c35126c5-kube-api-access-qmvth\") pod \"llmisvc-controller-manager-777c6bd7d5-8x6jl\" (UID: \"3d359a37-063a-4748-991f-3a69c35126c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl" Jul 08 19:09:34.898527 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.898544 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea-cert\") pod \"kserve-controller-manager-d6f4b65b8-7jrtd\" (UID: \"d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd" Jul 08 19:09:34.898832 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.898628 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8cq7\" (UniqueName: \"kubernetes.io/projected/d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea-kube-api-access-t8cq7\") pod \"kserve-controller-manager-d6f4b65b8-7jrtd\" (UID: \"d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd" Jul 08 19:09:34.898832 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.898654 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d359a37-063a-4748-991f-3a69c35126c5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8x6jl\" (UID: \"3d359a37-063a-4748-991f-3a69c35126c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl" Jul 08 19:09:34.901319 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.901295 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d359a37-063a-4748-991f-3a69c35126c5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8x6jl\" (UID: \"3d359a37-063a-4748-991f-3a69c35126c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl" Jul 08 19:09:34.901459 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.901384 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea-cert\") pod \"kserve-controller-manager-d6f4b65b8-7jrtd\" (UID: \"d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd" Jul 08 19:09:34.916032 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.915999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmvth\" (UniqueName: \"kubernetes.io/projected/3d359a37-063a-4748-991f-3a69c35126c5-kube-api-access-qmvth\") pod \"llmisvc-controller-manager-777c6bd7d5-8x6jl\" (UID: \"3d359a37-063a-4748-991f-3a69c35126c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl" Jul 08 19:09:34.954277 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:34.954188 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8cq7\" (UniqueName: \"kubernetes.io/projected/d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea-kube-api-access-t8cq7\") pod \"kserve-controller-manager-d6f4b65b8-7jrtd\" (UID: \"d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd" Jul 08 19:09:35.026264 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:35.026232 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl" Jul 08 19:09:35.035767 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:35.035730 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd" Jul 08 19:09:35.384855 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:35.384820 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl"] Jul 08 19:09:35.387651 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:09:35.387618 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3d359a37_063a_4748_991f_3a69c35126c5.slice/crio-666bf03c4c440d3e17310a3df0b115a4f2caeb81c9dfe29707074d96e7afa9f5 WatchSource:0}: Error finding container 666bf03c4c440d3e17310a3df0b115a4f2caeb81c9dfe29707074d96e7afa9f5: Status 404 returned error can't find the container with id 666bf03c4c440d3e17310a3df0b115a4f2caeb81c9dfe29707074d96e7afa9f5 Jul 08 19:09:35.404830 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:35.404798 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd"] Jul 08 19:09:35.408201 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:09:35.408175 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd88327e6_c93a_4df0_bbdc_5c0de3b4a4ea.slice/crio-173e5fcced8f65805b98323ef42e20cd05039f6cc5990bd27ce5edfb5a2b4310 WatchSource:0}: Error finding container 173e5fcced8f65805b98323ef42e20cd05039f6cc5990bd27ce5edfb5a2b4310: Status 404 returned error can't find the container with id 173e5fcced8f65805b98323ef42e20cd05039f6cc5990bd27ce5edfb5a2b4310 Jul 08 19:09:35.638882 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:35.638785 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" event={"ID":"92fc1942-7c34-4189-b164-3b9681418430","Type":"ContainerStarted","Data":"6cfa0f41ba26dffc85e68ec647e1e85205b8450ea422b90e645a0f9fca128ce2"} Jul 08 19:09:35.639049 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:35.638907 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:09:35.640088 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:35.640066 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd" event={"ID":"d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea","Type":"ContainerStarted","Data":"173e5fcced8f65805b98323ef42e20cd05039f6cc5990bd27ce5edfb5a2b4310"} Jul 08 19:09:35.641102 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:35.641086 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl" event={"ID":"3d359a37-063a-4748-991f-3a69c35126c5","Type":"ContainerStarted","Data":"666bf03c4c440d3e17310a3df0b115a4f2caeb81c9dfe29707074d96e7afa9f5"} Jul 08 19:09:35.659525 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:35.659480 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" podStartSLOduration=1.20725053 podStartE2EDuration="3.659464706s" totalImagesPullingTime="2.452214176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:35.658474642 +0000 UTC m=+644.050621453" watchObservedRunningTime="2026-07-08 19:09:35.659464706 +0000 UTC m=+644.051611491" Jul 08 19:09:40.668506 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:40.668469 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd" event={"ID":"d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea","Type":"ContainerStarted","Data":"23e8e6e44bbb17f38815eb1adfb1423ae90a192dd4458f9fe0d41920846a9ee9"} Jul 08 19:09:40.668924 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:40.668549 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd" Jul 08 19:09:40.670027 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:40.670005 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl" event={"ID":"3d359a37-063a-4748-991f-3a69c35126c5","Type":"ContainerStarted","Data":"d4e73f9b3106cf35f1bdcbdeaeea6949ac189f2056d10308b8ea7bb2b4edc078"} Jul 08 19:09:40.670145 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:40.670131 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl" Jul 08 19:09:40.753056 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:40.752999 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd" podStartSLOduration=2.344680256 podStartE2EDuration="6.752981277s" totalImagesPullingTime="4.408301021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:40.722779352 +0000 UTC m=+649.114926139" watchObservedRunningTime="2026-07-08 19:09:40.752981277 +0000 UTC m=+649.145128065" Jul 08 19:09:40.753284 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:40.753257 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl" podStartSLOduration=2.320912044 podStartE2EDuration="6.753251412s" totalImagesPullingTime="4.432339368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:40.751097961 +0000 UTC m=+649.143244750" watchObservedRunningTime="2026-07-08 19:09:40.753251412 +0000 UTC m=+649.145398200" Jul 08 19:09:46.649321 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:09:46.649291 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5bfc697457-hsl8b" Jul 08 19:10:11.677243 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:11.677209 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8x6jl" Jul 08 19:10:11.680107 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:11.680092 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jrtd" Jul 08 19:10:23.293510 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.293469 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l49pb"] Jul 08 19:10:23.295867 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.295848 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l49pb" Jul 08 19:10:23.299165 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.299138 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 19:10:23.299356 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.299307 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6xcts\"" Jul 08 19:10:23.300144 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.300113 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 19:10:23.315526 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.315497 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l49pb"] Jul 08 19:10:23.425245 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.425203 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9snfc\" (UniqueName: \"kubernetes.io/projected/796499ac-6d9f-4f04-a2c4-e30f63943f6c-kube-api-access-9snfc\") pod \"kuadrant-operator-catalog-l49pb\" (UID: \"796499ac-6d9f-4f04-a2c4-e30f63943f6c\") " pod="kuadrant-system/kuadrant-operator-catalog-l49pb" Jul 08 19:10:23.525971 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.525936 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9snfc\" (UniqueName: \"kubernetes.io/projected/796499ac-6d9f-4f04-a2c4-e30f63943f6c-kube-api-access-9snfc\") pod \"kuadrant-operator-catalog-l49pb\" (UID: \"796499ac-6d9f-4f04-a2c4-e30f63943f6c\") " pod="kuadrant-system/kuadrant-operator-catalog-l49pb" Jul 08 19:10:23.534554 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.534525 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9snfc\" (UniqueName: \"kubernetes.io/projected/796499ac-6d9f-4f04-a2c4-e30f63943f6c-kube-api-access-9snfc\") pod \"kuadrant-operator-catalog-l49pb\" (UID: \"796499ac-6d9f-4f04-a2c4-e30f63943f6c\") " pod="kuadrant-system/kuadrant-operator-catalog-l49pb" Jul 08 19:10:23.605975 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.605878 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l49pb" Jul 08 19:10:23.642028 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.641997 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l49pb"] Jul 08 19:10:23.737981 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.737933 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l49pb"] Jul 08 19:10:23.740478 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:10:23.740449 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod796499ac_6d9f_4f04_a2c4_e30f63943f6c.slice/crio-27882fd1f02521af37d1d892edd85019d605e53bfa865ad299d83a6f2e303902 WatchSource:0}: Error finding container 27882fd1f02521af37d1d892edd85019d605e53bfa865ad299d83a6f2e303902: Status 404 returned error can't find the container with id 27882fd1f02521af37d1d892edd85019d605e53bfa865ad299d83a6f2e303902 Jul 08 19:10:23.852897 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.852863 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vt2nm"] Jul 08 19:10:23.855824 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.855801 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vt2nm" Jul 08 19:10:23.864692 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.864665 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vt2nm"] Jul 08 19:10:23.870832 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.870802 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l49pb" event={"ID":"796499ac-6d9f-4f04-a2c4-e30f63943f6c","Type":"ContainerStarted","Data":"27882fd1f02521af37d1d892edd85019d605e53bfa865ad299d83a6f2e303902"} Jul 08 19:10:23.929778 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:23.929737 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd9nx\" (UniqueName: \"kubernetes.io/projected/8cf60436-871a-40a9-943a-89b55e12efd1-kube-api-access-jd9nx\") pod \"kuadrant-operator-catalog-vt2nm\" (UID: \"8cf60436-871a-40a9-943a-89b55e12efd1\") " pod="kuadrant-system/kuadrant-operator-catalog-vt2nm" Jul 08 19:10:24.030515 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:24.030483 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd9nx\" (UniqueName: \"kubernetes.io/projected/8cf60436-871a-40a9-943a-89b55e12efd1-kube-api-access-jd9nx\") pod \"kuadrant-operator-catalog-vt2nm\" (UID: \"8cf60436-871a-40a9-943a-89b55e12efd1\") " pod="kuadrant-system/kuadrant-operator-catalog-vt2nm" Jul 08 19:10:24.039393 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:24.039363 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd9nx\" (UniqueName: \"kubernetes.io/projected/8cf60436-871a-40a9-943a-89b55e12efd1-kube-api-access-jd9nx\") pod \"kuadrant-operator-catalog-vt2nm\" (UID: \"8cf60436-871a-40a9-943a-89b55e12efd1\") " pod="kuadrant-system/kuadrant-operator-catalog-vt2nm" Jul 08 19:10:24.166839 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:24.166751 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vt2nm" Jul 08 19:10:24.304229 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:24.304127 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vt2nm"] Jul 08 19:10:24.307401 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:10:24.307363 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf60436_871a_40a9_943a_89b55e12efd1.slice/crio-3f79f310c9d8106d968169c4c15d79e283c8f434818a93484d44fc02bd6d3784 WatchSource:0}: Error finding container 3f79f310c9d8106d968169c4c15d79e283c8f434818a93484d44fc02bd6d3784: Status 404 returned error can't find the container with id 3f79f310c9d8106d968169c4c15d79e283c8f434818a93484d44fc02bd6d3784 Jul 08 19:10:24.877638 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:24.877607 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vt2nm" event={"ID":"8cf60436-871a-40a9-943a-89b55e12efd1","Type":"ContainerStarted","Data":"3f79f310c9d8106d968169c4c15d79e283c8f434818a93484d44fc02bd6d3784"} Jul 08 19:10:26.889344 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:26.889306 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l49pb" event={"ID":"796499ac-6d9f-4f04-a2c4-e30f63943f6c","Type":"ContainerStarted","Data":"f5fc0c435a3ce54ab7e47053daca3a60996efc0d9d3c85296a5870ec94c2e1e3"} Jul 08 19:10:26.889825 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:26.889417 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-l49pb" podUID="796499ac-6d9f-4f04-a2c4-e30f63943f6c" containerName="registry-server" containerID="cri-o://f5fc0c435a3ce54ab7e47053daca3a60996efc0d9d3c85296a5870ec94c2e1e3" gracePeriod=2 Jul 08 19:10:26.890892 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:26.890866 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vt2nm" event={"ID":"8cf60436-871a-40a9-943a-89b55e12efd1","Type":"ContainerStarted","Data":"457df423dce9dd5b9ce34ed88cccde3f70b77ccc74c8f70bfbeef512e5bfb6a1"} Jul 08 19:10:26.908155 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:26.908109 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l49pb" podStartSLOduration=1.498764001 podStartE2EDuration="3.908094976s" totalImagesPullingTime="2.409330975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:10:26.905903336 +0000 UTC m=+695.298050139" watchObservedRunningTime="2026-07-08 19:10:26.908094976 +0000 UTC m=+695.300241764" Jul 08 19:10:26.922144 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:26.922097 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vt2nm" podStartSLOduration=2.077309802 podStartE2EDuration="3.92208053s" totalImagesPullingTime="1.844770728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:10:26.921691297 +0000 UTC m=+695.313838114" watchObservedRunningTime="2026-07-08 19:10:26.92208053 +0000 UTC m=+695.314227317" Jul 08 19:10:27.132989 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:27.132956 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l49pb" Jul 08 19:10:27.261424 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:27.261379 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9snfc\" (UniqueName: \"kubernetes.io/projected/796499ac-6d9f-4f04-a2c4-e30f63943f6c-kube-api-access-9snfc\") pod \"796499ac-6d9f-4f04-a2c4-e30f63943f6c\" (UID: \"796499ac-6d9f-4f04-a2c4-e30f63943f6c\") " Jul 08 19:10:27.263571 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:27.263538 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/796499ac-6d9f-4f04-a2c4-e30f63943f6c-kube-api-access-9snfc" (OuterVolumeSpecName: "kube-api-access-9snfc") pod "796499ac-6d9f-4f04-a2c4-e30f63943f6c" (UID: "796499ac-6d9f-4f04-a2c4-e30f63943f6c"). InnerVolumeSpecName "kube-api-access-9snfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:10:27.362825 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:27.362771 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9snfc\" (UniqueName: \"kubernetes.io/projected/796499ac-6d9f-4f04-a2c4-e30f63943f6c-kube-api-access-9snfc\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:10:27.896576 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:27.896539 2574 generic.go:356] "Generic (PLEG): container finished" podID="796499ac-6d9f-4f04-a2c4-e30f63943f6c" containerID="f5fc0c435a3ce54ab7e47053daca3a60996efc0d9d3c85296a5870ec94c2e1e3" exitCode=0 Jul 08 19:10:27.897071 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:27.896584 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l49pb" Jul 08 19:10:27.897071 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:27.896633 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l49pb" event={"ID":"796499ac-6d9f-4f04-a2c4-e30f63943f6c","Type":"ContainerDied","Data":"f5fc0c435a3ce54ab7e47053daca3a60996efc0d9d3c85296a5870ec94c2e1e3"} Jul 08 19:10:27.897071 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:27.896696 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l49pb" event={"ID":"796499ac-6d9f-4f04-a2c4-e30f63943f6c","Type":"ContainerDied","Data":"27882fd1f02521af37d1d892edd85019d605e53bfa865ad299d83a6f2e303902"} Jul 08 19:10:27.897071 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:27.896733 2574 scope.go:117] "RemoveContainer" containerID="f5fc0c435a3ce54ab7e47053daca3a60996efc0d9d3c85296a5870ec94c2e1e3" Jul 08 19:10:27.905821 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:27.905800 2574 scope.go:117] "RemoveContainer" containerID="f5fc0c435a3ce54ab7e47053daca3a60996efc0d9d3c85296a5870ec94c2e1e3" Jul 08 19:10:27.906100 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:10:27.906078 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5fc0c435a3ce54ab7e47053daca3a60996efc0d9d3c85296a5870ec94c2e1e3\": container with ID starting with f5fc0c435a3ce54ab7e47053daca3a60996efc0d9d3c85296a5870ec94c2e1e3 not found: ID does not exist" containerID="f5fc0c435a3ce54ab7e47053daca3a60996efc0d9d3c85296a5870ec94c2e1e3" Jul 08 19:10:27.906140 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:27.906111 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5fc0c435a3ce54ab7e47053daca3a60996efc0d9d3c85296a5870ec94c2e1e3"} err="failed to get container status \"f5fc0c435a3ce54ab7e47053daca3a60996efc0d9d3c85296a5870ec94c2e1e3\": rpc error: code = NotFound desc = could not find container \"f5fc0c435a3ce54ab7e47053daca3a60996efc0d9d3c85296a5870ec94c2e1e3\": container with ID starting with f5fc0c435a3ce54ab7e47053daca3a60996efc0d9d3c85296a5870ec94c2e1e3 not found: ID does not exist" Jul 08 19:10:27.918883 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:27.918851 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l49pb"] Jul 08 19:10:27.923169 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:27.923145 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l49pb"] Jul 08 19:10:28.225495 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:28.225466 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="796499ac-6d9f-4f04-a2c4-e30f63943f6c" path="/var/lib/kubelet/pods/796499ac-6d9f-4f04-a2c4-e30f63943f6c/volumes" Jul 08 19:10:34.167458 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:34.167407 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vt2nm" Jul 08 19:10:34.167458 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:34.167477 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vt2nm" Jul 08 19:10:34.190471 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:34.190441 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vt2nm" Jul 08 19:10:34.952686 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:34.952661 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vt2nm" Jul 08 19:10:54.775879 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:54.775843 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz"] Jul 08 19:10:54.776271 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:54.776201 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="796499ac-6d9f-4f04-a2c4-e30f63943f6c" containerName="registry-server" Jul 08 19:10:54.776271 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:54.776213 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="796499ac-6d9f-4f04-a2c4-e30f63943f6c" containerName="registry-server" Jul 08 19:10:54.776361 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:54.776280 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="796499ac-6d9f-4f04-a2c4-e30f63943f6c" containerName="registry-server" Jul 08 19:10:54.783230 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:54.783208 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:10:54.785776 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:54.785744 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9vrbx\"" Jul 08 19:10:54.792143 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:54.792114 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz"] Jul 08 19:10:54.886409 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:54.886370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dstbj\" (UniqueName: \"kubernetes.io/projected/a3876281-2829-4ff4-a94b-ed45a95ed11e-kube-api-access-dstbj\") pod \"limitador-operator-controller-manager-859d7b78bd-wr6kz\" (UID: \"a3876281-2829-4ff4-a94b-ed45a95ed11e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:10:54.987313 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:54.987272 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dstbj\" (UniqueName: \"kubernetes.io/projected/a3876281-2829-4ff4-a94b-ed45a95ed11e-kube-api-access-dstbj\") pod \"limitador-operator-controller-manager-859d7b78bd-wr6kz\" (UID: \"a3876281-2829-4ff4-a94b-ed45a95ed11e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:10:54.995921 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:54.995892 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dstbj\" (UniqueName: \"kubernetes.io/projected/a3876281-2829-4ff4-a94b-ed45a95ed11e-kube-api-access-dstbj\") pod \"limitador-operator-controller-manager-859d7b78bd-wr6kz\" (UID: \"a3876281-2829-4ff4-a94b-ed45a95ed11e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:10:55.094169 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:55.094069 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:10:55.229290 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:55.229231 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz"] Jul 08 19:10:55.233970 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:10:55.233940 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3876281_2829_4ff4_a94b_ed45a95ed11e.slice/crio-58851526f9070b72cb6e772ec5cdee6988341f834b39a69e2774c74b5c2a2124 WatchSource:0}: Error finding container 58851526f9070b72cb6e772ec5cdee6988341f834b39a69e2774c74b5c2a2124: Status 404 returned error can't find the container with id 58851526f9070b72cb6e772ec5cdee6988341f834b39a69e2774c74b5c2a2124 Jul 08 19:10:56.029030 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:56.028989 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" event={"ID":"a3876281-2829-4ff4-a94b-ed45a95ed11e","Type":"ContainerStarted","Data":"58851526f9070b72cb6e772ec5cdee6988341f834b39a69e2774c74b5c2a2124"} Jul 08 19:10:57.038527 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:57.038481 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" event={"ID":"a3876281-2829-4ff4-a94b-ed45a95ed11e","Type":"ContainerStarted","Data":"9bd7a5f66931bc31051ab70da36fc4317e340404662ed4116fde21d860b11261"} Jul 08 19:10:57.039004 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:57.038781 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:10:57.061072 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:10:57.060979 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" podStartSLOduration=1.354284211 podStartE2EDuration="3.060955563s" totalImagesPullingTime="1.706671352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:10:57.06045796 +0000 UTC m=+725.452604774" watchObservedRunningTime="2026-07-08 19:10:57.060955563 +0000 UTC m=+725.453102351" Jul 08 19:11:07.471309 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:07.471272 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ltbpm"] Jul 08 19:11:07.474350 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:07.474320 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ltbpm" Jul 08 19:11:07.477024 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:07.476997 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6wlvt\"" Jul 08 19:11:07.487927 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:07.487891 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ltbpm"] Jul 08 19:11:07.607146 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:07.607100 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfgj7\" (UniqueName: \"kubernetes.io/projected/461fed93-b544-40cd-bea0-13fe57bfcb38-kube-api-access-hfgj7\") pod \"authorino-operator-75cc8d5cb7-ltbpm\" (UID: \"461fed93-b544-40cd-bea0-13fe57bfcb38\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ltbpm" Jul 08 19:11:07.708452 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:07.708407 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfgj7\" (UniqueName: \"kubernetes.io/projected/461fed93-b544-40cd-bea0-13fe57bfcb38-kube-api-access-hfgj7\") pod \"authorino-operator-75cc8d5cb7-ltbpm\" (UID: \"461fed93-b544-40cd-bea0-13fe57bfcb38\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ltbpm" Jul 08 19:11:07.718074 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:07.718036 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfgj7\" (UniqueName: \"kubernetes.io/projected/461fed93-b544-40cd-bea0-13fe57bfcb38-kube-api-access-hfgj7\") pod \"authorino-operator-75cc8d5cb7-ltbpm\" (UID: \"461fed93-b544-40cd-bea0-13fe57bfcb38\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ltbpm" Jul 08 19:11:07.784783 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:07.784739 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ltbpm" Jul 08 19:11:07.923267 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:07.923171 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ltbpm"] Jul 08 19:11:07.926223 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:11:07.926193 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod461fed93_b544_40cd_bea0_13fe57bfcb38.slice/crio-0ec50863d38c10158ede97795cdffd29a30890a3a8030808118f1193af60f1fb WatchSource:0}: Error finding container 0ec50863d38c10158ede97795cdffd29a30890a3a8030808118f1193af60f1fb: Status 404 returned error can't find the container with id 0ec50863d38c10158ede97795cdffd29a30890a3a8030808118f1193af60f1fb Jul 08 19:11:08.047179 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:08.047092 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:11:08.096762 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:08.096729 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ltbpm" event={"ID":"461fed93-b544-40cd-bea0-13fe57bfcb38","Type":"ContainerStarted","Data":"0ec50863d38c10158ede97795cdffd29a30890a3a8030808118f1193af60f1fb"} Jul 08 19:11:11.115706 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:11.115612 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ltbpm" event={"ID":"461fed93-b544-40cd-bea0-13fe57bfcb38","Type":"ContainerStarted","Data":"86a0ca6cca90430b297006ee3d6d122729e5180a09eb149a787a51c6a1fd269c"} Jul 08 19:11:11.116079 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:11.115719 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ltbpm" Jul 08 19:11:11.137462 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:11.137407 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ltbpm" podStartSLOduration=1.314769386 podStartE2EDuration="4.137389693s" totalImagesPullingTime="2.822620307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:11:11.134821273 +0000 UTC m=+739.526968062" watchObservedRunningTime="2026-07-08 19:11:11.137389693 +0000 UTC m=+739.529536481" Jul 08 19:11:22.125279 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:22.125248 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ltbpm" Jul 08 19:11:24.973320 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:24.973288 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz"] Jul 08 19:11:24.973878 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:24.973553 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" podUID="a3876281-2829-4ff4-a94b-ed45a95ed11e" containerName="manager" containerID="cri-o://9bd7a5f66931bc31051ab70da36fc4317e340404662ed4116fde21d860b11261" gracePeriod=2 Jul 08 19:11:24.983847 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:24.983744 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz"] Jul 08 19:11:24.988023 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:11:24.987994 2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a3876281-2829-4ff4-a94b-ed45a95ed11e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-wr6kz\": pods \"limitador-operator-controller-manager-859d7b78bd-wr6kz\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:11:24.999946 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:24.999914 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-clwjt"] Jul 08 19:11:25.000561 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.000540 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3876281-2829-4ff4-a94b-ed45a95ed11e" containerName="manager" Jul 08 19:11:25.000691 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.000563 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3876281-2829-4ff4-a94b-ed45a95ed11e" containerName="manager" Jul 08 19:11:25.000747 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.000696 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3876281-2829-4ff4-a94b-ed45a95ed11e" containerName="manager" Jul 08 19:11:25.003929 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.003909 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-clwjt" Jul 08 19:11:25.006785 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:11:25.006754 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wr6kz\" is forbidden: User \"system:node:ip-10-0-142-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-189.ec2.internal' and this object" podUID="a3876281-2829-4ff4-a94b-ed45a95ed11e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:11:25.016690 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.016660 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-clwjt"] Jul 08 19:11:25.078197 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.078158 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clmqv\" (UniqueName: \"kubernetes.io/projected/25a36e38-422e-4b81-9841-99fa6e02669b-kube-api-access-clmqv\") pod \"limitador-operator-controller-manager-859d7b78bd-clwjt\" (UID: \"25a36e38-422e-4b81-9841-99fa6e02669b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-clwjt" Jul 08 19:11:25.179438 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.179405 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clmqv\" (UniqueName: \"kubernetes.io/projected/25a36e38-422e-4b81-9841-99fa6e02669b-kube-api-access-clmqv\") pod \"limitador-operator-controller-manager-859d7b78bd-clwjt\" (UID: \"25a36e38-422e-4b81-9841-99fa6e02669b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-clwjt" Jul 08 19:11:25.185359 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.185316 2574 generic.go:356] "Generic (PLEG): container finished" podID="a3876281-2829-4ff4-a94b-ed45a95ed11e" containerID="9bd7a5f66931bc31051ab70da36fc4317e340404662ed4116fde21d860b11261" exitCode=0 Jul 08 19:11:25.188189 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.188162 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clmqv\" (UniqueName: \"kubernetes.io/projected/25a36e38-422e-4b81-9841-99fa6e02669b-kube-api-access-clmqv\") pod \"limitador-operator-controller-manager-859d7b78bd-clwjt\" (UID: \"25a36e38-422e-4b81-9841-99fa6e02669b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-clwjt" Jul 08 19:11:25.211058 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.211038 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:11:25.213414 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:11:25.213388 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wr6kz\" is forbidden: User \"system:node:ip-10-0-142-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-189.ec2.internal' and this object" podUID="a3876281-2829-4ff4-a94b-ed45a95ed11e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:11:25.280080 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.280006 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dstbj\" (UniqueName: \"kubernetes.io/projected/a3876281-2829-4ff4-a94b-ed45a95ed11e-kube-api-access-dstbj\") pod \"a3876281-2829-4ff4-a94b-ed45a95ed11e\" (UID: \"a3876281-2829-4ff4-a94b-ed45a95ed11e\") " Jul 08 19:11:25.282050 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.282026 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3876281-2829-4ff4-a94b-ed45a95ed11e-kube-api-access-dstbj" (OuterVolumeSpecName: "kube-api-access-dstbj") pod "a3876281-2829-4ff4-a94b-ed45a95ed11e" (UID: "a3876281-2829-4ff4-a94b-ed45a95ed11e"). InnerVolumeSpecName "kube-api-access-dstbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:11:25.350273 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.350233 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-clwjt" Jul 08 19:11:25.380577 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.380542 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dstbj\" (UniqueName: \"kubernetes.io/projected/a3876281-2829-4ff4-a94b-ed45a95ed11e-kube-api-access-dstbj\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:11:25.494007 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:25.493976 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-clwjt"] Jul 08 19:11:25.497108 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:11:25.497079 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a36e38_422e_4b81_9841_99fa6e02669b.slice/crio-5929988ee6676f6cc4285a1cd0b2b0a80c637314e9cbd370875929181ed0818a WatchSource:0}: Error finding container 5929988ee6676f6cc4285a1cd0b2b0a80c637314e9cbd370875929181ed0818a: Status 404 returned error can't find the container with id 5929988ee6676f6cc4285a1cd0b2b0a80c637314e9cbd370875929181ed0818a Jul 08 19:11:26.191451 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:26.191424 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:11:26.192153 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:26.191489 2574 scope.go:117] "RemoveContainer" containerID="9bd7a5f66931bc31051ab70da36fc4317e340404662ed4116fde21d860b11261" Jul 08 19:11:26.193072 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:26.193042 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-clwjt" event={"ID":"25a36e38-422e-4b81-9841-99fa6e02669b","Type":"ContainerStarted","Data":"a936b5abe61ff0404e92abdb7eb52c8a9cd31d552d5eb54187b56030a4d04050"} Jul 08 19:11:26.193181 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:26.193099 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-clwjt" event={"ID":"25a36e38-422e-4b81-9841-99fa6e02669b","Type":"ContainerStarted","Data":"5929988ee6676f6cc4285a1cd0b2b0a80c637314e9cbd370875929181ed0818a"} Jul 08 19:11:26.193181 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:26.193123 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-clwjt" Jul 08 19:11:26.193845 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:11:26.193824 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wr6kz\" is forbidden: User \"system:node:ip-10-0-142-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-189.ec2.internal' and this object" podUID="a3876281-2829-4ff4-a94b-ed45a95ed11e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:11:26.195949 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:11:26.195922 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wr6kz\" is forbidden: User \"system:node:ip-10-0-142-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-189.ec2.internal' and this object" podUID="a3876281-2829-4ff4-a94b-ed45a95ed11e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:11:26.220543 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:11:26.220500 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wr6kz\" is forbidden: User \"system:node:ip-10-0-142-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-189.ec2.internal' and this object" podUID="a3876281-2829-4ff4-a94b-ed45a95ed11e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wr6kz" Jul 08 19:11:26.221492 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:26.221447 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-clwjt" podStartSLOduration=2.221428501 podStartE2EDuration="2.221428501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:11:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:11:26.218690236 +0000 UTC m=+754.610837027" watchObservedRunningTime="2026-07-08 19:11:26.221428501 +0000 UTC m=+754.613575305" Jul 08 19:11:26.225723 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:26.225702 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3876281-2829-4ff4-a94b-ed45a95ed11e" path="/var/lib/kubelet/pods/a3876281-2829-4ff4-a94b-ed45a95ed11e/volumes" Jul 08 19:11:37.201886 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:37.201855 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-clwjt" Jul 08 19:11:37.516225 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:37.516186 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8"] Jul 08 19:11:37.522609 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:37.522590 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" Jul 08 19:11:37.525222 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:37.525202 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-szlr2\"" Jul 08 19:11:37.534711 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:37.534684 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8"] Jul 08 19:11:37.588037 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:37.587998 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c12eeaf-f792-4b2b-9726-3024944a5bd4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kh9g8\" (UID: \"5c12eeaf-f792-4b2b-9726-3024944a5bd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" Jul 08 19:11:37.588233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:37.588116 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk5xj\" (UniqueName: \"kubernetes.io/projected/5c12eeaf-f792-4b2b-9726-3024944a5bd4-kube-api-access-vk5xj\") pod \"kuadrant-operator-controller-manager-86878c769f-kh9g8\" (UID: \"5c12eeaf-f792-4b2b-9726-3024944a5bd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" Jul 08 19:11:37.689537 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:37.689494 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5xj\" (UniqueName: \"kubernetes.io/projected/5c12eeaf-f792-4b2b-9726-3024944a5bd4-kube-api-access-vk5xj\") pod \"kuadrant-operator-controller-manager-86878c769f-kh9g8\" (UID: \"5c12eeaf-f792-4b2b-9726-3024944a5bd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" Jul 08 19:11:37.689742 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:37.689574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c12eeaf-f792-4b2b-9726-3024944a5bd4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kh9g8\" (UID: \"5c12eeaf-f792-4b2b-9726-3024944a5bd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" Jul 08 19:11:37.689956 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:37.689935 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c12eeaf-f792-4b2b-9726-3024944a5bd4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kh9g8\" (UID: \"5c12eeaf-f792-4b2b-9726-3024944a5bd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" Jul 08 19:11:37.700006 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:37.699979 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk5xj\" (UniqueName: \"kubernetes.io/projected/5c12eeaf-f792-4b2b-9726-3024944a5bd4-kube-api-access-vk5xj\") pod \"kuadrant-operator-controller-manager-86878c769f-kh9g8\" (UID: \"5c12eeaf-f792-4b2b-9726-3024944a5bd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" Jul 08 19:11:37.833536 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:37.833444 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" Jul 08 19:11:37.988492 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:37.988469 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8"] Jul 08 19:11:37.991157 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:11:37.991129 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c12eeaf_f792_4b2b_9726_3024944a5bd4.slice/crio-fcc1f927fabfc32558c3c9178fc8f492a5076ef3de05bec456b728312164f222 WatchSource:0}: Error finding container fcc1f927fabfc32558c3c9178fc8f492a5076ef3de05bec456b728312164f222: Status 404 returned error can't find the container with id fcc1f927fabfc32558c3c9178fc8f492a5076ef3de05bec456b728312164f222 Jul 08 19:11:38.256037 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:38.256000 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" event={"ID":"5c12eeaf-f792-4b2b-9726-3024944a5bd4","Type":"ContainerStarted","Data":"fcc1f927fabfc32558c3c9178fc8f492a5076ef3de05bec456b728312164f222"} Jul 08 19:11:45.298369 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:45.298314 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" event={"ID":"5c12eeaf-f792-4b2b-9726-3024944a5bd4","Type":"ContainerStarted","Data":"83f747801bb319c87f3eb525f9d8392497a5a16746fb9d0e383c6ec06fd4b029"} Jul 08 19:11:45.298756 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:45.298469 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" Jul 08 19:11:45.321391 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:45.321319 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" podStartSLOduration=1.662764912 podStartE2EDuration="8.321300972s" totalImagesPullingTime="6.65853606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:11:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:11:45.319325818 +0000 UTC m=+773.711472615" watchObservedRunningTime="2026-07-08 19:11:45.321300972 +0000 UTC m=+773.713447759" Jul 08 19:11:56.305833 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:11:56.305802 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" Jul 08 19:13:58.605634 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.605600 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zv275"] Jul 08 19:13:58.609189 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.609161 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.612802 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.612780 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hs4tk\"" Jul 08 19:13:58.613045 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.613027 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 19:13:58.613092 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.613067 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 08 19:13:58.613092 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.613079 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 19:13:58.620388 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.620362 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zv275"] Jul 08 19:13:58.668885 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.668840 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db64l\" (UniqueName: \"kubernetes.io/projected/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-kube-api-access-db64l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.669065 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.668903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.669065 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.669010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.669065 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.669040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.669253 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.669060 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.669253 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.669131 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.769914 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.769873 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.769914 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.769911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.770161 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.769929 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.770161 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.769952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.770161 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.770021 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db64l\" (UniqueName: \"kubernetes.io/projected/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-kube-api-access-db64l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.770161 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.770052 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.770393 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.770356 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.770451 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.770425 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.770496 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.770474 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.772317 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.772300 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.772454 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.772439 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.778456 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.778431 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db64l\" (UniqueName: \"kubernetes.io/projected/0c7d896f-ac4f-41d6-ae81-5d26b00a8a95-kube-api-access-db64l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zv275\" (UID: \"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:58.920909 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:58.920822 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:13:59.060669 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:59.060646 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zv275"] Jul 08 19:13:59.063045 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:13:59.063006 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7d896f_ac4f_41d6_ae81_5d26b00a8a95.slice/crio-39da7c3cdee945afc947de0a6beb6026338aca4cbf6e0bce58f49d0a2dfb8134 WatchSource:0}: Error finding container 39da7c3cdee945afc947de0a6beb6026338aca4cbf6e0bce58f49d0a2dfb8134: Status 404 returned error can't find the container with id 39da7c3cdee945afc947de0a6beb6026338aca4cbf6e0bce58f49d0a2dfb8134 Jul 08 19:13:59.953792 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:13:59.953754 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" event={"ID":"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95","Type":"ContainerStarted","Data":"39da7c3cdee945afc947de0a6beb6026338aca4cbf6e0bce58f49d0a2dfb8134"} Jul 08 19:14:00.966185 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:00.966145 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" event={"ID":"0c7d896f-ac4f-41d6-ae81-5d26b00a8a95","Type":"ContainerStarted","Data":"809cdc6f38519fbb21800f7d0d123c53ed57db46b996f66ffdc399c622b3b069"} Jul 08 19:14:00.985436 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:00.985381 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" podStartSLOduration=1.930393811 podStartE2EDuration="2.985364519s" totalImagesPullingTime="1.054970708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:14:00.983002939 +0000 UTC m=+909.375149727" watchObservedRunningTime="2026-07-08 19:14:00.985364519 +0000 UTC m=+909.377511307" Jul 08 19:14:08.921277 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:08.921230 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:14:08.923821 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:08.921303 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:14:08.934022 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:08.933999 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:14:09.018159 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:09.018127 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zv275" Jul 08 19:14:27.905547 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:27.905512 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn"] Jul 08 19:14:27.908698 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:27.908662 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:27.911220 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:27.911200 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 08 19:14:27.921748 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:27.921718 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn"] Jul 08 19:14:28.046659 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.046622 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5078f5f1-197f-48a5-9302-73f23982db6a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.046659 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.046656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5078f5f1-197f-48a5-9302-73f23982db6a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.046911 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.046685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5078f5f1-197f-48a5-9302-73f23982db6a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.046911 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.046819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5078f5f1-197f-48a5-9302-73f23982db6a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.046911 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.046861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5078f5f1-197f-48a5-9302-73f23982db6a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.047014 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.046919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhl9c\" (UniqueName: \"kubernetes.io/projected/5078f5f1-197f-48a5-9302-73f23982db6a-kube-api-access-nhl9c\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.147998 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.147957 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5078f5f1-197f-48a5-9302-73f23982db6a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.147998 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.148007 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5078f5f1-197f-48a5-9302-73f23982db6a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.148270 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.148036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhl9c\" (UniqueName: \"kubernetes.io/projected/5078f5f1-197f-48a5-9302-73f23982db6a-kube-api-access-nhl9c\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.148270 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.148083 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5078f5f1-197f-48a5-9302-73f23982db6a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.148270 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.148102 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5078f5f1-197f-48a5-9302-73f23982db6a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.148270 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.148245 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5078f5f1-197f-48a5-9302-73f23982db6a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.148565 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.148546 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5078f5f1-197f-48a5-9302-73f23982db6a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.148651 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.148634 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5078f5f1-197f-48a5-9302-73f23982db6a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.148728 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.148706 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5078f5f1-197f-48a5-9302-73f23982db6a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.150473 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.150453 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5078f5f1-197f-48a5-9302-73f23982db6a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.150618 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.150537 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5078f5f1-197f-48a5-9302-73f23982db6a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.157884 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.157824 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhl9c\" (UniqueName: \"kubernetes.io/projected/5078f5f1-197f-48a5-9302-73f23982db6a-kube-api-access-nhl9c\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-flsmn\" (UID: \"5078f5f1-197f-48a5-9302-73f23982db6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.219473 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.219437 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:28.361498 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.361467 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn"] Jul 08 19:14:28.363743 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:14:28.363712 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5078f5f1_197f_48a5_9302_73f23982db6a.slice/crio-a8f52d7b6fd96907e128621fb85006e718256d47b461a49ba696c1614316428c WatchSource:0}: Error finding container a8f52d7b6fd96907e128621fb85006e718256d47b461a49ba696c1614316428c: Status 404 returned error can't find the container with id a8f52d7b6fd96907e128621fb85006e718256d47b461a49ba696c1614316428c Jul 08 19:14:28.365044 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:28.365028 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:14:29.103080 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:29.103050 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" event={"ID":"5078f5f1-197f-48a5-9302-73f23982db6a","Type":"ContainerStarted","Data":"4ec548384a9ba87722aac6fc892c2df4ef66446405ee0e2218078d12b5dec822"} Jul 08 19:14:29.103513 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:29.103109 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" event={"ID":"5078f5f1-197f-48a5-9302-73f23982db6a","Type":"ContainerStarted","Data":"a8f52d7b6fd96907e128621fb85006e718256d47b461a49ba696c1614316428c"} Jul 08 19:14:29.123998 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:29.123935 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" podStartSLOduration=1.918293212 podStartE2EDuration="2.123914387s" totalImagesPullingTime="205.621175ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:14:29.123606018 +0000 UTC m=+937.515752831" watchObservedRunningTime="2026-07-08 19:14:29.123914387 +0000 UTC m=+937.516061176" Jul 08 19:14:38.225493 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:38.225464 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:38.226101 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:38.225524 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:38.233270 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:38.233247 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:14:39.170913 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:14:39.170884 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-flsmn" Jul 08 19:21:22.051184 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:22.051102 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8"] Jul 08 19:21:22.051701 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:22.051394 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" podUID="5c12eeaf-f792-4b2b-9726-3024944a5bd4" containerName="manager" containerID="cri-o://83f747801bb319c87f3eb525f9d8392497a5a16746fb9d0e383c6ec06fd4b029" gracePeriod=10 Jul 08 19:21:25.809088 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:25.809059 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" Jul 08 19:21:25.925616 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:25.925522 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk5xj\" (UniqueName: \"kubernetes.io/projected/5c12eeaf-f792-4b2b-9726-3024944a5bd4-kube-api-access-vk5xj\") pod \"5c12eeaf-f792-4b2b-9726-3024944a5bd4\" (UID: \"5c12eeaf-f792-4b2b-9726-3024944a5bd4\") " Jul 08 19:21:25.925616 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:25.925600 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c12eeaf-f792-4b2b-9726-3024944a5bd4-extensions-socket-volume\") pod \"5c12eeaf-f792-4b2b-9726-3024944a5bd4\" (UID: \"5c12eeaf-f792-4b2b-9726-3024944a5bd4\") " Jul 08 19:21:25.925983 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:25.925955 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c12eeaf-f792-4b2b-9726-3024944a5bd4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5c12eeaf-f792-4b2b-9726-3024944a5bd4" (UID: "5c12eeaf-f792-4b2b-9726-3024944a5bd4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:21:25.927764 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:25.927730 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c12eeaf-f792-4b2b-9726-3024944a5bd4-kube-api-access-vk5xj" (OuterVolumeSpecName: "kube-api-access-vk5xj") pod "5c12eeaf-f792-4b2b-9726-3024944a5bd4" (UID: "5c12eeaf-f792-4b2b-9726-3024944a5bd4"). InnerVolumeSpecName "kube-api-access-vk5xj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:21:26.026730 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:26.026695 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk5xj\" (UniqueName: \"kubernetes.io/projected/5c12eeaf-f792-4b2b-9726-3024944a5bd4-kube-api-access-vk5xj\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:21:26.026730 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:26.026724 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c12eeaf-f792-4b2b-9726-3024944a5bd4-extensions-socket-volume\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:21:26.223184 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:26.223154 2574 generic.go:356] "Generic (PLEG): container finished" podID="5c12eeaf-f792-4b2b-9726-3024944a5bd4" containerID="83f747801bb319c87f3eb525f9d8392497a5a16746fb9d0e383c6ec06fd4b029" exitCode=0 Jul 08 19:21:26.223392 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:26.223286 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" Jul 08 19:21:26.224515 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:26.224495 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" event={"ID":"5c12eeaf-f792-4b2b-9726-3024944a5bd4","Type":"ContainerDied","Data":"83f747801bb319c87f3eb525f9d8392497a5a16746fb9d0e383c6ec06fd4b029"} Jul 08 19:21:26.224613 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:26.224534 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8" event={"ID":"5c12eeaf-f792-4b2b-9726-3024944a5bd4","Type":"ContainerDied","Data":"fcc1f927fabfc32558c3c9178fc8f492a5076ef3de05bec456b728312164f222"} Jul 08 19:21:26.224613 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:26.224557 2574 scope.go:117] "RemoveContainer" containerID="83f747801bb319c87f3eb525f9d8392497a5a16746fb9d0e383c6ec06fd4b029" Jul 08 19:21:26.234648 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:26.234629 2574 scope.go:117] "RemoveContainer" containerID="83f747801bb319c87f3eb525f9d8392497a5a16746fb9d0e383c6ec06fd4b029" Jul 08 19:21:26.234959 ip-10-0-142-189 kubenswrapper[2574]: E0708 19:21:26.234931 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83f747801bb319c87f3eb525f9d8392497a5a16746fb9d0e383c6ec06fd4b029\": container with ID starting with 83f747801bb319c87f3eb525f9d8392497a5a16746fb9d0e383c6ec06fd4b029 not found: ID does not exist" containerID="83f747801bb319c87f3eb525f9d8392497a5a16746fb9d0e383c6ec06fd4b029" Jul 08 19:21:26.235073 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:26.234969 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83f747801bb319c87f3eb525f9d8392497a5a16746fb9d0e383c6ec06fd4b029"} err="failed to get container status \"83f747801bb319c87f3eb525f9d8392497a5a16746fb9d0e383c6ec06fd4b029\": rpc error: code = NotFound desc = could not find container \"83f747801bb319c87f3eb525f9d8392497a5a16746fb9d0e383c6ec06fd4b029\": container with ID starting with 83f747801bb319c87f3eb525f9d8392497a5a16746fb9d0e383c6ec06fd4b029 not found: ID does not exist" Jul 08 19:21:26.252574 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:26.252543 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8"] Jul 08 19:21:26.261564 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:26.261531 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kh9g8"] Jul 08 19:21:28.225390 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:21:28.225357 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c12eeaf-f792-4b2b-9726-3024944a5bd4" path="/var/lib/kubelet/pods/5c12eeaf-f792-4b2b-9726-3024944a5bd4/volumes" Jul 08 19:22:23.262810 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.262769 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw"] Jul 08 19:22:23.263297 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.263224 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c12eeaf-f792-4b2b-9726-3024944a5bd4" containerName="manager" Jul 08 19:22:23.263297 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.263236 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c12eeaf-f792-4b2b-9726-3024944a5bd4" containerName="manager" Jul 08 19:22:23.263297 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.263292 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c12eeaf-f792-4b2b-9726-3024944a5bd4" containerName="manager" Jul 08 19:22:23.266233 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.266214 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw" Jul 08 19:22:23.269917 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.269899 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-szlr2\"" Jul 08 19:22:23.287370 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.287321 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw"] Jul 08 19:22:23.364489 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.364443 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e14774ee-deb1-4da9-a513-90dd45f9cf1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wcfvw\" (UID: \"e14774ee-deb1-4da9-a513-90dd45f9cf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw" Jul 08 19:22:23.364675 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.364510 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f89n\" (UniqueName: \"kubernetes.io/projected/e14774ee-deb1-4da9-a513-90dd45f9cf1b-kube-api-access-2f89n\") pod \"kuadrant-operator-controller-manager-86878c769f-wcfvw\" (UID: \"e14774ee-deb1-4da9-a513-90dd45f9cf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw" Jul 08 19:22:23.466026 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.465981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e14774ee-deb1-4da9-a513-90dd45f9cf1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wcfvw\" (UID: \"e14774ee-deb1-4da9-a513-90dd45f9cf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw" Jul 08 19:22:23.466173 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.466025 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f89n\" (UniqueName: \"kubernetes.io/projected/e14774ee-deb1-4da9-a513-90dd45f9cf1b-kube-api-access-2f89n\") pod \"kuadrant-operator-controller-manager-86878c769f-wcfvw\" (UID: \"e14774ee-deb1-4da9-a513-90dd45f9cf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw" Jul 08 19:22:23.466404 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.466375 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e14774ee-deb1-4da9-a513-90dd45f9cf1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wcfvw\" (UID: \"e14774ee-deb1-4da9-a513-90dd45f9cf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw" Jul 08 19:22:23.478818 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.478791 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f89n\" (UniqueName: \"kubernetes.io/projected/e14774ee-deb1-4da9-a513-90dd45f9cf1b-kube-api-access-2f89n\") pod \"kuadrant-operator-controller-manager-86878c769f-wcfvw\" (UID: \"e14774ee-deb1-4da9-a513-90dd45f9cf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw" Jul 08 19:22:23.576405 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.576297 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw" Jul 08 19:22:23.728944 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:23.728919 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw"] Jul 08 19:22:23.731970 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:22:23.731936 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14774ee_deb1_4da9_a513_90dd45f9cf1b.slice/crio-c0a7ac9e8ad74d8b312922ade4531a81a1598e4bc05830090270da6b201f3ebd WatchSource:0}: Error finding container c0a7ac9e8ad74d8b312922ade4531a81a1598e4bc05830090270da6b201f3ebd: Status 404 returned error can't find the container with id c0a7ac9e8ad74d8b312922ade4531a81a1598e4bc05830090270da6b201f3ebd Jul 08 19:22:24.512544 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:24.512499 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw" event={"ID":"e14774ee-deb1-4da9-a513-90dd45f9cf1b","Type":"ContainerStarted","Data":"0bbbbcf20a7524a7d9c63bba77958a6b09368d2178905fa95744bd988fa64dad"} Jul 08 19:22:24.512936 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:24.512564 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw" event={"ID":"e14774ee-deb1-4da9-a513-90dd45f9cf1b","Type":"ContainerStarted","Data":"c0a7ac9e8ad74d8b312922ade4531a81a1598e4bc05830090270da6b201f3ebd"} Jul 08 19:22:24.512936 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:24.512650 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw" Jul 08 19:22:24.567240 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:24.567183 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw" podStartSLOduration=1.567163823 podStartE2EDuration="1.567163823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:22:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:22:24.563294378 +0000 UTC m=+1412.955441166" watchObservedRunningTime="2026-07-08 19:22:24.567163823 +0000 UTC m=+1412.959310610" Jul 08 19:22:35.520129 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:22:35.520100 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wcfvw" Jul 08 19:35:17.401297 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.401201 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk"] Jul 08 19:35:17.405100 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.405076 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.408482 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.408454 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fb0a08\"/\"test-model-fb0a08-kserve-self-signed-certs\"" Jul 08 19:35:17.408628 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.408454 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fb0a08\"/\"default-dockercfg-fgqsk\"" Jul 08 19:35:17.408628 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.408456 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fb0a08\"/\"kube-root-ca.crt\"" Jul 08 19:35:17.408628 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.408456 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fb0a08\"/\"openshift-service-ca.crt\"" Jul 08 19:35:17.415506 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.415482 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk"] Jul 08 19:35:17.476028 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.475993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-tmp-dir\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.476213 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.476037 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-model-cache\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.476213 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.476129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-home\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.476213 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.476160 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-dshm\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.476411 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.476241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf5xd\" (UniqueName: \"kubernetes.io/projected/c499d542-d4ed-47ee-a98c-bc9bc39109d6-kube-api-access-mf5xd\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.476411 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.476306 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c499d542-d4ed-47ee-a98c-bc9bc39109d6-tls-certs\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.577021 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.576984 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-dshm\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.577228 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.577042 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf5xd\" (UniqueName: \"kubernetes.io/projected/c499d542-d4ed-47ee-a98c-bc9bc39109d6-kube-api-access-mf5xd\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.577228 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.577092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c499d542-d4ed-47ee-a98c-bc9bc39109d6-tls-certs\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.577228 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.577142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-tmp-dir\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.577228 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.577175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-model-cache\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.577228 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.577227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-home\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.577613 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.577590 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-tmp-dir\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.577671 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.577617 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-home\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.577671 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.577653 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-model-cache\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.579469 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.579439 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-dshm\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.579766 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.579745 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c499d542-d4ed-47ee-a98c-bc9bc39109d6-tls-certs\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.585437 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.585413 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf5xd\" (UniqueName: \"kubernetes.io/projected/c499d542-d4ed-47ee-a98c-bc9bc39109d6-kube-api-access-mf5xd\") pod \"test-model-fb0a08-kserve-6457fb58bc-ntnfk\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.715407 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.715307 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:17.857279 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:17.857099 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk"] Jul 08 19:35:17.860357 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:35:17.860299 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc499d542_d4ed_47ee_a98c_bc9bc39109d6.slice/crio-707453efbefc2c4852d54b24ecd82c4139c09e7e076c14242ca67ac18cee5b75 WatchSource:0}: Error finding container 707453efbefc2c4852d54b24ecd82c4139c09e7e076c14242ca67ac18cee5b75: Status 404 returned error can't find the container with id 707453efbefc2c4852d54b24ecd82c4139c09e7e076c14242ca67ac18cee5b75 Jul 08 19:35:18.473856 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:18.473816 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" event={"ID":"c499d542-d4ed-47ee-a98c-bc9bc39109d6","Type":"ContainerStarted","Data":"daa728fbb42ce71401d497e820bdcdd0cb11876d9ba459cbf389ba9a57550619"} Jul 08 19:35:18.474260 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:18.473868 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" event={"ID":"c499d542-d4ed-47ee-a98c-bc9bc39109d6","Type":"ContainerStarted","Data":"707453efbefc2c4852d54b24ecd82c4139c09e7e076c14242ca67ac18cee5b75"} Jul 08 19:35:18.520314 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:18.520258 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" podStartSLOduration=1.520243097 podStartE2EDuration="1.520243097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:18.517866692 +0000 UTC m=+2186.910013479" watchObservedRunningTime="2026-07-08 19:35:18.520243097 +0000 UTC m=+2186.912389885" Jul 08 19:35:27.716478 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:27.716439 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:27.716884 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:27.716705 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:27.729232 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:27.729204 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:28.541218 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:28.541184 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:36.378731 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:36.378701 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk"] Jul 08 19:35:51.399614 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.399571 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" podUID="c499d542-d4ed-47ee-a98c-bc9bc39109d6" containerName="main" containerID="cri-o://daa728fbb42ce71401d497e820bdcdd0cb11876d9ba459cbf389ba9a57550619" gracePeriod=45 Jul 08 19:35:51.648540 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.648509 2574 generic.go:356] "Generic (PLEG): container finished" podID="c499d542-d4ed-47ee-a98c-bc9bc39109d6" containerID="daa728fbb42ce71401d497e820bdcdd0cb11876d9ba459cbf389ba9a57550619" exitCode=0 Jul 08 19:35:51.648660 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.648582 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" event={"ID":"c499d542-d4ed-47ee-a98c-bc9bc39109d6","Type":"ContainerDied","Data":"daa728fbb42ce71401d497e820bdcdd0cb11876d9ba459cbf389ba9a57550619"} Jul 08 19:35:51.648660 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.648637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" event={"ID":"c499d542-d4ed-47ee-a98c-bc9bc39109d6","Type":"ContainerDied","Data":"707453efbefc2c4852d54b24ecd82c4139c09e7e076c14242ca67ac18cee5b75"} Jul 08 19:35:51.648660 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.648655 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="707453efbefc2c4852d54b24ecd82c4139c09e7e076c14242ca67ac18cee5b75" Jul 08 19:35:51.663366 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.663297 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:51.693923 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.693893 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-tmp-dir\") pod \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " Jul 08 19:35:51.694103 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.693936 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-dshm\") pod \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " Jul 08 19:35:51.694103 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.693955 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c499d542-d4ed-47ee-a98c-bc9bc39109d6-tls-certs\") pod \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " Jul 08 19:35:51.694103 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.693982 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-model-cache\") pod \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " Jul 08 19:35:51.694103 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.694018 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-home\") pod \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " Jul 08 19:35:51.694318 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.694165 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf5xd\" (UniqueName: \"kubernetes.io/projected/c499d542-d4ed-47ee-a98c-bc9bc39109d6-kube-api-access-mf5xd\") pod \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\" (UID: \"c499d542-d4ed-47ee-a98c-bc9bc39109d6\") " Jul 08 19:35:51.694318 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.694224 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-home" (OuterVolumeSpecName: "home") pod "c499d542-d4ed-47ee-a98c-bc9bc39109d6" (UID: "c499d542-d4ed-47ee-a98c-bc9bc39109d6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:35:51.694318 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.694239 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c499d542-d4ed-47ee-a98c-bc9bc39109d6" (UID: "c499d542-d4ed-47ee-a98c-bc9bc39109d6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:35:51.694853 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.694255 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-model-cache" (OuterVolumeSpecName: "model-cache") pod "c499d542-d4ed-47ee-a98c-bc9bc39109d6" (UID: "c499d542-d4ed-47ee-a98c-bc9bc39109d6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:35:51.700824 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.695322 2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-home\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:35:51.700824 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.695377 2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-tmp-dir\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:35:51.702534 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.701536 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c499d542-d4ed-47ee-a98c-bc9bc39109d6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c499d542-d4ed-47ee-a98c-bc9bc39109d6" (UID: "c499d542-d4ed-47ee-a98c-bc9bc39109d6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:35:51.702651 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.702585 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c499d542-d4ed-47ee-a98c-bc9bc39109d6-kube-api-access-mf5xd" (OuterVolumeSpecName: "kube-api-access-mf5xd") pod "c499d542-d4ed-47ee-a98c-bc9bc39109d6" (UID: "c499d542-d4ed-47ee-a98c-bc9bc39109d6"). InnerVolumeSpecName "kube-api-access-mf5xd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:35:51.702845 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.702818 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-dshm" (OuterVolumeSpecName: "dshm") pod "c499d542-d4ed-47ee-a98c-bc9bc39109d6" (UID: "c499d542-d4ed-47ee-a98c-bc9bc39109d6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:35:51.796542 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.796509 2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-dshm\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:35:51.796542 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.796535 2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c499d542-d4ed-47ee-a98c-bc9bc39109d6-tls-certs\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:35:51.796542 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.796545 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c499d542-d4ed-47ee-a98c-bc9bc39109d6-model-cache\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:35:51.796542 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:51.796555 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf5xd\" (UniqueName: \"kubernetes.io/projected/c499d542-d4ed-47ee-a98c-bc9bc39109d6-kube-api-access-mf5xd\") on node \"ip-10-0-142-189.ec2.internal\" DevicePath \"\"" Jul 08 19:35:52.654628 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:52.654526 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk" Jul 08 19:35:52.672133 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:52.672104 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk"] Jul 08 19:35:52.675408 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:52.675381 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-fb0a08/test-model-fb0a08-kserve-6457fb58bc-ntnfk"] Jul 08 19:35:54.224933 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:35:54.224893 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c499d542-d4ed-47ee-a98c-bc9bc39109d6" path="/var/lib/kubelet/pods/c499d542-d4ed-47ee-a98c-bc9bc39109d6/volumes" Jul 08 19:40:46.474215 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:40:46.474124 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7jrtd_d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea/manager/0.log" Jul 08 19:40:46.590886 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:40:46.590859 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8x6jl_3d359a37-063a-4748-991f-3a69c35126c5/manager/0.log" Jul 08 19:40:47.337639 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:40:47.337610 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd7775959-vrnjk_5c835a57-8183-4579-9a7e-b202a05dcfe0/copy-manifests/0.log" Jul 08 19:40:47.344517 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:40:47.344493 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd7775959-vrnjk_5c835a57-8183-4579-9a7e-b202a05dcfe0/manager/0.log" Jul 08 19:40:48.773815 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:40:48.773784 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ltbpm_461fed93-b544-40cd-bea0-13fe57bfcb38/manager/0.log" Jul 08 19:40:49.114647 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:40:49.114571 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vt2nm_8cf60436-871a-40a9-943a-89b55e12efd1/registry-server/0.log" Jul 08 19:40:49.243459 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:40:49.243426 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wcfvw_e14774ee-deb1-4da9-a513-90dd45f9cf1b/manager/0.log" Jul 08 19:40:49.469756 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:40:49.469677 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-clwjt_25a36e38-422e-4b81-9841-99fa6e02669b/manager/0.log" Jul 08 19:40:51.235300 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:40:51.235268 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-zv275_0c7d896f-ac4f-41d6-ae81-5d26b00a8a95/main/0.log" Jul 08 19:40:51.467355 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:40:51.467303 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-flsmn_5078f5f1-197f-48a5-9302-73f23982db6a/main/0.log" Jul 08 19:40:59.121405 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:40:59.121378 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7jmds_c425d240-601b-44d7-8185-7b4e5f80b9be/global-pull-secret-syncer/0.log" Jul 08 19:40:59.322493 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:40:59.322464 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xg5dz_8db410ea-9a2a-4463-a5f6-dfb2c25515e6/konnectivity-agent/0.log" Jul 08 19:40:59.376511 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:40:59.376431 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-189.ec2.internal_8179e64f56bafcea70993a6654313ec4/haproxy/0.log" Jul 08 19:41:04.201451 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:04.201423 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ltbpm_461fed93-b544-40cd-bea0-13fe57bfcb38/manager/0.log" Jul 08 19:41:04.313316 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:04.313279 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vt2nm_8cf60436-871a-40a9-943a-89b55e12efd1/registry-server/0.log" Jul 08 19:41:04.408007 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:04.407923 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wcfvw_e14774ee-deb1-4da9-a513-90dd45f9cf1b/manager/0.log" Jul 08 19:41:04.510102 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:04.510065 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-clwjt_25a36e38-422e-4b81-9841-99fa6e02669b/manager/0.log" Jul 08 19:41:06.117444 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.117412 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_326e5237-8973-48d9-9ad3-5a7aab78f994/alertmanager/0.log" Jul 08 19:41:06.138932 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.138908 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_326e5237-8973-48d9-9ad3-5a7aab78f994/config-reloader/0.log" Jul 08 19:41:06.179728 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.179654 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_326e5237-8973-48d9-9ad3-5a7aab78f994/kube-rbac-proxy-web/0.log" Jul 08 19:41:06.201216 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.201189 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_326e5237-8973-48d9-9ad3-5a7aab78f994/kube-rbac-proxy/0.log" Jul 08 19:41:06.223234 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.223210 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_326e5237-8973-48d9-9ad3-5a7aab78f994/kube-rbac-proxy-metric/0.log" Jul 08 19:41:06.245755 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.245727 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_326e5237-8973-48d9-9ad3-5a7aab78f994/prom-label-proxy/0.log" Jul 08 19:41:06.274381 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.274351 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_326e5237-8973-48d9-9ad3-5a7aab78f994/init-config-reloader/0.log" Jul 08 19:41:06.354741 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.354711 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-b9cqf_578fa707-8fdd-4bc2-81ae-e64e60d6dfe3/kube-state-metrics/0.log" Jul 08 19:41:06.393725 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.393697 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-b9cqf_578fa707-8fdd-4bc2-81ae-e64e60d6dfe3/kube-rbac-proxy-main/0.log" Jul 08 19:41:06.450380 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.450278 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-b9cqf_578fa707-8fdd-4bc2-81ae-e64e60d6dfe3/kube-rbac-proxy-self/0.log" Jul 08 19:41:06.532733 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.532705 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-55b4797f49-nmvbf_7b0ad615-5c96-4b10-9d86-9c50ce582b06/metrics-server/0.log" Jul 08 19:41:06.708161 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.708068 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-942n2_f8ed8e70-095c-4c79-b114-32d5de5f24b1/node-exporter/0.log" Jul 08 19:41:06.728563 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.728540 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-942n2_f8ed8e70-095c-4c79-b114-32d5de5f24b1/kube-rbac-proxy/0.log" Jul 08 19:41:06.751881 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.751857 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-942n2_f8ed8e70-095c-4c79-b114-32d5de5f24b1/init-textfile/0.log" Jul 08 19:41:06.876145 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.876117 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-45jh7_48fe2128-ab3d-419d-bb99-cf48834612a7/kube-rbac-proxy-main/0.log" Jul 08 19:41:06.899767 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.899728 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-45jh7_48fe2128-ab3d-419d-bb99-cf48834612a7/kube-rbac-proxy-self/0.log" Jul 08 19:41:06.922875 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.922842 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-45jh7_48fe2128-ab3d-419d-bb99-cf48834612a7/openshift-state-metrics/0.log" Jul 08 19:41:06.965805 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.965729 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f74b3ca-31c7-4750-ad77-50f984a1ba14/prometheus/0.log" Jul 08 19:41:06.990732 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:06.990704 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f74b3ca-31c7-4750-ad77-50f984a1ba14/config-reloader/0.log" Jul 08 19:41:07.014764 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:07.014739 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f74b3ca-31c7-4750-ad77-50f984a1ba14/thanos-sidecar/0.log" Jul 08 19:41:07.040485 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:07.040456 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f74b3ca-31c7-4750-ad77-50f984a1ba14/kube-rbac-proxy-web/0.log" Jul 08 19:41:07.061738 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:07.061714 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f74b3ca-31c7-4750-ad77-50f984a1ba14/kube-rbac-proxy/0.log" Jul 08 19:41:07.085972 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:07.085945 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f74b3ca-31c7-4750-ad77-50f984a1ba14/kube-rbac-proxy-thanos/0.log" Jul 08 19:41:07.108803 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:07.108781 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f74b3ca-31c7-4750-ad77-50f984a1ba14/init-config-reloader/0.log" Jul 08 19:41:07.195607 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:07.195580 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-dzs6t_2872402b-914a-49c6-83f4-a7945ba3ca7c/prometheus-operator-admission-webhook/0.log" Jul 08 19:41:07.225146 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:07.225120 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69978c7fd6-zvcpg_609935c0-68c3-49e5-ad61-f25a2dcdd308/telemeter-client/0.log" Jul 08 19:41:07.248911 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:07.248887 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69978c7fd6-zvcpg_609935c0-68c3-49e5-ad61-f25a2dcdd308/reload/0.log" Jul 08 19:41:07.269684 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:07.269654 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69978c7fd6-zvcpg_609935c0-68c3-49e5-ad61-f25a2dcdd308/kube-rbac-proxy/0.log" Jul 08 19:41:08.591480 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:08.591444 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-qxslq_ca5a01cc-2e9b-485f-b5d3-b52f5c76a9c7/networking-console-plugin/0.log" Jul 08 19:41:09.338386 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.338348 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s"] Jul 08 19:41:09.338854 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.338830 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c499d542-d4ed-47ee-a98c-bc9bc39109d6" containerName="main" Jul 08 19:41:09.339004 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.338911 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c499d542-d4ed-47ee-a98c-bc9bc39109d6" containerName="main" Jul 08 19:41:09.339082 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.339056 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c499d542-d4ed-47ee-a98c-bc9bc39109d6" containerName="main" Jul 08 19:41:09.342565 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.342542 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.345796 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.345773 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7j27\"/\"kube-root-ca.crt\"" Jul 08 19:41:09.346404 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.346383 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7j27\"/\"openshift-service-ca.crt\"" Jul 08 19:41:09.346768 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.346751 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c7j27\"/\"default-dockercfg-z67fq\"" Jul 08 19:41:09.354249 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.354222 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s"] Jul 08 19:41:09.441205 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.441162 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-lib-modules\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.441205 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.441211 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-proc\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.441469 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.441257 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-sys\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.441469 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.441289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttqrh\" (UniqueName: \"kubernetes.io/projected/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-kube-api-access-ttqrh\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.441469 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.441308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-podres\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.542562 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.542530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttqrh\" (UniqueName: \"kubernetes.io/projected/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-kube-api-access-ttqrh\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.542562 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.542564 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-podres\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.542832 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.542616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-lib-modules\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.542832 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.542642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-proc\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.542832 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.542669 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-sys\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.542832 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.542754 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-sys\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.542832 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.542759 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-proc\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.542832 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.542801 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-podres\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.543065 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.542802 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-lib-modules\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.552358 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.552313 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttqrh\" (UniqueName: \"kubernetes.io/projected/3f9fce89-d539-46ad-ab4d-dac6ca5a486d-kube-api-access-ttqrh\") pod \"perf-node-gather-daemonset-r9z4s\" (UID: \"3f9fce89-d539-46ad-ab4d-dac6ca5a486d\") " pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.654052 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.653947 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:09.794824 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.794797 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s"] Jul 08 19:41:09.796993 ip-10-0-142-189 kubenswrapper[2574]: W0708 19:41:09.796960 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3f9fce89_d539_46ad_ab4d_dac6ca5a486d.slice/crio-f6527d6a34ef422752afc788c30b866cf6485d661651ec7518a2b9f197dee963 WatchSource:0}: Error finding container f6527d6a34ef422752afc788c30b866cf6485d661651ec7518a2b9f197dee963: Status 404 returned error can't find the container with id f6527d6a34ef422752afc788c30b866cf6485d661651ec7518a2b9f197dee963 Jul 08 19:41:09.901550 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:09.901519 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-qv8f9_a9d1bd10-8b64-42ae-b83b-25a35131743b/download-server/0.log" Jul 08 19:41:10.273734 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:10.273701 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" event={"ID":"3f9fce89-d539-46ad-ab4d-dac6ca5a486d","Type":"ContainerStarted","Data":"1bf33df0957765066a8bfecbc851716672a5cec19dbfb86f3d91dbb3d1792102"} Jul 08 19:41:10.273937 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:10.273763 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" event={"ID":"3f9fce89-d539-46ad-ab4d-dac6ca5a486d","Type":"ContainerStarted","Data":"f6527d6a34ef422752afc788c30b866cf6485d661651ec7518a2b9f197dee963"} Jul 08 19:41:10.273937 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:10.273788 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:10.292443 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:10.292389 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" podStartSLOduration=1.292370853 podStartE2EDuration="1.292370853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:41:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:41:10.290810983 +0000 UTC m=+2538.682957771" watchObservedRunningTime="2026-07-08 19:41:10.292370853 +0000 UTC m=+2538.684517640" Jul 08 19:41:10.485706 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:10.485675 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-sgj7j_2d4361c7-b563-433e-abe9-e88ccd5d2cda/volume-data-source-validator/0.log" Jul 08 19:41:11.599438 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:11.599405 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v5gbg_f24b0dfb-3ed3-4236-ba0e-587f52eb5267/dns/0.log" Jul 08 19:41:11.625064 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:11.625027 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v5gbg_f24b0dfb-3ed3-4236-ba0e-587f52eb5267/kube-rbac-proxy/0.log" Jul 08 19:41:11.757193 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:11.757163 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s9c56_bf533b5c-6379-40d6-bd6d-1cf429b2ef2e/dns-node-resolver/0.log" Jul 08 19:41:12.345483 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:12.345444 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p7px9_fa3a6023-79bf-4124-91a9-68653cd84334/node-ca/0.log" Jul 08 19:41:14.297904 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:14.297877 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-thtdt_6040d8e3-4ec5-4988-8f52-2df87ad31a3e/serve-healthcheck-canary/0.log" Jul 08 19:41:14.748571 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:14.748515 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-9xbz2_7341c637-b13e-4a5f-b7e5-2701bf8337a4/insights-operator/0.log" Jul 08 19:41:14.749244 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:14.749225 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-9xbz2_7341c637-b13e-4a5f-b7e5-2701bf8337a4/insights-operator/1.log" Jul 08 19:41:14.876952 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:14.876921 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfd56_fd1cc41f-157d-4890-adda-df6d4341f8bb/kube-rbac-proxy/0.log" Jul 08 19:41:14.897455 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:14.897428 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfd56_fd1cc41f-157d-4890-adda-df6d4341f8bb/exporter/0.log" Jul 08 19:41:14.919027 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:14.919004 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfd56_fd1cc41f-157d-4890-adda-df6d4341f8bb/extractor/0.log" Jul 08 19:41:16.289460 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:16.289434 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c7j27/perf-node-gather-daemonset-r9z4s" Jul 08 19:41:17.098144 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:17.098106 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7jrtd_d88327e6-c93a-4df0-bbdc-5c0de3b4a4ea/manager/0.log" Jul 08 19:41:17.211218 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:17.211180 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8x6jl_3d359a37-063a-4748-991f-3a69c35126c5/manager/0.log" Jul 08 19:41:17.638039 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:17.637994 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd7775959-vrnjk_5c835a57-8183-4579-9a7e-b202a05dcfe0/manager/0.log" Jul 08 19:41:17.659182 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:17.659155 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd7775959-vrnjk_5c835a57-8183-4579-9a7e-b202a05dcfe0/copy-manifests/0.log" Jul 08 19:41:19.085144 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:19.085102 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5bfc697457-hsl8b_92fc1942-7c34-4189-b164-3b9681418430/manager/0.log" Jul 08 19:41:24.134313 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:24.134283 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-4zzss_c1e48217-767d-4b12-9195-bff1573993d6/migrator/0.log" Jul 08 19:41:24.154726 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:24.154694 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-4zzss_c1e48217-767d-4b12-9195-bff1573993d6/graceful-termination/0.log" Jul 08 19:41:25.812900 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:25.812873 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jggch_14160c19-e852-417e-beee-1bd3f869f339/kube-multus-additional-cni-plugins/0.log" Jul 08 19:41:25.836604 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:25.836528 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jggch_14160c19-e852-417e-beee-1bd3f869f339/egress-router-binary-copy/0.log" Jul 08 19:41:25.862501 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:25.862468 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jggch_14160c19-e852-417e-beee-1bd3f869f339/cni-plugins/0.log" Jul 08 19:41:25.883695 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:25.883671 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jggch_14160c19-e852-417e-beee-1bd3f869f339/bond-cni-plugin/0.log" Jul 08 19:41:25.905968 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:25.905935 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jggch_14160c19-e852-417e-beee-1bd3f869f339/routeoverride-cni/0.log" Jul 08 19:41:25.926409 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:25.926378 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jggch_14160c19-e852-417e-beee-1bd3f869f339/whereabouts-cni-bincopy/0.log" Jul 08 19:41:25.953084 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:25.953058 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jggch_14160c19-e852-417e-beee-1bd3f869f339/whereabouts-cni/0.log" Jul 08 19:41:26.023808 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:26.023776 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zbbm7_feb81d8c-4f54-436a-9b05-094323099754/kube-multus/0.log" Jul 08 19:41:26.125210 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:26.125127 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k4pww_9c146ab4-0d07-4951-9d48-bfff5ab7acef/network-metrics-daemon/0.log" Jul 08 19:41:26.147266 ip-10-0-142-189 kubenswrapper[2574]: I0708 19:41:26.147241 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k4pww_9c146ab4-0d07-4951-9d48-bfff5ab7acef/kube-rbac-proxy/0.log"