Jul 20 09:55:16.620074 ip-10-0-128-168 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 20 09:55:16.620083 ip-10-0-128-168 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 20 09:55:16.620090 ip-10-0-128-168 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 20 09:55:16.620295 ip-10-0-128-168 systemd[1]: Failed to start Kubernetes Kubelet. Jul 20 09:55:26.305273 ip-10-0-128-168 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 20 09:55:26.305287 ip-10-0-128-168 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 416fea5439844de5bcda4900b9cc0425 -- Jul 20 09:57:13.316958 ip-10-0-128-168 systemd[1]: Starting Kubernetes Kubelet... Jul 20 09:57:13.738415 ip-10-0-128-168 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 09:57:13.738415 ip-10-0-128-168 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 09:57:13.738415 ip-10-0-128-168 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 09:57:13.738415 ip-10-0-128-168 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 09:57:13.738415 ip-10-0-128-168 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 09:57:13.741367 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.741253 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 09:57:13.746059 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746045 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:57:13.746094 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746061 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:57:13.746094 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746065 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:57:13.746094 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746068 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:57:13.746094 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746071 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:57:13.746094 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746074 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:57:13.746094 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746077 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:57:13.746094 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746079 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:57:13.746094 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746082 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:57:13.746094 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746085 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:57:13.746094 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746088 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:57:13.746094 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746090 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:57:13.746094 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746098 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746102 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746104 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746107 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746110 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746112 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746115 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746117 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746120 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746122 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746125 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746127 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746129 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746132 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746134 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746138 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746142 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746145 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746147 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:57:13.746379 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746150 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746152 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746154 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746157 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746159 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746162 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746164 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746167 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746170 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746172 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746175 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746177 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746180 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746183 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746185 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746188 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746192 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746194 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746198 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746200 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:57:13.747047 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746203 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746206 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746208 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746211 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746213 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746216 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746220 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746223 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746226 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746229 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746231 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746234 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746236 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746239 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746241 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746244 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746246 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746249 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746251 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746254 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:57:13.747801 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746257 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746259 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746261 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746264 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746266 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746270 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746272 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746279 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746282 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746285 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746288 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746292 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746294 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746297 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746300 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746303 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746306 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746309 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746311 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:57:13.748285 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746315 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746317 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746320 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746323 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746326 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746328 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746331 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746333 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.746336 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748179 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748189 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748193 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748196 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748199 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748203 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748205 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748209 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748211 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748214 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748216 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:57:13.748750 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748220 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748223 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748225 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748228 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748231 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748233 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748236 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748238 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748241 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748244 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748246 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748249 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748251 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748254 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748256 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748269 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748272 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748274 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748277 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:57:13.749231 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748279 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748283 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748287 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748290 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748293 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748296 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748299 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748302 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748304 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748307 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748310 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748313 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748315 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748319 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748322 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748325 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748328 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748330 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748333 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:57:13.749729 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748335 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748338 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748340 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748343 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748346 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748349 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748353 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748356 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748358 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748361 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748364 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748366 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748369 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748371 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748373 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748376 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748378 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748381 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748383 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748386 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:57:13.750196 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748388 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748391 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748393 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748396 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748398 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748401 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748404 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748407 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748412 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748415 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748418 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748421 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748424 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748426 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748429 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748432 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748434 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748437 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748439 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748442 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:57:13.750697 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748444 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748446 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748449 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748451 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748454 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748457 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748459 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748462 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748464 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748467 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748868 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748874 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748877 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748880 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748883 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748887 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748889 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748892 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748895 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748898 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:57:13.751197 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748901 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748903 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748906 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748909 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748912 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748915 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748918 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748920 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748923 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748926 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748929 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748931 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748933 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748936 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748938 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748941 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748943 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748946 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748948 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748951 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:57:13.751719 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748953 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748956 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748958 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748960 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748963 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748966 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748968 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748971 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748973 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748976 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748979 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748982 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748984 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748987 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748989 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748992 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748994 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.748998 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749001 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:57:13.752208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749005 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749007 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749012 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749015 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749018 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749021 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749024 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749026 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749029 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749031 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749034 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749037 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749041 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749043 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749046 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749048 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749051 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749053 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749055 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:57:13.752678 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749058 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749061 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749063 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749067 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749070 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749072 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749075 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749077 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749080 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749082 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749085 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749087 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749089 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749092 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749095 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749097 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749099 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749102 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749104 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749107 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:57:13.753208 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749110 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749112 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749114 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749117 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749119 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749122 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749124 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749126 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749129 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749131 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749134 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749202 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749209 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749215 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749219 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749223 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749226 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749230 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749234 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749238 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 09:57:13.753705 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749241 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749244 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749247 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749250 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749253 2564 flags.go:64] FLAG: --cgroup-root="" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749256 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749259 2564 flags.go:64] FLAG: --client-ca-file="" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749262 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749265 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749269 2564 flags.go:64] FLAG: --cluster-domain="" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749272 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749275 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749278 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749281 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749284 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749287 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749290 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749294 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749296 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749299 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749302 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749305 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749308 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749312 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 09:57:13.754230 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749317 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749320 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749323 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749326 2564 flags.go:64] FLAG: --enable-server="true" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749330 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749335 2564 flags.go:64] FLAG: --event-burst="100" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749338 2564 flags.go:64] FLAG: --event-qps="50" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749341 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749344 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749346 2564 flags.go:64] FLAG: --eviction-hard="" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749350 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749353 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749356 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749358 2564 flags.go:64] FLAG: --eviction-soft="" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749361 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749364 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749368 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749371 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749373 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749376 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749379 2564 flags.go:64] FLAG: --feature-gates="" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749382 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749385 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749388 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749391 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749394 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 20 09:57:13.754808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749397 2564 flags.go:64] FLAG: --help="false" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749399 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-128-168.ec2.internal" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749403 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749405 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749409 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749412 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749417 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749419 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749422 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749425 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749429 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749432 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749435 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749438 2564 flags.go:64] FLAG: --kube-reserved="" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749441 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749444 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749447 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749449 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749452 2564 flags.go:64] FLAG: --lock-file="" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749455 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749458 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749461 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749466 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 09:57:13.755447 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749469 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749472 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749475 2564 flags.go:64] FLAG: --logging-format="text" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749477 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749480 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749483 2564 flags.go:64] FLAG: --manifest-url="" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749486 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749490 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749493 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749497 2564 flags.go:64] FLAG: --max-pods="110" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749500 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749504 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749506 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749509 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749512 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749517 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749520 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749526 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749529 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749533 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749536 2564 flags.go:64] FLAG: --pod-cidr="" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749539 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749544 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749547 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 09:57:13.756020 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749550 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749553 2564 flags.go:64] FLAG: --port="10250" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749556 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749559 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07fec99e19d7f123b" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749562 2564 flags.go:64] FLAG: --qos-reserved="" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749565 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749568 2564 flags.go:64] FLAG: --register-node="true" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749570 2564 flags.go:64] FLAG: --register-with-taints="" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749574 2564 flags.go:64] FLAG: --registry-burst="10" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749577 2564 flags.go:64] FLAG: --registry-qps="5" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749580 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749583 2564 flags.go:64] FLAG: --reserved-memory="" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749586 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749589 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749592 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749595 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749598 2564 flags.go:64] FLAG: --runonce="false" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749600 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749603 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749606 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749609 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749611 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749614 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749618 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749621 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749624 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 09:57:13.756601 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749627 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749629 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749633 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749637 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749654 2564 flags.go:64] FLAG: --system-cgroups="" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749657 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749662 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749665 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749668 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749672 2564 flags.go:64] FLAG: --tls-min-version="" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749674 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749677 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749680 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749683 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749685 2564 flags.go:64] FLAG: --v="2" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749689 2564 flags.go:64] FLAG: --version="false" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749694 2564 flags.go:64] FLAG: --vmodule="" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749698 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.749701 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749806 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749810 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749813 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749816 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749818 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:57:13.757253 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749821 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749824 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749826 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749829 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749832 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749836 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749839 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749841 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749844 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749847 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749851 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749854 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749857 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749859 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749862 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749865 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749867 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749870 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749872 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749875 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:57:13.757889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749877 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749880 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749883 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749885 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749888 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749891 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749894 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749896 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749898 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749901 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749903 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749906 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749909 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749912 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749914 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749917 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749919 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749925 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749928 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749931 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:57:13.758403 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749934 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749936 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749940 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749943 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749945 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749948 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749950 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749953 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749956 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749958 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749961 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749963 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749966 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749969 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749973 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749976 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749978 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749981 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749984 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:57:13.758889 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749987 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749989 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749991 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749994 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749996 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.749999 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750001 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750004 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750006 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750009 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750012 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750015 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750017 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750020 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750022 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750028 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750031 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750034 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750037 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:57:13.759351 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750040 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750043 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750045 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750048 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750051 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750053 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750056 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750059 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750061 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750064 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750067 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750069 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750072 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750075 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750077 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:57:13.759835 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.750080 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:57:13.760199 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.750088 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 09:57:13.760199 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.757634 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 09:57:13.760199 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.757662 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 09:57:13.760199 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.757686 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 09:57:13.760199 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.757691 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 09:57:13.760199 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757746 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:57:13.760199 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757751 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:57:13.760199 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757755 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:57:13.760199 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757758 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:57:13.760199 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757762 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:57:13.760199 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757765 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:57:13.760199 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757767 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:57:13.760199 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757770 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:57:13.760199 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757773 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757776 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757779 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757782 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757785 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757788 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757791 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757793 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757796 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757798 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757801 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757804 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757807 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757809 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757811 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757814 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757817 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757820 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757823 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:57:13.760547 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757825 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757827 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757831 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757834 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757836 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757839 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757841 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757844 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757848 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757852 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757855 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757857 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757860 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757863 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757865 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757868 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757870 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757873 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757876 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:57:13.761021 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757878 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757881 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757883 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757886 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757888 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757891 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757895 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757898 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757900 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757903 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757906 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757909 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757911 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757914 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757916 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757919 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757922 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757925 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757927 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757930 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:57:13.761475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757934 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757937 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757941 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757944 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757947 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757950 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757953 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757956 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757958 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757961 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757963 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757966 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757968 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757971 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757973 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757976 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757978 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757981 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757984 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757986 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:57:13.761974 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757989 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757991 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757994 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757996 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.757999 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758002 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758004 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758008 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758010 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758013 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758015 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758018 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758020 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.758026 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758149 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:57:13.762452 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758154 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758157 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758161 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758164 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758168 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758172 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758176 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758179 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758182 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758185 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758188 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758191 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758194 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758197 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758200 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758203 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758206 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758208 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758211 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:57:13.762840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758214 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758216 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758219 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758223 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758226 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758228 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758231 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758234 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758236 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758239 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758241 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758244 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758246 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758249 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758252 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758254 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758256 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758259 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758261 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758264 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:57:13.763299 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758266 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758269 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758271 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758274 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758276 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758279 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758281 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758283 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758286 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758288 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758292 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758295 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758297 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758300 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758302 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758305 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758308 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758311 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758313 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:57:13.763797 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758316 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758318 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758321 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758323 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758326 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758328 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758330 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758333 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758335 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758338 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758340 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758343 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758345 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758347 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758350 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758352 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758355 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758357 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758360 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758362 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:57:13.764257 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758365 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758367 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758370 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758372 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758375 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758377 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758380 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758382 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758385 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758387 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758390 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758394 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758397 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758400 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758403 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758406 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758409 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758412 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758414 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:57:13.764840 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:13.758417 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:57:13.765289 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.758421 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 09:57:13.765289 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.758510 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 09:57:13.765289 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.760569 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 09:57:13.765289 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.761854 2564 server.go:1019] "Starting client certificate rotation" Jul 20 09:57:13.765289 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.761950 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 09:57:13.765289 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.761978 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 09:57:13.765289 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.764774 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 09:57:13.765993 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.765981 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 09:57:13.777619 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.777598 2564 log.go:25] "Validated CRI v1 runtime API" Jul 20 09:57:13.779464 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.779448 2564 log.go:25] "Validated CRI v1 image API" Jul 20 09:57:13.780215 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.780200 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 09:57:13.782353 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.782331 2564 fs.go:135] Filesystem UUIDs: map[0b5ec9a2-a7fa-4129-a7b5-bf2b816fdcac:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 96cd1898-d95c-4872-8d4d-ea1f9b9ca522:/dev/nvme0n1p3] Jul 20 09:57:13.782427 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.782352 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 09:57:13.788495 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.788386 2564 manager.go:216] Machine: {Timestamp:2026-07-20 09:57:13.787223747 +0000 UTC m=+0.347422226 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103931 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26279c25c576e0b406abc036aa5f0c SystemUUID:ec26279c-25c5-76e0-b406-abc036aa5f0c BootID:416fea54-3984-4de5-bcda-4900b9cc0425 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a5:04:a0:b2:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a5:04:a0:b2:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:6b:e3:b5:81:d1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 09:57:13.788495 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.788482 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 09:57:13.788677 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.788576 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 09:57:13.791371 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.791348 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 09:57:13.791533 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.791374 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-168.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 09:57:13.792172 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.792160 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 09:57:13.792236 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.792178 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 09:57:13.792236 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.792188 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 09:57:13.792993 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.792980 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 09:57:13.794175 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.794163 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 09:57:13.796474 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.796457 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 09:57:13.798064 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.798051 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 20 09:57:13.798188 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.798177 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 09:57:13.798242 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.798213 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 20 09:57:13.798242 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.798234 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 09:57:13.798329 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.798256 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 09:57:13.798329 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.798269 2564 kubelet.go:398] "Adding apiserver pod source" Jul 20 09:57:13.798329 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.798282 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 09:57:13.798673 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.798654 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 09:57:13.798673 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.798681 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 09:57:13.801046 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.801027 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 09:57:13.803209 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.803191 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 09:57:13.803262 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.803225 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 09:57:13.804325 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.804308 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 09:57:13.804325 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.804328 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 09:57:13.804432 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.804336 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 09:57:13.804432 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.804341 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 09:57:13.804432 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.804349 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 09:57:13.804432 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.804355 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 09:57:13.804432 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.804364 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 09:57:13.804432 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.804372 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 09:57:13.804432 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.804383 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 09:57:13.804432 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.804389 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 09:57:13.804432 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.804404 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 09:57:13.804432 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.804410 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 09:57:13.805127 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.805114 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 09:57:13.805127 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.805127 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 09:57:13.808493 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.808475 2564 server.go:1268] "Started kubelet" Jul 20 09:57:13.808598 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:13.808576 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 09:57:13.808678 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.808599 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-168.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 09:57:13.808678 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.808639 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 09:57:13.808778 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:13.808733 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 09:57:13.808978 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.808801 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 09:57:13.809408 ip-10-0-128-168 systemd[1]: Started Kubernetes Kubelet. Jul 20 09:57:13.809593 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.809442 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 09:57:13.810424 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.810355 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 09:57:13.811311 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.811298 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 20 09:57:13.815103 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:13.815076 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 09:57:13.817260 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:13.816306 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-168.ec2.internal.18c3f6faa91ddbb7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-168.ec2.internal,UID:ip-10-0-128-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-168.ec2.internal,},FirstTimestamp:2026-07-20 09:57:13.808411575 +0000 UTC m=+0.368610057,LastTimestamp:2026-07-20 09:57:13.808411575 +0000 UTC m=+0.368610057,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-168.ec2.internal,}" Jul 20 09:57:13.817909 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.817865 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 09:57:13.817909 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.817879 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 09:57:13.818059 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:13.817970 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jul 20 09:57:13.818390 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.818363 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 09:57:13.818390 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.818371 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 09:57:13.818534 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.818403 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 09:57:13.818534 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.818518 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 20 09:57:13.818534 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.818526 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 20 09:57:13.818843 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.818805 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 09:57:13.818843 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.818823 2564 factory.go:55] Registering systemd factory Jul 20 09:57:13.818843 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.818833 2564 factory.go:223] Registration of the systemd container factory successfully Jul 20 09:57:13.819035 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.819019 2564 factory.go:153] Registering CRI-O factory Jul 20 09:57:13.819076 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.819039 2564 factory.go:223] Registration of the crio container factory successfully Jul 20 09:57:13.819076 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.819063 2564 factory.go:103] Registering Raw factory Jul 20 09:57:13.819138 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.819077 2564 manager.go:1196] Started watching for new ooms in manager Jul 20 09:57:13.819545 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.819532 2564 manager.go:349] Starting recovery of all containers Jul 20 09:57:13.823992 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:13.823967 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 20 09:57:13.824220 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:13.824086 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 20 09:57:13.829972 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.829953 2564 manager.go:354] Recovery completed Jul 20 09:57:13.834973 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.834960 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:13.836564 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.836546 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:13.836662 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.836575 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:13.836662 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.836586 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:13.837134 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.837115 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 09:57:13.837134 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.837119 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:13.837301 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.837132 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 09:57:13.837301 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.837192 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 20 09:57:13.837817 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.837793 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:13.837891 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.837823 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:13.837891 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.837837 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:13.839263 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.839249 2564 policy_none.go:49] "None policy: Start" Jul 20 09:57:13.839263 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.839264 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 09:57:13.839338 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.839274 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 09:57:13.841132 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.841116 2564 policy_none.go:47] "Start" Jul 20 09:57:13.847245 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:13.847082 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-168.ec2.internal.18c3f6faaacb6717 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-168.ec2.internal,UID:ip-10-0-128-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-168.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-168.ec2.internal,},FirstTimestamp:2026-07-20 09:57:13.836562199 +0000 UTC m=+0.396760677,LastTimestamp:2026-07-20 09:57:13.836562199 +0000 UTC m=+0.396760677,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-168.ec2.internal,}" Jul 20 09:57:13.861870 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:13.861807 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-168.ec2.internal.18c3f6faaacbaa63 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-168.ec2.internal,UID:ip-10-0-128-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-168.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-168.ec2.internal,},FirstTimestamp:2026-07-20 09:57:13.836579427 +0000 UTC m=+0.396777905,LastTimestamp:2026-07-20 09:57:13.836579427 +0000 UTC m=+0.396777905,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-168.ec2.internal,}" Jul 20 09:57:13.877503 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:13.877424 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-168.ec2.internal.18c3f6faaacbd1c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-168.ec2.internal,UID:ip-10-0-128-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-168.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-168.ec2.internal,},FirstTimestamp:2026-07-20 09:57:13.836589508 +0000 UTC m=+0.396787986,LastTimestamp:2026-07-20 09:57:13.836589508 +0000 UTC m=+0.396787986,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-168.ec2.internal,}" Jul 20 09:57:13.877783 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.877495 2564 manager.go:337] "Starting Device Plugin manager" Jul 20 09:57:13.877783 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:13.877702 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 09:57:13.877783 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.877719 2564 server.go:87] "Starting device plugin registration server" Jul 20 09:57:13.877976 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.877962 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 09:57:13.878025 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.877979 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 09:57:13.878123 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.878097 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 09:57:13.878196 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.878183 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 09:57:13.878244 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.878196 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 09:57:13.878715 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:13.878693 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 09:57:13.878783 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:13.878748 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-168.ec2.internal\" not found" Jul 20 09:57:13.888316 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:13.888261 2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-168.ec2.internal.18c3f6faaacb6717\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-168.ec2.internal.18c3f6faaacb6717 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-168.ec2.internal,UID:ip-10-0-128-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-168.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-168.ec2.internal,},FirstTimestamp:2026-07-20 09:57:13.836562199 +0000 UTC m=+0.396760677,LastTimestamp:2026-07-20 09:57:13.83780889 +0000 UTC m=+0.398007371,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-168.ec2.internal,}" Jul 20 09:57:13.893676 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.893661 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-42j68" Jul 20 09:57:13.909718 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:13.909698 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-42j68" Jul 20 09:57:15.249661 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.249629 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 09:57:15.250765 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.250751 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 09:57:15.250826 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.250783 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 09:57:15.250826 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.250800 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 09:57:15.250904 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:15.250829 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 09:57:15.253660 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.253643 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:57:15.280798 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.280774 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:15.282466 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.282451 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:15.282523 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.282494 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:15.282523 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.282510 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:15.282600 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.282536 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.293418 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.293382 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.293418 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:15.293401 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-168.ec2.internal\": node \"ip-10-0-128-168.ec2.internal\" not found" Jul 20 09:57:15.310235 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:15.310219 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jul 20 09:57:15.350918 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.350903 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal"] Jul 20 09:57:15.350985 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.350956 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:15.352188 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.352173 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:15.352250 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.352198 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:15.352250 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.352209 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:15.354409 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.354397 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:15.354586 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.354572 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.354647 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.354600 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:15.355055 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.355040 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:15.355112 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.355041 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:15.355112 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.355071 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:15.355112 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.355085 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:15.355200 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.355086 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:15.355200 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.355139 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:15.357194 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.357180 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.357275 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.357202 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:15.357784 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.357771 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:15.357840 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.357792 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:15.357840 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.357805 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:15.381221 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:15.381207 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-168.ec2.internal\" not found" node="ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.385641 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:15.385628 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-168.ec2.internal\" not found" node="ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.410481 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:15.410466 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jul 20 09:57:15.421700 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.421685 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d97e9e3433a54f7fc5fb31270e8cbde7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-168.ec2.internal\" (UID: \"d97e9e3433a54f7fc5fb31270e8cbde7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.421774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.421708 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1238c0aca3f63e014c424e1c2547bff3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal\" (UID: \"1238c0aca3f63e014c424e1c2547bff3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.421774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.421726 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1238c0aca3f63e014c424e1c2547bff3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal\" (UID: \"1238c0aca3f63e014c424e1c2547bff3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.510761 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:15.510736 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jul 20 09:57:15.522311 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.522291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1238c0aca3f63e014c424e1c2547bff3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal\" (UID: \"1238c0aca3f63e014c424e1c2547bff3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.522373 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.522316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d97e9e3433a54f7fc5fb31270e8cbde7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-168.ec2.internal\" (UID: \"d97e9e3433a54f7fc5fb31270e8cbde7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.522373 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.522331 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1238c0aca3f63e014c424e1c2547bff3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal\" (UID: \"1238c0aca3f63e014c424e1c2547bff3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.522373 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.522366 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1238c0aca3f63e014c424e1c2547bff3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal\" (UID: \"1238c0aca3f63e014c424e1c2547bff3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.522481 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.522389 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1238c0aca3f63e014c424e1c2547bff3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal\" (UID: \"1238c0aca3f63e014c424e1c2547bff3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.522481 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.522396 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d97e9e3433a54f7fc5fb31270e8cbde7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-168.ec2.internal\" (UID: \"d97e9e3433a54f7fc5fb31270e8cbde7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.611749 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:15.611731 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jul 20 09:57:15.684210 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.684192 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.689180 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.689009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" Jul 20 09:57:15.712640 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:15.712622 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jul 20 09:57:15.813157 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:15.813121 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jul 20 09:57:15.913631 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:15.913575 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jul 20 09:57:15.998183 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:15.998159 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:57:16.014307 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:16.014287 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jul 20 09:57:16.063699 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.063682 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 09:57:16.064190 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.063786 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 09:57:16.064190 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.063810 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 09:57:16.114793 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:16.114772 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jul 20 09:57:16.215482 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:16.215413 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jul 20 09:57:16.216505 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.216483 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 09:52:15 +0000 UTC" deadline="2028-04-28 17:41:38.6972545 +0000 UTC" Jul 20 09:57:16.216553 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.216507 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15559h44m22.480750975s" Jul 20 09:57:16.273473 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:16.273430 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97e9e3433a54f7fc5fb31270e8cbde7.slice/crio-67ce379745b1e60ed50637103d119da510708ef8f2e25b01f4446a462e58218d WatchSource:0}: Error finding container 67ce379745b1e60ed50637103d119da510708ef8f2e25b01f4446a462e58218d: Status 404 returned error can't find the container with id 67ce379745b1e60ed50637103d119da510708ef8f2e25b01f4446a462e58218d Jul 20 09:57:16.273798 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:16.273777 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1238c0aca3f63e014c424e1c2547bff3.slice/crio-a8c668d52dd7ad24a7a22e3ab6a2e9443d7126efd999bac1951e7337bef95d38 WatchSource:0}: Error finding container a8c668d52dd7ad24a7a22e3ab6a2e9443d7126efd999bac1951e7337bef95d38: Status 404 returned error can't find the container with id a8c668d52dd7ad24a7a22e3ab6a2e9443d7126efd999bac1951e7337bef95d38 Jul 20 09:57:16.277959 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.277942 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 09:57:16.316514 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:16.316482 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jul 20 09:57:16.343911 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.343895 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:16.344877 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.344853 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:16.344944 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.344886 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:16.344944 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.344897 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:16.390709 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.390689 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:57:16.419952 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.419936 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jul 20 09:57:16.423251 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.423236 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:57:16.431203 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.431190 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 09:57:16.432219 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.432207 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" Jul 20 09:57:16.440297 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:16.440282 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 09:57:17.101954 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.101926 2564 apiserver.go:52] "Watching apiserver" Jul 20 09:57:17.110046 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.110021 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 09:57:17.111331 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.111303 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-lrjcf","openshift-network-operator/iptables-alerter-cpdv4","openshift-ovn-kubernetes/ovnkube-node-65jsj","kube-system/global-pull-secret-syncer-lf8fm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj","openshift-cluster-node-tuning-operator/tuned-dnj6m","openshift-dns/node-resolver-656q7","openshift-image-registry/node-ca-vmtp7","openshift-multus/multus-additional-cni-plugins-mtxmk","openshift-multus/network-metrics-daemon-mk7cq","openshift-network-diagnostics/network-check-target-6mxr8","kube-system/konnectivity-agent-jmcfd","kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal"] Jul 20 09:57:17.113920 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.113893 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.116950 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.116255 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 09:57:17.116950 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.116533 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 09:57:17.116950 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.116603 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xhp5n\"" Jul 20 09:57:17.116950 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.116741 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 09:57:17.116950 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.116799 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 09:57:17.117242 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.116989 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cpdv4" Jul 20 09:57:17.118647 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.118628 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 09:57:17.118991 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.118971 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x72sh\"" Jul 20 09:57:17.119117 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.119076 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 09:57:17.119300 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.119283 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.119383 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.119338 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:57:17.119897 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.119867 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 09:57:17.122397 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.122304 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:17.122397 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.122377 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:17.123584 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.123565 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 09:57:17.123679 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.123613 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 09:57:17.123679 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.123655 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 09:57:17.123786 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.123743 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 09:57:17.123786 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.123768 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p4zxh\"" Jul 20 09:57:17.124202 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.123901 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 09:57:17.124202 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.123990 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 09:57:17.125040 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.125020 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.127776 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.126977 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 09:57:17.127776 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.127006 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 09:57:17.127776 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.127252 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k92jd\"" Jul 20 09:57:17.127776 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.127294 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.128132 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.128115 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 09:57:17.130187 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.129550 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 09:57:17.130187 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.129789 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rplxq\"" Jul 20 09:57:17.130187 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.129849 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-656q7" Jul 20 09:57:17.130187 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.129991 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:57:17.132312 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.132312 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-ovnkube-config\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.132312 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132114 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-env-overrides\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.132312 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-system-cni-dir\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.132312 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132174 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-etc-kubernetes\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.132312 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132197 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-run-netns\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.132312 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-etc-openvswitch\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.132312 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132242 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-run-openvswitch\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.132312 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw5gc\" (UniqueName: \"kubernetes.io/projected/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-kube-api-access-rw5gc\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132323 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-kubelet-config\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132354 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-var-lib-cni-bin\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132399 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-multus-conf-dir\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132417 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vmtp7" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132465 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-run-multus-certs\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132492 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lmcr\" (UniqueName: \"kubernetes.io/projected/1aaa469c-5cfc-41b8-b757-c2683a318436-kube-api-access-5lmcr\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132516 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-slash\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132537 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-run-systemd\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132564 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-dbus\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132585 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-multus-socket-dir-parent\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-var-lib-cni-multus\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132635 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e06f763-f83a-4f6f-82c5-35f468e3ee31-host-slash\") pod \"iptables-alerter-cpdv4\" (UID: \"9e06f763-f83a-4f6f-82c5-35f468e3ee31\") " pod="openshift-network-operator/iptables-alerter-cpdv4" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132656 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-systemd-units\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-node-log\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132723 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-log-socket\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.132807 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-run-k8s-cni-cncf-io\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132796 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-cni-netd\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-run-netns\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-hostroot\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1aaa469c-5cfc-41b8-b757-c2683a318436-multus-daemon-config\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-multus-cni-dir\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.132999 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-var-lib-openvswitch\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.133038 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-ovnkube-script-lib\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.133066 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.133104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-os-release\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.133130 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1aaa469c-5cfc-41b8-b757-c2683a318436-cni-binary-copy\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.133151 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-var-lib-kubelet\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.133176 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4dqj\" (UniqueName: \"kubernetes.io/projected/9e06f763-f83a-4f6f-82c5-35f468e3ee31-kube-api-access-h4dqj\") pod \"iptables-alerter-cpdv4\" (UID: \"9e06f763-f83a-4f6f-82c5-35f468e3ee31\") " pod="openshift-network-operator/iptables-alerter-cpdv4" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.133208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-run-ovn\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.133239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-ovn-node-metrics-cert\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.133274 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-cnibin\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.133307 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e06f763-f83a-4f6f-82c5-35f468e3ee31-iptables-alerter-script\") pod \"iptables-alerter-cpdv4\" (UID: \"9e06f763-f83a-4f6f-82c5-35f468e3ee31\") " pod="openshift-network-operator/iptables-alerter-cpdv4" Jul 20 09:57:17.133604 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.133329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-kubelet\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.134392 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.133353 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-cni-bin\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.135345 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.135156 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 09:57:17.135345 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.135203 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.135507 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.135388 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 09:57:17.136090 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.135918 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rdh9m\"" Jul 20 09:57:17.136479 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.136122 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 09:57:17.136479 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.136311 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 09:57:17.136596 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.136568 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 09:57:17.136697 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.136678 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vhplr\"" Jul 20 09:57:17.139169 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.137630 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:17.139169 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.137716 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:17.139169 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.138653 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 09:57:17.139169 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.139019 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 09:57:17.139169 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.139093 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jmtnz\"" Jul 20 09:57:17.140603 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.139298 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 09:57:17.142093 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.142026 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:17.142093 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.142086 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:17.144334 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.144313 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jmcfd" Jul 20 09:57:17.146699 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.146660 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 09:57:17.146995 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.146897 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 09:57:17.147088 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.147042 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5xbxt\"" Jul 20 09:57:17.182041 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.182013 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:57:17.203046 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.203024 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v4gvp" Jul 20 09:57:17.212850 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.212830 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v4gvp" Jul 20 09:57:17.221665 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.221647 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 09:57:17.234312 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234287 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-run-netns\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.234415 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-sys-fs\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.234415 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234354 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nl25\" (UniqueName: \"kubernetes.io/projected/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-kube-api-access-8nl25\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.234415 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-kubelet-config\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:17.234585 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234424 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-run-netns\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.234585 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-multus-conf-dir\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.234585 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234499 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-kubelet-config\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:17.234585 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-run-multus-certs\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.234585 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234547 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-multus-conf-dir\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.234585 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-run-systemd\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.234585 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-log-socket\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.234585 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234586 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-run-multus-certs\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234603 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234623 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-run-systemd\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65e05599-9f05-4924-8d90-d0c4a7a7f4aa-hosts-file\") pod \"node-resolver-656q7\" (UID: \"65e05599-9f05-4924-8d90-d0c4a7a7f4aa\") " pod="openshift-dns/node-resolver-656q7" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-dbus\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e06f763-f83a-4f6f-82c5-35f468e3ee31-host-slash\") pod \"iptables-alerter-cpdv4\" (UID: \"9e06f763-f83a-4f6f-82c5-35f468e3ee31\") " pod="openshift-network-operator/iptables-alerter-cpdv4" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234687 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-systemd-units\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-cni-netd\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234741 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-sys\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234761 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afa7dced-205f-4733-a059-fbd59fb79687-host\") pod \"node-ca-vmtp7\" (UID: \"afa7dced-205f-4733-a059-fbd59fb79687\") " pod="openshift-image-registry/node-ca-vmtp7" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwsmc\" (UniqueName: \"kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc\") pod \"network-check-target-6mxr8\" (UID: \"aa8e2e5f-7dd0-464d-8077-41a497565322\") " pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234818 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-dbus\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234829 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dfdceec5-4d97-4521-a8d4-83d163fdc371-agent-certs\") pod \"konnectivity-agent-jmcfd\" (UID: \"dfdceec5-4d97-4521-a8d4-83d163fdc371\") " pod="kube-system/konnectivity-agent-jmcfd" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234658 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-log-socket\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234854 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-run-netns\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.235021 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-hostroot\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234909 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-systemd-units\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1aaa469c-5cfc-41b8-b757-c2683a318436-multus-daemon-config\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234943 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-sysconfig\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-system-cni-dir\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235020 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-run\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235042 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-lib-modules\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235068 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-cni-binary-copy\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-os-release\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-run-ovn\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-ovn-node-metrics-cert\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvxm9\" (UniqueName: \"kubernetes.io/projected/bda40917-2614-429f-8754-ad4f8233f50c-kube-api-access-lvxm9\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/afa7dced-205f-4733-a059-fbd59fb79687-serviceca\") pod \"node-ca-vmtp7\" (UID: \"afa7dced-205f-4733-a059-fbd59fb79687\") " pod="openshift-image-registry/node-ca-vmtp7" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-device-dir\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfhzn\" (UniqueName: \"kubernetes.io/projected/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-kube-api-access-kfhzn\") pod \"network-metrics-daemon-mk7cq\" (UID: \"e31e814a-2c84-4b09-a4f3-06fa6c649cfb\") " pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:17.235774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235327 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-cni-bin\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235388 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw5gc\" (UniqueName: \"kubernetes.io/projected/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-kube-api-access-rw5gc\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-modprobe-d\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-socket-dir\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235491 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs\") pod \"network-metrics-daemon-mk7cq\" (UID: \"e31e814a-2c84-4b09-a4f3-06fa6c649cfb\") " pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235516 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-etc-openvswitch\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-run-openvswitch\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235550 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-cni-netd\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235564 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-kubernetes\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235595 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-run-netns\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235588 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235638 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-hostroot\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.234877 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e06f763-f83a-4f6f-82c5-35f468e3ee31-host-slash\") pod \"iptables-alerter-cpdv4\" (UID: \"9e06f763-f83a-4f6f-82c5-35f468e3ee31\") " pod="openshift-network-operator/iptables-alerter-cpdv4" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235659 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-var-lib-cni-bin\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lmcr\" (UniqueName: \"kubernetes.io/projected/1aaa469c-5cfc-41b8-b757-c2683a318436-kube-api-access-5lmcr\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.236510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-slash\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235735 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bda40917-2614-429f-8754-ad4f8233f50c-etc-tuned\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235744 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-os-release\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7s8s\" (UniqueName: \"kubernetes.io/projected/65e05599-9f05-4924-8d90-d0c4a7a7f4aa-kube-api-access-q7s8s\") pod \"node-resolver-656q7\" (UID: \"65e05599-9f05-4924-8d90-d0c4a7a7f4aa\") " pod="openshift-dns/node-resolver-656q7" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235782 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-run-ovn\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235785 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-multus-socket-dir-parent\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-var-lib-cni-multus\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235833 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-node-log\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65e05599-9f05-4924-8d90-d0c4a7a7f4aa-tmp-dir\") pod \"node-resolver-656q7\" (UID: \"65e05599-9f05-4924-8d90-d0c4a7a7f4aa\") " pod="openshift-dns/node-resolver-656q7" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235917 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-slash\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.235920 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj8hn\" (UniqueName: \"kubernetes.io/projected/afa7dced-205f-4733-a059-fbd59fb79687-kube-api-access-wj8hn\") pod \"node-ca-vmtp7\" (UID: \"afa7dced-205f-4733-a059-fbd59fb79687\") " pod="openshift-image-registry/node-ca-vmtp7" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235966 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.236007 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret podName:a7e1ce9e-5b4e-49df-bcbd-1bff98386452 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:17.735958759 +0000 UTC m=+2.994363428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret") pod "global-pull-secret-syncer-lf8fm" (UID: "a7e1ce9e-5b4e-49df-bcbd-1bff98386452") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236047 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-var-lib-cni-multus\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236097 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-var-lib-cni-bin\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236140 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-node-log\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.237298 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236130 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236209 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-cni-bin\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236235 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-multus-socket-dir-parent\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236259 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.235466 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1aaa469c-5cfc-41b8-b757-c2683a318436-multus-daemon-config\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-run-k8s-cni-cncf-io\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bda40917-2614-429f-8754-ad4f8233f50c-tmp\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-sysctl-conf\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236361 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-systemd\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236370 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-etc-openvswitch\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236370 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-run-k8s-cni-cncf-io\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dfdceec5-4d97-4521-a8d4-83d163fdc371-konnectivity-ca\") pod \"konnectivity-agent-jmcfd\" (UID: \"dfdceec5-4d97-4521-a8d4-83d163fdc371\") " pod="kube-system/konnectivity-agent-jmcfd" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-multus-cni-dir\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236489 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-run-openvswitch\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-var-lib-openvswitch\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-ovnkube-script-lib\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-var-lib-kubelet\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.238073 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236572 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-multus-cni-dir\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236577 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-var-lib-openvswitch\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236587 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-registration-dir\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236611 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1aaa469c-5cfc-41b8-b757-c2683a318436-cni-binary-copy\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-var-lib-kubelet\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236768 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-host-var-lib-kubelet\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236789 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4dqj\" (UniqueName: \"kubernetes.io/projected/9e06f763-f83a-4f6f-82c5-35f468e3ee31-kube-api-access-h4dqj\") pod \"iptables-alerter-cpdv4\" (UID: \"9e06f763-f83a-4f6f-82c5-35f468e3ee31\") " pod="openshift-network-operator/iptables-alerter-cpdv4" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-sysctl-d\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236861 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-host\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236882 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wsvm\" (UniqueName: \"kubernetes.io/projected/ae598c3a-9c8c-415c-9ff0-005e786227a6-kube-api-access-6wsvm\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-os-release\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-cnibin\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e06f763-f83a-4f6f-82c5-35f468e3ee31-iptables-alerter-script\") pod \"iptables-alerter-cpdv4\" (UID: \"9e06f763-f83a-4f6f-82c5-35f468e3ee31\") " pod="openshift-network-operator/iptables-alerter-cpdv4" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-kubelet\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.236995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-ovnkube-config\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.237017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-env-overrides\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.237040 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-cnibin\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.238732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.237064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-system-cni-dir\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.239460 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.237089 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-etc-kubernetes\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.239460 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.237104 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-cnibin\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.239460 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.237144 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-ovnkube-script-lib\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.239460 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.237175 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-etc-kubernetes\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.239460 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.237182 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1aaa469c-5cfc-41b8-b757-c2683a318436-cni-binary-copy\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.239460 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.237243 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-host-kubelet\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.239460 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.237358 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1aaa469c-5cfc-41b8-b757-c2683a318436-system-cni-dir\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.239460 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.237611 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-env-overrides\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.239460 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.237657 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e06f763-f83a-4f6f-82c5-35f468e3ee31-iptables-alerter-script\") pod \"iptables-alerter-cpdv4\" (UID: \"9e06f763-f83a-4f6f-82c5-35f468e3ee31\") " pod="openshift-network-operator/iptables-alerter-cpdv4" Jul 20 09:57:17.239460 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.237906 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-ovnkube-config\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.239919 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.239789 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-ovn-node-metrics-cert\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.256859 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.256525 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" event={"ID":"d97e9e3433a54f7fc5fb31270e8cbde7","Type":"ContainerStarted","Data":"67ce379745b1e60ed50637103d119da510708ef8f2e25b01f4446a462e58218d"} Jul 20 09:57:17.258243 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.258218 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lmcr\" (UniqueName: \"kubernetes.io/projected/1aaa469c-5cfc-41b8-b757-c2683a318436-kube-api-access-5lmcr\") pod \"multus-lrjcf\" (UID: \"1aaa469c-5cfc-41b8-b757-c2683a318436\") " pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.258764 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.258730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" event={"ID":"1238c0aca3f63e014c424e1c2547bff3","Type":"ContainerStarted","Data":"a8c668d52dd7ad24a7a22e3ab6a2e9443d7126efd999bac1951e7337bef95d38"} Jul 20 09:57:17.259417 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.259374 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4dqj\" (UniqueName: \"kubernetes.io/projected/9e06f763-f83a-4f6f-82c5-35f468e3ee31-kube-api-access-h4dqj\") pod \"iptables-alerter-cpdv4\" (UID: \"9e06f763-f83a-4f6f-82c5-35f468e3ee31\") " pod="openshift-network-operator/iptables-alerter-cpdv4" Jul 20 09:57:17.263906 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.263885 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw5gc\" (UniqueName: \"kubernetes.io/projected/69bf8322-6b6f-40e4-bf99-4b353ee2b2f1-kube-api-access-rw5gc\") pod \"ovnkube-node-65jsj\" (UID: \"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.337683 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.337655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-modprobe-d\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.337872 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.337694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-socket-dir\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.337872 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.337721 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs\") pod \"network-metrics-daemon-mk7cq\" (UID: \"e31e814a-2c84-4b09-a4f3-06fa6c649cfb\") " pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:17.337872 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.337810 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:17.337872 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.337833 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-socket-dir\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.337872 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.337835 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-modprobe-d\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.337872 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.337861 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs podName:e31e814a-2c84-4b09-a4f3-06fa6c649cfb nodeName:}" failed. No retries permitted until 2026-07-20 09:57:17.837843012 +0000 UTC m=+3.096247667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs") pod "network-metrics-daemon-mk7cq" (UID: "e31e814a-2c84-4b09-a4f3-06fa6c649cfb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:17.338181 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.337877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-kubernetes\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.338181 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.337901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.338181 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.337925 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.338181 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.337928 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-kubernetes\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.338181 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.337953 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bda40917-2614-429f-8754-ad4f8233f50c-etc-tuned\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.338181 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.337977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7s8s\" (UniqueName: \"kubernetes.io/projected/65e05599-9f05-4924-8d90-d0c4a7a7f4aa-kube-api-access-q7s8s\") pod \"node-resolver-656q7\" (UID: \"65e05599-9f05-4924-8d90-d0c4a7a7f4aa\") " pod="openshift-dns/node-resolver-656q7" Jul 20 09:57:17.338181 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65e05599-9f05-4924-8d90-d0c4a7a7f4aa-tmp-dir\") pod \"node-resolver-656q7\" (UID: \"65e05599-9f05-4924-8d90-d0c4a7a7f4aa\") " pod="openshift-dns/node-resolver-656q7" Jul 20 09:57:17.338181 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338013 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.338181 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338069 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.338181 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj8hn\" (UniqueName: \"kubernetes.io/projected/afa7dced-205f-4733-a059-fbd59fb79687-kube-api-access-wj8hn\") pod \"node-ca-vmtp7\" (UID: \"afa7dced-205f-4733-a059-fbd59fb79687\") " pod="openshift-image-registry/node-ca-vmtp7" Jul 20 09:57:17.338181 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bda40917-2614-429f-8754-ad4f8233f50c-tmp\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-sysctl-conf\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338254 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-systemd\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338276 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dfdceec5-4d97-4521-a8d4-83d163fdc371-konnectivity-ca\") pod \"konnectivity-agent-jmcfd\" (UID: \"dfdceec5-4d97-4521-a8d4-83d163fdc371\") " pod="kube-system/konnectivity-agent-jmcfd" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338295 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65e05599-9f05-4924-8d90-d0c4a7a7f4aa-tmp-dir\") pod \"node-resolver-656q7\" (UID: \"65e05599-9f05-4924-8d90-d0c4a7a7f4aa\") " pod="openshift-dns/node-resolver-656q7" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-var-lib-kubelet\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-registration-dir\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338355 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-sysctl-d\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-host\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338395 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-sysctl-conf\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wsvm\" (UniqueName: \"kubernetes.io/projected/ae598c3a-9c8c-415c-9ff0-005e786227a6-kube-api-access-6wsvm\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338409 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-systemd\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338423 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-os-release\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-cnibin\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338472 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-registration-dir\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338485 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-host\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.338690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338526 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-var-lib-kubelet\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-sys-fs\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338562 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nl25\" (UniqueName: \"kubernetes.io/projected/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-kube-api-access-8nl25\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338619 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-cnibin\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338631 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-sys-fs\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338645 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-os-release\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338726 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-sysctl-d\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338751 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65e05599-9f05-4924-8d90-d0c4a7a7f4aa-hosts-file\") pod \"node-resolver-656q7\" (UID: \"65e05599-9f05-4924-8d90-d0c4a7a7f4aa\") " pod="openshift-dns/node-resolver-656q7" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338786 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-sys\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afa7dced-205f-4733-a059-fbd59fb79687-host\") pod \"node-ca-vmtp7\" (UID: \"afa7dced-205f-4733-a059-fbd59fb79687\") " pod="openshift-image-registry/node-ca-vmtp7" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338853 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65e05599-9f05-4924-8d90-d0c4a7a7f4aa-hosts-file\") pod \"node-resolver-656q7\" (UID: \"65e05599-9f05-4924-8d90-d0c4a7a7f4aa\") " pod="openshift-dns/node-resolver-656q7" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwsmc\" (UniqueName: \"kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc\") pod \"network-check-target-6mxr8\" (UID: \"aa8e2e5f-7dd0-464d-8077-41a497565322\") " pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338890 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-sys\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dfdceec5-4d97-4521-a8d4-83d163fdc371-agent-certs\") pod \"konnectivity-agent-jmcfd\" (UID: \"dfdceec5-4d97-4521-a8d4-83d163fdc371\") " pod="kube-system/konnectivity-agent-jmcfd" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338901 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afa7dced-205f-4733-a059-fbd59fb79687-host\") pod \"node-ca-vmtp7\" (UID: \"afa7dced-205f-4733-a059-fbd59fb79687\") " pod="openshift-image-registry/node-ca-vmtp7" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-sysconfig\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.339500 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338942 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338988 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-system-cni-dir\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338997 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-etc-sysconfig\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.339011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-run\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.339036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-lib-modules\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.339062 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-cni-binary-copy\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.339064 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-system-cni-dir\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.339037 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.339158 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-lib-modules\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.339202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvxm9\" (UniqueName: \"kubernetes.io/projected/bda40917-2614-429f-8754-ad4f8233f50c-kube-api-access-lvxm9\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.339220 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bda40917-2614-429f-8754-ad4f8233f50c-run\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.339228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/afa7dced-205f-4733-a059-fbd59fb79687-serviceca\") pod \"node-ca-vmtp7\" (UID: \"afa7dced-205f-4733-a059-fbd59fb79687\") " pod="openshift-image-registry/node-ca-vmtp7" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.339261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-device-dir\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.338877 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dfdceec5-4d97-4521-a8d4-83d163fdc371-konnectivity-ca\") pod \"konnectivity-agent-jmcfd\" (UID: \"dfdceec5-4d97-4521-a8d4-83d163fdc371\") " pod="kube-system/konnectivity-agent-jmcfd" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.339584 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-cni-binary-copy\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.339596 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/afa7dced-205f-4733-a059-fbd59fb79687-serviceca\") pod \"node-ca-vmtp7\" (UID: \"afa7dced-205f-4733-a059-fbd59fb79687\") " pod="openshift-image-registry/node-ca-vmtp7" Jul 20 09:57:17.340328 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.339598 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae598c3a-9c8c-415c-9ff0-005e786227a6-device-dir\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.341154 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.339288 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfhzn\" (UniqueName: \"kubernetes.io/projected/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-kube-api-access-kfhzn\") pod \"network-metrics-daemon-mk7cq\" (UID: \"e31e814a-2c84-4b09-a4f3-06fa6c649cfb\") " pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:17.341154 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.340017 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.341154 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.340927 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bda40917-2614-429f-8754-ad4f8233f50c-etc-tuned\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.341557 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.341538 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dfdceec5-4d97-4521-a8d4-83d163fdc371-agent-certs\") pod \"konnectivity-agent-jmcfd\" (UID: \"dfdceec5-4d97-4521-a8d4-83d163fdc371\") " pod="kube-system/konnectivity-agent-jmcfd" Jul 20 09:57:17.341779 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.341756 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bda40917-2614-429f-8754-ad4f8233f50c-tmp\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.353555 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.353505 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:17.353555 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.353529 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:17.353555 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.353542 2564 projected.go:196] Error preparing data for projected volume kube-api-access-kwsmc for pod openshift-network-diagnostics/network-check-target-6mxr8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:17.353714 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.353596 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc podName:aa8e2e5f-7dd0-464d-8077-41a497565322 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:17.853582086 +0000 UTC m=+3.111986761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kwsmc" (UniqueName: "kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc") pod "network-check-target-6mxr8" (UID: "aa8e2e5f-7dd0-464d-8077-41a497565322") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:17.355703 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.355683 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nl25\" (UniqueName: \"kubernetes.io/projected/89ab4d5e-0f3e-48ee-83ff-5d5d940a8570-kube-api-access-8nl25\") pod \"multus-additional-cni-plugins-mtxmk\" (UID: \"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570\") " pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.356827 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.356803 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj8hn\" (UniqueName: \"kubernetes.io/projected/afa7dced-205f-4733-a059-fbd59fb79687-kube-api-access-wj8hn\") pod \"node-ca-vmtp7\" (UID: \"afa7dced-205f-4733-a059-fbd59fb79687\") " pod="openshift-image-registry/node-ca-vmtp7" Jul 20 09:57:17.357626 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.357608 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7s8s\" (UniqueName: \"kubernetes.io/projected/65e05599-9f05-4924-8d90-d0c4a7a7f4aa-kube-api-access-q7s8s\") pod \"node-resolver-656q7\" (UID: \"65e05599-9f05-4924-8d90-d0c4a7a7f4aa\") " pod="openshift-dns/node-resolver-656q7" Jul 20 09:57:17.357866 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.357848 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfhzn\" (UniqueName: \"kubernetes.io/projected/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-kube-api-access-kfhzn\") pod \"network-metrics-daemon-mk7cq\" (UID: \"e31e814a-2c84-4b09-a4f3-06fa6c649cfb\") " pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:17.358121 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.358106 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvxm9\" (UniqueName: \"kubernetes.io/projected/bda40917-2614-429f-8754-ad4f8233f50c-kube-api-access-lvxm9\") pod \"tuned-dnj6m\" (UID: \"bda40917-2614-429f-8754-ad4f8233f50c\") " pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.360285 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.360263 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wsvm\" (UniqueName: \"kubernetes.io/projected/ae598c3a-9c8c-415c-9ff0-005e786227a6-kube-api-access-6wsvm\") pod \"aws-ebs-csi-driver-node-q5cbj\" (UID: \"ae598c3a-9c8c-415c-9ff0-005e786227a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.429250 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.429214 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lrjcf" Jul 20 09:57:17.440150 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.440123 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cpdv4" Jul 20 09:57:17.450039 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.450015 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:17.455563 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.455544 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" Jul 20 09:57:17.463157 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.463134 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" Jul 20 09:57:17.471252 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.471235 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-656q7" Jul 20 09:57:17.478046 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.478019 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vmtp7" Jul 20 09:57:17.485497 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.485479 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mtxmk" Jul 20 09:57:17.491033 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.491017 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jmcfd" Jul 20 09:57:17.741792 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.741755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:17.741978 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.741924 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:17.742043 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.741993 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret podName:a7e1ce9e-5b4e-49df-bcbd-1bff98386452 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:18.741972607 +0000 UTC m=+4.000377261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret") pod "global-pull-secret-syncer-lf8fm" (UID: "a7e1ce9e-5b4e-49df-bcbd-1bff98386452") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:17.843099 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.843071 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs\") pod \"network-metrics-daemon-mk7cq\" (UID: \"e31e814a-2c84-4b09-a4f3-06fa6c649cfb\") " pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:17.843242 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.843214 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:17.843301 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.843280 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs podName:e31e814a-2c84-4b09-a4f3-06fa6c649cfb nodeName:}" failed. No retries permitted until 2026-07-20 09:57:18.843260601 +0000 UTC m=+4.101665274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs") pod "network-metrics-daemon-mk7cq" (UID: "e31e814a-2c84-4b09-a4f3-06fa6c649cfb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:17.943362 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:17.943331 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwsmc\" (UniqueName: \"kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc\") pod \"network-check-target-6mxr8\" (UID: \"aa8e2e5f-7dd0-464d-8077-41a497565322\") " pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:17.943522 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.943463 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:17.943522 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.943487 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:17.943522 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.943502 2564 projected.go:196] Error preparing data for projected volume kube-api-access-kwsmc for pod openshift-network-diagnostics/network-check-target-6mxr8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:17.943654 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:17.943554 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc podName:aa8e2e5f-7dd0-464d-8077-41a497565322 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:18.943539963 +0000 UTC m=+4.201944631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwsmc" (UniqueName: "kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc") pod "network-check-target-6mxr8" (UID: "aa8e2e5f-7dd0-464d-8077-41a497565322") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:18.136393 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:18.136307 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda40917_2614_429f_8754_ad4f8233f50c.slice/crio-7d1e5aa41d2cd7358964325508d3494f55acee5f552c46ade95dd13134071c96 WatchSource:0}: Error finding container 7d1e5aa41d2cd7358964325508d3494f55acee5f552c46ade95dd13134071c96: Status 404 returned error can't find the container with id 7d1e5aa41d2cd7358964325508d3494f55acee5f552c46ade95dd13134071c96 Jul 20 09:57:18.138790 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:18.138558 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69bf8322_6b6f_40e4_bf99_4b353ee2b2f1.slice/crio-174b666bec63fa97aee63a070620de0168959dbee6bd14a16f93972adc77fc6f WatchSource:0}: Error finding container 174b666bec63fa97aee63a070620de0168959dbee6bd14a16f93972adc77fc6f: Status 404 returned error can't find the container with id 174b666bec63fa97aee63a070620de0168959dbee6bd14a16f93972adc77fc6f Jul 20 09:57:18.140170 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:18.140112 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae598c3a_9c8c_415c_9ff0_005e786227a6.slice/crio-d593b84483a69ca8e842392bd2bc4cc121b2ca0d48fa2d1512921e8988919377 WatchSource:0}: Error finding container d593b84483a69ca8e842392bd2bc4cc121b2ca0d48fa2d1512921e8988919377: Status 404 returned error can't find the container with id d593b84483a69ca8e842392bd2bc4cc121b2ca0d48fa2d1512921e8988919377 Jul 20 09:57:18.161953 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:18.161933 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e06f763_f83a_4f6f_82c5_35f468e3ee31.slice/crio-be14c543050fbd95cdac8275d67b60682f0fce75384ab4f8c3c5ff72373d8ed6 WatchSource:0}: Error finding container be14c543050fbd95cdac8275d67b60682f0fce75384ab4f8c3c5ff72373d8ed6: Status 404 returned error can't find the container with id be14c543050fbd95cdac8275d67b60682f0fce75384ab4f8c3c5ff72373d8ed6 Jul 20 09:57:18.162520 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:18.162508 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e05599_9f05_4924_8d90_d0c4a7a7f4aa.slice/crio-43d5114acae7dd74bd6829d06ca8390d107ac286a866fd712789681f25852850 WatchSource:0}: Error finding container 43d5114acae7dd74bd6829d06ca8390d107ac286a866fd712789681f25852850: Status 404 returned error can't find the container with id 43d5114acae7dd74bd6829d06ca8390d107ac286a866fd712789681f25852850 Jul 20 09:57:18.163189 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:18.163158 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ab4d5e_0f3e_48ee_83ff_5d5d940a8570.slice/crio-33d0f605a66ce58795b787e3dd27df1d5b59f8b026bcfe69e28c7c301908bdb9 WatchSource:0}: Error finding container 33d0f605a66ce58795b787e3dd27df1d5b59f8b026bcfe69e28c7c301908bdb9: Status 404 returned error can't find the container with id 33d0f605a66ce58795b787e3dd27df1d5b59f8b026bcfe69e28c7c301908bdb9 Jul 20 09:57:18.164050 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:18.164017 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa7dced_205f_4733_a059_fbd59fb79687.slice/crio-b50f298fd6a98e1cc98843fe42ceaa489d7c02187d5009547091cce76f0723e1 WatchSource:0}: Error finding container b50f298fd6a98e1cc98843fe42ceaa489d7c02187d5009547091cce76f0723e1: Status 404 returned error can't find the container with id b50f298fd6a98e1cc98843fe42ceaa489d7c02187d5009547091cce76f0723e1 Jul 20 09:57:18.217353 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.217306 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 09:52:17 +0000 UTC" deadline="2028-01-13 12:14:29.076872653 +0000 UTC" Jul 20 09:57:18.217353 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.217339 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13010h17m10.859538042s" Jul 20 09:57:18.265750 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.265622 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lrjcf" event={"ID":"1aaa469c-5cfc-41b8-b757-c2683a318436","Type":"ContainerStarted","Data":"0ec2b061f65f60b60b1c2a72c7930836760db45468cb58fbc4edf2b92a1a0868"} Jul 20 09:57:18.266720 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.266696 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" event={"ID":"bda40917-2614-429f-8754-ad4f8233f50c","Type":"ContainerStarted","Data":"7d1e5aa41d2cd7358964325508d3494f55acee5f552c46ade95dd13134071c96"} Jul 20 09:57:18.268306 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.268289 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtxmk" event={"ID":"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570","Type":"ContainerStarted","Data":"33d0f605a66ce58795b787e3dd27df1d5b59f8b026bcfe69e28c7c301908bdb9"} Jul 20 09:57:18.269366 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.269344 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" event={"ID":"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1","Type":"ContainerStarted","Data":"174b666bec63fa97aee63a070620de0168959dbee6bd14a16f93972adc77fc6f"} Jul 20 09:57:18.270309 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.270287 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jmcfd" event={"ID":"dfdceec5-4d97-4521-a8d4-83d163fdc371","Type":"ContainerStarted","Data":"ca2be083006c0c3fb7dc948589c8025dba16938aef516bc4bd92641774a5dff2"} Jul 20 09:57:18.272842 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.272822 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" event={"ID":"d97e9e3433a54f7fc5fb31270e8cbde7","Type":"ContainerStarted","Data":"60a46b2950441b23c99f996c527bb4219f2726ca135dff47b5966f75d4a2a1d3"} Jul 20 09:57:18.273943 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.273908 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vmtp7" event={"ID":"afa7dced-205f-4733-a059-fbd59fb79687","Type":"ContainerStarted","Data":"b50f298fd6a98e1cc98843fe42ceaa489d7c02187d5009547091cce76f0723e1"} Jul 20 09:57:18.276659 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.276635 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-656q7" event={"ID":"65e05599-9f05-4924-8d90-d0c4a7a7f4aa","Type":"ContainerStarted","Data":"43d5114acae7dd74bd6829d06ca8390d107ac286a866fd712789681f25852850"} Jul 20 09:57:18.279255 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.279236 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cpdv4" event={"ID":"9e06f763-f83a-4f6f-82c5-35f468e3ee31","Type":"ContainerStarted","Data":"be14c543050fbd95cdac8275d67b60682f0fce75384ab4f8c3c5ff72373d8ed6"} Jul 20 09:57:18.280646 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.280629 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" event={"ID":"ae598c3a-9c8c-415c-9ff0-005e786227a6","Type":"ContainerStarted","Data":"d593b84483a69ca8e842392bd2bc4cc121b2ca0d48fa2d1512921e8988919377"} Jul 20 09:57:18.286515 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.286471 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" podStartSLOduration=2.286459238 podStartE2EDuration="2.286459238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:18.286167419 +0000 UTC m=+3.544572096" watchObservedRunningTime="2026-07-20 09:57:18.286459238 +0000 UTC m=+3.544863908" Jul 20 09:57:18.749086 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.748296 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:18.749086 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:18.748499 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:18.749086 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:18.748561 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret podName:a7e1ce9e-5b4e-49df-bcbd-1bff98386452 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:20.748542485 +0000 UTC m=+6.006947154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret") pod "global-pull-secret-syncer-lf8fm" (UID: "a7e1ce9e-5b4e-49df-bcbd-1bff98386452") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:18.831699 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.831595 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:57:18.849429 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.849404 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs\") pod \"network-metrics-daemon-mk7cq\" (UID: \"e31e814a-2c84-4b09-a4f3-06fa6c649cfb\") " pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:18.849641 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:18.849579 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:18.849641 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:18.849636 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs podName:e31e814a-2c84-4b09-a4f3-06fa6c649cfb nodeName:}" failed. No retries permitted until 2026-07-20 09:57:20.849618125 +0000 UTC m=+6.108022797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs") pod "network-metrics-daemon-mk7cq" (UID: "e31e814a-2c84-4b09-a4f3-06fa6c649cfb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:18.950177 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:18.950142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwsmc\" (UniqueName: \"kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc\") pod \"network-check-target-6mxr8\" (UID: \"aa8e2e5f-7dd0-464d-8077-41a497565322\") " pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:18.950347 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:18.950301 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:18.950347 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:18.950323 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:18.950347 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:18.950336 2564 projected.go:196] Error preparing data for projected volume kube-api-access-kwsmc for pod openshift-network-diagnostics/network-check-target-6mxr8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:18.950547 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:18.950391 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc podName:aa8e2e5f-7dd0-464d-8077-41a497565322 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:20.950374565 +0000 UTC m=+6.208779236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwsmc" (UniqueName: "kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc") pod "network-check-target-6mxr8" (UID: "aa8e2e5f-7dd0-464d-8077-41a497565322") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:19.217572 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:19.217488 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 09:52:17 +0000 UTC" deadline="2027-12-15 06:01:41.555843292 +0000 UTC" Jul 20 09:57:19.217572 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:19.217544 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12308h4m22.338303063s" Jul 20 09:57:19.252108 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:19.251549 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:19.252108 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:19.251571 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:19.252108 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:19.251675 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:19.252108 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:19.251723 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:19.252108 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:19.251812 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:19.252108 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:19.251895 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:19.295563 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:19.295043 2564 generic.go:356] "Generic (PLEG): container finished" podID="1238c0aca3f63e014c424e1c2547bff3" containerID="6869eb288b8cf92572a6cd14e837f76c9c4ccdc52d24cc5e8532ab708d995a9c" exitCode=0 Jul 20 09:57:19.295563 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:19.295134 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" event={"ID":"1238c0aca3f63e014c424e1c2547bff3","Type":"ContainerDied","Data":"6869eb288b8cf92572a6cd14e837f76c9c4ccdc52d24cc5e8532ab708d995a9c"} Jul 20 09:57:20.309858 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:20.309824 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" event={"ID":"1238c0aca3f63e014c424e1c2547bff3","Type":"ContainerStarted","Data":"49340e6683c05f051afba863a8b9e4c2081b567e24536f16affbd8fb9a6a6a5f"} Jul 20 09:57:20.327355 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:20.327304 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" podStartSLOduration=4.327284677 podStartE2EDuration="4.327284677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:20.327175905 +0000 UTC m=+5.585580582" watchObservedRunningTime="2026-07-20 09:57:20.327284677 +0000 UTC m=+5.585689354" Jul 20 09:57:20.765813 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:20.765754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:20.765997 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:20.765959 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:20.766057 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:20.766021 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret podName:a7e1ce9e-5b4e-49df-bcbd-1bff98386452 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:24.766003025 +0000 UTC m=+10.024407680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret") pod "global-pull-secret-syncer-lf8fm" (UID: "a7e1ce9e-5b4e-49df-bcbd-1bff98386452") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:20.867177 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:20.867139 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs\") pod \"network-metrics-daemon-mk7cq\" (UID: \"e31e814a-2c84-4b09-a4f3-06fa6c649cfb\") " pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:20.867426 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:20.867295 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:20.867426 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:20.867362 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs podName:e31e814a-2c84-4b09-a4f3-06fa6c649cfb nodeName:}" failed. No retries permitted until 2026-07-20 09:57:24.867341749 +0000 UTC m=+10.125746403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs") pod "network-metrics-daemon-mk7cq" (UID: "e31e814a-2c84-4b09-a4f3-06fa6c649cfb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:20.967894 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:20.967839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwsmc\" (UniqueName: \"kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc\") pod \"network-check-target-6mxr8\" (UID: \"aa8e2e5f-7dd0-464d-8077-41a497565322\") " pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:20.968077 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:20.968006 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:20.968077 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:20.968023 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:20.968077 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:20.968036 2564 projected.go:196] Error preparing data for projected volume kube-api-access-kwsmc for pod openshift-network-diagnostics/network-check-target-6mxr8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:20.968229 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:20.968093 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc podName:aa8e2e5f-7dd0-464d-8077-41a497565322 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:24.96807428 +0000 UTC m=+10.226478954 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwsmc" (UniqueName: "kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc") pod "network-check-target-6mxr8" (UID: "aa8e2e5f-7dd0-464d-8077-41a497565322") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:21.253535 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:21.253505 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:21.253705 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:21.253629 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:21.254038 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:21.254013 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:21.254149 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:21.254123 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:21.254213 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:21.254172 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:21.254266 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:21.254244 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:23.252351 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:23.251840 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:23.252351 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:23.251857 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:23.252351 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:23.251970 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:23.252351 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:23.252001 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:23.252351 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:23.252090 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:23.252351 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:23.252181 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:24.800004 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:24.799972 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:24.800501 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:24.800119 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:24.800501 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:24.800184 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret podName:a7e1ce9e-5b4e-49df-bcbd-1bff98386452 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:32.800164451 +0000 UTC m=+18.058569130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret") pod "global-pull-secret-syncer-lf8fm" (UID: "a7e1ce9e-5b4e-49df-bcbd-1bff98386452") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:24.901414 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:24.901364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs\") pod \"network-metrics-daemon-mk7cq\" (UID: \"e31e814a-2c84-4b09-a4f3-06fa6c649cfb\") " pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:24.901605 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:24.901507 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:24.901605 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:24.901569 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs podName:e31e814a-2c84-4b09-a4f3-06fa6c649cfb nodeName:}" failed. No retries permitted until 2026-07-20 09:57:32.901550185 +0000 UTC m=+18.159954853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs") pod "network-metrics-daemon-mk7cq" (UID: "e31e814a-2c84-4b09-a4f3-06fa6c649cfb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:25.002497 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:25.001907 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwsmc\" (UniqueName: \"kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc\") pod \"network-check-target-6mxr8\" (UID: \"aa8e2e5f-7dd0-464d-8077-41a497565322\") " pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:25.002497 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:25.002073 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:25.002497 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:25.002095 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:25.002497 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:25.002108 2564 projected.go:196] Error preparing data for projected volume kube-api-access-kwsmc for pod openshift-network-diagnostics/network-check-target-6mxr8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:25.002497 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:25.002163 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc podName:aa8e2e5f-7dd0-464d-8077-41a497565322 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:33.00214519 +0000 UTC m=+18.260549869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwsmc" (UniqueName: "kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc") pod "network-check-target-6mxr8" (UID: "aa8e2e5f-7dd0-464d-8077-41a497565322") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:25.253023 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:25.252574 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:25.253023 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:25.252687 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:25.253023 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:25.252757 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:25.253023 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:25.252859 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:25.253023 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:25.252896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:25.253023 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:25.252954 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:27.252023 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:27.251983 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:27.252488 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:27.251983 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:27.252488 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:27.252120 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:27.252488 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:27.252118 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:27.252488 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:27.252231 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:27.252488 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:27.252309 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:29.251878 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:29.251846 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:29.251878 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:29.251858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:29.252324 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:29.251981 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:29.252324 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:29.252052 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:29.252324 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:29.252099 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:29.252324 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:29.252166 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:31.251832 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:31.251796 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:31.252293 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:31.251796 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:31.252293 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:31.251924 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:31.252293 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:31.251809 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:31.252293 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:31.252023 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:31.252293 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:31.252087 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:32.862071 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:32.862040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:32.862542 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:32.862201 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:32.862542 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:32.862262 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret podName:a7e1ce9e-5b4e-49df-bcbd-1bff98386452 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:48.862246579 +0000 UTC m=+34.120651233 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret") pod "global-pull-secret-syncer-lf8fm" (UID: "a7e1ce9e-5b4e-49df-bcbd-1bff98386452") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:32.962724 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:32.962688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs\") pod \"network-metrics-daemon-mk7cq\" (UID: \"e31e814a-2c84-4b09-a4f3-06fa6c649cfb\") " pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:32.962899 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:32.962825 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:32.962899 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:32.962894 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs podName:e31e814a-2c84-4b09-a4f3-06fa6c649cfb nodeName:}" failed. No retries permitted until 2026-07-20 09:57:48.962876447 +0000 UTC m=+34.221281104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs") pod "network-metrics-daemon-mk7cq" (UID: "e31e814a-2c84-4b09-a4f3-06fa6c649cfb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:33.063334 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:33.063291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwsmc\" (UniqueName: \"kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc\") pod \"network-check-target-6mxr8\" (UID: \"aa8e2e5f-7dd0-464d-8077-41a497565322\") " pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:33.063527 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:33.063501 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:33.063598 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:33.063527 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:33.063598 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:33.063542 2564 projected.go:196] Error preparing data for projected volume kube-api-access-kwsmc for pod openshift-network-diagnostics/network-check-target-6mxr8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:33.063696 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:33.063608 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc podName:aa8e2e5f-7dd0-464d-8077-41a497565322 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:49.063588054 +0000 UTC m=+34.321992722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwsmc" (UniqueName: "kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc") pod "network-check-target-6mxr8" (UID: "aa8e2e5f-7dd0-464d-8077-41a497565322") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:33.251113 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:33.251009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:33.251113 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:33.251017 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:33.251317 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:33.251140 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:33.251317 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:33.251022 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:33.251317 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:33.251218 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:33.251317 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:33.251281 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:35.252387 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:35.252353 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:35.252864 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:35.252431 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:35.252864 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:35.252454 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:35.252864 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:35.252573 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:35.252864 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:35.252607 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:35.252864 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:35.252680 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:37.252308 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.252035 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:37.252999 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.252035 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:37.252999 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:37.252386 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:37.252999 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:37.252515 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:37.252999 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.252117 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:37.252999 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:37.252627 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:37.349368 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.349339 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" event={"ID":"bda40917-2614-429f-8754-ad4f8233f50c","Type":"ContainerStarted","Data":"a193ff5b57e8850f1031c8bb98e4a1bbf6b59f7d09805724e20740879a0c0ba8"} Jul 20 09:57:37.350908 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.350886 2564 generic.go:356] "Generic (PLEG): container finished" podID="89ab4d5e-0f3e-48ee-83ff-5d5d940a8570" containerID="e7a2cdf314f7ae1fbe58af98899e642333fbaa26facc9a7b53be7b3b46f45a41" exitCode=0 Jul 20 09:57:37.350998 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.350953 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtxmk" event={"ID":"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570","Type":"ContainerDied","Data":"e7a2cdf314f7ae1fbe58af98899e642333fbaa26facc9a7b53be7b3b46f45a41"} Jul 20 09:57:37.352990 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.352967 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" event={"ID":"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1","Type":"ContainerStarted","Data":"2cbf41a94ff84e28e8aed366fc04655e5c55a6b29a4d02f0b0efc512a64a972f"} Jul 20 09:57:37.353086 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.353042 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" event={"ID":"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1","Type":"ContainerStarted","Data":"a270bcc8e807b2ce4320a1e769687c3679ac69afa50a865e0cd7be535c0b63ed"} Jul 20 09:57:37.353130 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.353089 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" event={"ID":"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1","Type":"ContainerStarted","Data":"52fca3f404fa69de843c6074cfb76fa476efa6a111b0776ff913667e4c659fe2"} Jul 20 09:57:37.354382 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.354359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jmcfd" event={"ID":"dfdceec5-4d97-4521-a8d4-83d163fdc371","Type":"ContainerStarted","Data":"917b22bebd7d240bd95881c7d48d4c7e802dfacba35db2b185a799328c27d410"} Jul 20 09:57:37.355650 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.355632 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vmtp7" event={"ID":"afa7dced-205f-4733-a059-fbd59fb79687","Type":"ContainerStarted","Data":"1e413eb2ac56544367c01e5ca20c1b940ec7e5683b72b2ce19924b5a3af8a5b9"} Jul 20 09:57:37.356913 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.356891 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-656q7" event={"ID":"65e05599-9f05-4924-8d90-d0c4a7a7f4aa","Type":"ContainerStarted","Data":"29144edb12e85564cb998fb4ba006077e10bcb3651a1773203feaaf82469b6e3"} Jul 20 09:57:37.358536 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.358519 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" event={"ID":"ae598c3a-9c8c-415c-9ff0-005e786227a6","Type":"ContainerStarted","Data":"db8d5c5306718e8421d330e207f803ac6a3935cff54a5188fe7d96fb4d790ea8"} Jul 20 09:57:37.359659 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.359643 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lrjcf" event={"ID":"1aaa469c-5cfc-41b8-b757-c2683a318436","Type":"ContainerStarted","Data":"14f27e10869339e29a1bb186bf2746f1172f7f5e5dd34f4037739d123e303753"} Jul 20 09:57:37.403168 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.403124 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dnj6m" podStartSLOduration=3.667889963 podStartE2EDuration="22.403104323s" totalImagesPullingTime="18.73521436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:37.376871683 +0000 UTC m=+22.635276369" watchObservedRunningTime="2026-07-20 09:57:37.403104323 +0000 UTC m=+22.661509001" Jul 20 09:57:37.403338 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.403308 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vmtp7" podStartSLOduration=3.720771139 podStartE2EDuration="22.403297958s" totalImagesPullingTime="18.682526819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:37.403217969 +0000 UTC m=+22.661622646" watchObservedRunningTime="2026-07-20 09:57:37.403297958 +0000 UTC m=+22.661702636" Jul 20 09:57:37.426905 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.426868 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jmcfd" podStartSLOduration=11.932497381 podStartE2EDuration="22.426855616s" totalImagesPullingTime="10.494358235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:37.426556975 +0000 UTC m=+22.684961650" watchObservedRunningTime="2026-07-20 09:57:37.426855616 +0000 UTC m=+22.685260306" Jul 20 09:57:37.462914 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.462874 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lrjcf" podStartSLOduration=3.718416204 podStartE2EDuration="22.462861872s" totalImagesPullingTime="18.744445668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:37.46282818 +0000 UTC m=+22.721232855" watchObservedRunningTime="2026-07-20 09:57:37.462861872 +0000 UTC m=+22.721266547" Jul 20 09:57:37.521910 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:37.521857 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-656q7" podStartSLOduration=3.842412275 podStartE2EDuration="22.521837779s" totalImagesPullingTime="18.679425504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:37.48830437 +0000 UTC m=+22.746709047" watchObservedRunningTime="2026-07-20 09:57:37.521837779 +0000 UTC m=+22.780242458" Jul 20 09:57:38.280452 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:38.280410 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 09:57:38.363485 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:38.363450 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cpdv4" event={"ID":"9e06f763-f83a-4f6f-82c5-35f468e3ee31","Type":"ContainerStarted","Data":"44e32ac97d573712606f2cd291001334bb94fe6f4c1435ec324e2fc1adce1ff4"} Jul 20 09:57:38.365996 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:38.365930 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" event={"ID":"ae598c3a-9c8c-415c-9ff0-005e786227a6","Type":"ContainerStarted","Data":"57852efa036a74a6d41393a781a3d1b16292da1399bbc477fba03bbe327f730b"} Jul 20 09:57:38.371377 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:38.371351 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" event={"ID":"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1","Type":"ContainerStarted","Data":"8b2f20a87c7836ce3f5d4f53cb1fb63c59f1b5c8e0bee625134d207ef61c8b01"} Jul 20 09:57:38.371547 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:38.371426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" event={"ID":"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1","Type":"ContainerStarted","Data":"bdc9065e1d48673caa7bbb9b67b6bd7fdebdd06c4437c36629a7b42dfb0fde2f"} Jul 20 09:57:38.371547 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:38.371494 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" event={"ID":"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1","Type":"ContainerStarted","Data":"df2eb78bebd0b96e06ea9b61ac28e12be47862df97d70684222c5570ae19c3b2"} Jul 20 09:57:38.395022 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:38.394981 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cpdv4" podStartSLOduration=4.71565789 podStartE2EDuration="23.394969922s" totalImagesPullingTime="18.679312032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:38.394969541 +0000 UTC m=+23.653374218" watchObservedRunningTime="2026-07-20 09:57:38.394969922 +0000 UTC m=+23.653374598" Jul 20 09:57:39.194785 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:39.194685 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T09:57:38.28043147Z","UUID":"6873fefd-3a99-478a-ae3e-26112542ee80","Handler":null,"Name":"","Endpoint":""} Jul 20 09:57:39.196463 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:39.196418 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 09:57:39.196591 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:39.196471 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 09:57:39.251346 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:39.251321 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:39.251346 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:39.251337 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:39.251559 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:39.251455 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:39.251559 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:39.251466 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:39.251665 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:39.251563 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:39.251665 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:39.251643 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:39.309170 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:39.309146 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jmcfd" Jul 20 09:57:39.309791 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:39.309777 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jmcfd" Jul 20 09:57:39.373371 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:39.373353 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jmcfd" Jul 20 09:57:39.373744 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:39.373721 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jmcfd" Jul 20 09:57:40.378033 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:40.377779 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" event={"ID":"ae598c3a-9c8c-415c-9ff0-005e786227a6","Type":"ContainerStarted","Data":"a378630f658d52cf3300c8daebed17076a0f3d6093842d3f04b7247238476b9a"} Jul 20 09:57:40.381414 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:40.381379 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" event={"ID":"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1","Type":"ContainerStarted","Data":"dd03b2b52f0024e3758417da7b80612ec809837545746ab6b2a2a310ba4dde44"} Jul 20 09:57:40.399215 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:40.399165 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q5cbj" podStartSLOduration=4.514573734 podStartE2EDuration="25.39914957s" totalImagesPullingTime="20.884575836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:40.398595357 +0000 UTC m=+25.657000033" watchObservedRunningTime="2026-07-20 09:57:40.39914957 +0000 UTC m=+25.657554247" Jul 20 09:57:41.251600 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:41.251570 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:41.251787 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:41.251570 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:41.251787 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:41.251702 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:41.251787 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:41.251697 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:41.251939 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:41.251783 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:41.251939 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:41.251888 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:42.387888 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:42.387706 2564 generic.go:356] "Generic (PLEG): container finished" podID="89ab4d5e-0f3e-48ee-83ff-5d5d940a8570" containerID="e4869190785283212647f0041cbfaf940fde052d2b4cc96ed95312aaff8d2a26" exitCode=0 Jul 20 09:57:42.388690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:42.387793 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtxmk" event={"ID":"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570","Type":"ContainerDied","Data":"e4869190785283212647f0041cbfaf940fde052d2b4cc96ed95312aaff8d2a26"} Jul 20 09:57:42.391680 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:42.391659 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" event={"ID":"69bf8322-6b6f-40e4-bf99-4b353ee2b2f1","Type":"ContainerStarted","Data":"86b9a7228e1dafa9cf0e69d8dd248ee10100640c5fac2a9f7b02b468cbbd7bfb"} Jul 20 09:57:42.391879 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:42.391861 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:42.391962 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:42.391937 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:42.406867 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:42.406851 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:42.441702 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:42.441660 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" podStartSLOduration=8.692713011 podStartE2EDuration="27.441648318s" totalImagesPullingTime="18.748935307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:42.440942529 +0000 UTC m=+27.699347205" watchObservedRunningTime="2026-07-20 09:57:42.441648318 +0000 UTC m=+27.700052993" Jul 20 09:57:43.251361 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:43.251328 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:43.251569 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:43.251328 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:43.251569 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:43.251457 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:43.251569 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:43.251460 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:43.251569 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:43.251527 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:43.251707 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:43.251599 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:43.393739 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:43.393667 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:43.407665 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:43.407638 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:57:43.890329 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:43.890292 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mk7cq"] Jul 20 09:57:43.890510 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:43.890417 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:43.890560 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:43.890525 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:43.893170 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:43.893145 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lf8fm"] Jul 20 09:57:43.893297 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:43.893228 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:43.893362 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:43.893322 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:43.893893 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:43.893872 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6mxr8"] Jul 20 09:57:43.893990 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:43.893942 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:43.894039 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:43.894012 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:44.397636 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:44.397602 2564 generic.go:356] "Generic (PLEG): container finished" podID="89ab4d5e-0f3e-48ee-83ff-5d5d940a8570" containerID="0c56c5f6d43fbf0fc92784696694ff8ab15a0728375b6edd7260b5baaf6b5139" exitCode=0 Jul 20 09:57:44.398082 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:44.397677 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtxmk" event={"ID":"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570","Type":"ContainerDied","Data":"0c56c5f6d43fbf0fc92784696694ff8ab15a0728375b6edd7260b5baaf6b5139"} Jul 20 09:57:45.254282 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:45.254257 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:45.254430 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:45.254341 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:46.251915 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:46.251741 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:46.252277 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:46.251792 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:46.252277 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:46.251991 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:46.252277 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:46.252053 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:46.404262 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:46.404226 2564 generic.go:356] "Generic (PLEG): container finished" podID="89ab4d5e-0f3e-48ee-83ff-5d5d940a8570" containerID="76eecd8e5eb5c6f3741bc476c18dc5ede81822dc0dfc29279c2f151c1328e148" exitCode=0 Jul 20 09:57:46.404262 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:46.404264 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtxmk" event={"ID":"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570","Type":"ContainerDied","Data":"76eecd8e5eb5c6f3741bc476c18dc5ede81822dc0dfc29279c2f151c1328e148"} Jul 20 09:57:47.251573 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:47.251544 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:47.251759 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:47.251662 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:48.251614 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:48.251579 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:48.252314 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:48.251696 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:48.252314 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:48.251760 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:48.252314 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:48.251851 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:48.888501 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:48.888467 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:48.888650 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:48.888613 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:48.888692 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:48.888679 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret podName:a7e1ce9e-5b4e-49df-bcbd-1bff98386452 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:20.888663955 +0000 UTC m=+66.147068615 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret") pod "global-pull-secret-syncer-lf8fm" (UID: "a7e1ce9e-5b4e-49df-bcbd-1bff98386452") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:48.989446 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:48.989415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs\") pod \"network-metrics-daemon-mk7cq\" (UID: \"e31e814a-2c84-4b09-a4f3-06fa6c649cfb\") " pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:48.989634 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:48.989565 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:48.989695 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:48.989639 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs podName:e31e814a-2c84-4b09-a4f3-06fa6c649cfb nodeName:}" failed. No retries permitted until 2026-07-20 09:58:20.989618974 +0000 UTC m=+66.248023645 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs") pod "network-metrics-daemon-mk7cq" (UID: "e31e814a-2c84-4b09-a4f3-06fa6c649cfb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:49.090595 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:49.090568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwsmc\" (UniqueName: \"kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc\") pod \"network-check-target-6mxr8\" (UID: \"aa8e2e5f-7dd0-464d-8077-41a497565322\") " pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:49.090778 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:49.090759 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:49.090828 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:49.090786 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:49.090828 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:49.090800 2564 projected.go:196] Error preparing data for projected volume kube-api-access-kwsmc for pod openshift-network-diagnostics/network-check-target-6mxr8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:49.090914 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:49.090852 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc podName:aa8e2e5f-7dd0-464d-8077-41a497565322 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:21.090839421 +0000 UTC m=+66.349244088 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwsmc" (UniqueName: "kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc") pod "network-check-target-6mxr8" (UID: "aa8e2e5f-7dd0-464d-8077-41a497565322") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:49.252043 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:49.251962 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:49.252479 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:49.252068 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mxr8" podUID="aa8e2e5f-7dd0-464d-8077-41a497565322" Jul 20 09:57:50.251387 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.251360 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:50.251592 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.251360 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:50.251592 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:50.251509 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk7cq" podUID="e31e814a-2c84-4b09-a4f3-06fa6c649cfb" Jul 20 09:57:50.251711 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:50.251584 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lf8fm" podUID="a7e1ce9e-5b4e-49df-bcbd-1bff98386452" Jul 20 09:57:50.544876 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.544856 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeReady" Jul 20 09:57:50.545332 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.544965 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 09:57:50.588711 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.588687 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8d6l7"] Jul 20 09:57:50.610692 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.610659 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7c6jg"] Jul 20 09:57:50.610813 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.610797 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:50.614028 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.613996 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 09:57:50.614153 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.614046 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l5b2l\"" Jul 20 09:57:50.614306 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.614284 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 09:57:50.622850 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.622833 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8d6l7"] Jul 20 09:57:50.622940 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.622862 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7c6jg"] Jul 20 09:57:50.622940 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.622928 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7c6jg" Jul 20 09:57:50.634227 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.634183 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-84ttf\"" Jul 20 09:57:50.634227 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.634211 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 09:57:50.634671 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.634651 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 09:57:50.634768 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.634734 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 09:57:50.700814 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.700783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:50.700814 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.700816 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/480a8435-e56c-4ef7-9fe8-2e561760616a-tmp-dir\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:50.701003 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.700843 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/480a8435-e56c-4ef7-9fe8-2e561760616a-config-volume\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:50.701003 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.700907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlc8b\" (UniqueName: \"kubernetes.io/projected/480a8435-e56c-4ef7-9fe8-2e561760616a-kube-api-access-jlc8b\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:50.801685 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.801627 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/480a8435-e56c-4ef7-9fe8-2e561760616a-config-volume\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:50.801774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.801688 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt994\" (UniqueName: \"kubernetes.io/projected/f47dca99-e127-4cca-8468-cdfeb4b56539-kube-api-access-wt994\") pod \"ingress-canary-7c6jg\" (UID: \"f47dca99-e127-4cca-8468-cdfeb4b56539\") " pod="openshift-ingress-canary/ingress-canary-7c6jg" Jul 20 09:57:50.801774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.801711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f47dca99-e127-4cca-8468-cdfeb4b56539-cert\") pod \"ingress-canary-7c6jg\" (UID: \"f47dca99-e127-4cca-8468-cdfeb4b56539\") " pod="openshift-ingress-canary/ingress-canary-7c6jg" Jul 20 09:57:50.801774 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.801731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlc8b\" (UniqueName: \"kubernetes.io/projected/480a8435-e56c-4ef7-9fe8-2e561760616a-kube-api-access-jlc8b\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:50.801891 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.801794 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:50.801891 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.801810 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/480a8435-e56c-4ef7-9fe8-2e561760616a-tmp-dir\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:50.801961 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:50.801910 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:50.802002 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:50.801976 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls podName:480a8435-e56c-4ef7-9fe8-2e561760616a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:51.301955108 +0000 UTC m=+36.560359767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls") pod "dns-default-8d6l7" (UID: "480a8435-e56c-4ef7-9fe8-2e561760616a") : secret "dns-default-metrics-tls" not found Jul 20 09:57:50.802283 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.802266 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/480a8435-e56c-4ef7-9fe8-2e561760616a-config-volume\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:50.813032 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.813013 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/480a8435-e56c-4ef7-9fe8-2e561760616a-tmp-dir\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:50.823621 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.823596 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlc8b\" (UniqueName: \"kubernetes.io/projected/480a8435-e56c-4ef7-9fe8-2e561760616a-kube-api-access-jlc8b\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:50.902394 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.902372 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt994\" (UniqueName: \"kubernetes.io/projected/f47dca99-e127-4cca-8468-cdfeb4b56539-kube-api-access-wt994\") pod \"ingress-canary-7c6jg\" (UID: \"f47dca99-e127-4cca-8468-cdfeb4b56539\") " pod="openshift-ingress-canary/ingress-canary-7c6jg" Jul 20 09:57:50.902493 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.902402 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f47dca99-e127-4cca-8468-cdfeb4b56539-cert\") pod \"ingress-canary-7c6jg\" (UID: \"f47dca99-e127-4cca-8468-cdfeb4b56539\") " pod="openshift-ingress-canary/ingress-canary-7c6jg" Jul 20 09:57:50.904404 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.904383 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f47dca99-e127-4cca-8468-cdfeb4b56539-cert\") pod \"ingress-canary-7c6jg\" (UID: \"f47dca99-e127-4cca-8468-cdfeb4b56539\") " pod="openshift-ingress-canary/ingress-canary-7c6jg" Jul 20 09:57:50.917059 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.917041 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt994\" (UniqueName: \"kubernetes.io/projected/f47dca99-e127-4cca-8468-cdfeb4b56539-kube-api-access-wt994\") pod \"ingress-canary-7c6jg\" (UID: \"f47dca99-e127-4cca-8468-cdfeb4b56539\") " pod="openshift-ingress-canary/ingress-canary-7c6jg" Jul 20 09:57:50.930529 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:50.930506 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7c6jg" Jul 20 09:57:51.053975 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:51.053769 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7c6jg"] Jul 20 09:57:51.057791 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:57:51.057769 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47dca99_e127_4cca_8468_cdfeb4b56539.slice/crio-981d336234c5cfcd53cbc8c203b0db929207b7ae24f2c7c08a60bc57b2966933 WatchSource:0}: Error finding container 981d336234c5cfcd53cbc8c203b0db929207b7ae24f2c7c08a60bc57b2966933: Status 404 returned error can't find the container with id 981d336234c5cfcd53cbc8c203b0db929207b7ae24f2c7c08a60bc57b2966933 Jul 20 09:57:51.251793 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:51.251765 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:57:51.254042 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:51.254017 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 09:57:51.254184 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:51.254016 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 09:57:51.254184 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:51.254107 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wrt6f\"" Jul 20 09:57:51.305593 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:51.305547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:51.305698 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:51.305682 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:51.305744 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:51.305735 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls podName:480a8435-e56c-4ef7-9fe8-2e561760616a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:52.305720188 +0000 UTC m=+37.564124842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls") pod "dns-default-8d6l7" (UID: "480a8435-e56c-4ef7-9fe8-2e561760616a") : secret "dns-default-metrics-tls" not found Jul 20 09:57:51.416881 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:51.416845 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7c6jg" event={"ID":"f47dca99-e127-4cca-8468-cdfeb4b56539","Type":"ContainerStarted","Data":"981d336234c5cfcd53cbc8c203b0db929207b7ae24f2c7c08a60bc57b2966933"} Jul 20 09:57:51.419950 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:51.419904 2564 generic.go:356] "Generic (PLEG): container finished" podID="89ab4d5e-0f3e-48ee-83ff-5d5d940a8570" containerID="33feebda1dd2b3d94267c24328e78626cab5e6dddb7ab6a305bba83fdff19573" exitCode=0 Jul 20 09:57:51.419950 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:51.419942 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtxmk" event={"ID":"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570","Type":"ContainerDied","Data":"33feebda1dd2b3d94267c24328e78626cab5e6dddb7ab6a305bba83fdff19573"} Jul 20 09:57:52.251691 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:52.251661 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:57:52.252237 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:52.251661 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:57:52.253990 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:52.253970 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 09:57:52.254315 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:52.254297 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8dwl2\"" Jul 20 09:57:52.254416 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:52.254349 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 09:57:52.311967 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:52.311942 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:52.312114 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:52.312072 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:52.312182 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:52.312140 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls podName:480a8435-e56c-4ef7-9fe8-2e561760616a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:54.312121658 +0000 UTC m=+39.570526326 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls") pod "dns-default-8d6l7" (UID: "480a8435-e56c-4ef7-9fe8-2e561760616a") : secret "dns-default-metrics-tls" not found Jul 20 09:57:52.425449 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:52.425415 2564 generic.go:356] "Generic (PLEG): container finished" podID="89ab4d5e-0f3e-48ee-83ff-5d5d940a8570" containerID="f4e1f454e89b4f9c68482e15c46970bdb82a07648e021035d5a4192b8727138f" exitCode=0 Jul 20 09:57:52.425597 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:52.425467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtxmk" event={"ID":"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570","Type":"ContainerDied","Data":"f4e1f454e89b4f9c68482e15c46970bdb82a07648e021035d5a4192b8727138f"} Jul 20 09:57:53.434496 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:53.434286 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtxmk" event={"ID":"89ab4d5e-0f3e-48ee-83ff-5d5d940a8570","Type":"ContainerStarted","Data":"9110b88c36f8a5b6364cf5f82c19690717a8f1c884ff74951ce6f41ace398425"} Jul 20 09:57:53.435634 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:53.435612 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7c6jg" event={"ID":"f47dca99-e127-4cca-8468-cdfeb4b56539","Type":"ContainerStarted","Data":"581258341e66a398494161c8e9b6ebab866db5fd973711055672a17d38cbea25"} Jul 20 09:57:53.457477 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:53.457418 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mtxmk" podStartSLOduration=9.063869272 podStartE2EDuration="38.457404227s" totalImagesPullingTime="29.393534955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:53.456155936 +0000 UTC m=+38.714560612" watchObservedRunningTime="2026-07-20 09:57:53.457404227 +0000 UTC m=+38.715808905" Jul 20 09:57:53.472121 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:53.472079 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7c6jg" podStartSLOduration=1.525494455 podStartE2EDuration="3.472064705s" totalImagesPullingTime="1.94657025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:53.471163486 +0000 UTC m=+38.729568159" watchObservedRunningTime="2026-07-20 09:57:53.472064705 +0000 UTC m=+38.730469373" Jul 20 09:57:54.323959 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:54.323913 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:54.324125 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:54.324054 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:54.324125 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:54.324114 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls podName:480a8435-e56c-4ef7-9fe8-2e561760616a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:58.324098155 +0000 UTC m=+43.582502811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls") pod "dns-default-8d6l7" (UID: "480a8435-e56c-4ef7-9fe8-2e561760616a") : secret "dns-default-metrics-tls" not found Jul 20 09:57:58.351160 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:57:58.351120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:57:58.351577 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:58.351260 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:58.351577 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:57:58.351324 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls podName:480a8435-e56c-4ef7-9fe8-2e561760616a nodeName:}" failed. No retries permitted until 2026-07-20 09:58:06.351307269 +0000 UTC m=+51.609711923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls") pod "dns-default-8d6l7" (UID: "480a8435-e56c-4ef7-9fe8-2e561760616a") : secret "dns-default-metrics-tls" not found Jul 20 09:58:06.405856 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:06.405819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:58:06.406321 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:06.405924 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:58:06.406321 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:06.405976 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls podName:480a8435-e56c-4ef7-9fe8-2e561760616a nodeName:}" failed. No retries permitted until 2026-07-20 09:58:22.405961126 +0000 UTC m=+67.664365780 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls") pod "dns-default-8d6l7" (UID: "480a8435-e56c-4ef7-9fe8-2e561760616a") : secret "dns-default-metrics-tls" not found Jul 20 09:58:15.419786 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:15.419762 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65jsj" Jul 20 09:58:16.834391 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.834354 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-9f4gs"] Jul 20 09:58:16.836755 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.836737 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.839699 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.839676 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bgql5\"" Jul 20 09:58:16.839699 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.839698 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 20 09:58:16.840049 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.840035 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 09:58:16.840251 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.840233 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 20 09:58:16.842310 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.842293 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 09:58:16.846987 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.846968 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 20 09:58:16.855248 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.855231 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-9f4gs"] Jul 20 09:58:16.870344 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.870320 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0509b165-52b1-452f-9d81-993c6ebe528e-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.870431 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.870345 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0509b165-52b1-452f-9d81-993c6ebe528e-service-ca-bundle\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.870431 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.870367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgxv8\" (UniqueName: \"kubernetes.io/projected/0509b165-52b1-452f-9d81-993c6ebe528e-kube-api-access-vgxv8\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.870431 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.870384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0509b165-52b1-452f-9d81-993c6ebe528e-serving-cert\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.870559 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.870523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0509b165-52b1-452f-9d81-993c6ebe528e-tmp\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.870559 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.870546 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0509b165-52b1-452f-9d81-993c6ebe528e-snapshots\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.971134 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.971109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0509b165-52b1-452f-9d81-993c6ebe528e-tmp\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.971134 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.971134 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0509b165-52b1-452f-9d81-993c6ebe528e-snapshots\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.971277 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.971152 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0509b165-52b1-452f-9d81-993c6ebe528e-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.971277 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.971167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0509b165-52b1-452f-9d81-993c6ebe528e-service-ca-bundle\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.971277 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.971189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgxv8\" (UniqueName: \"kubernetes.io/projected/0509b165-52b1-452f-9d81-993c6ebe528e-kube-api-access-vgxv8\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.971277 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.971209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0509b165-52b1-452f-9d81-993c6ebe528e-serving-cert\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.971740 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.971718 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0509b165-52b1-452f-9d81-993c6ebe528e-tmp\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.971838 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.971795 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0509b165-52b1-452f-9d81-993c6ebe528e-snapshots\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.971884 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.971858 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0509b165-52b1-452f-9d81-993c6ebe528e-service-ca-bundle\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.972217 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.972201 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0509b165-52b1-452f-9d81-993c6ebe528e-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.974990 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.974971 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0509b165-52b1-452f-9d81-993c6ebe528e-serving-cert\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:16.980899 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:16.980876 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgxv8\" (UniqueName: \"kubernetes.io/projected/0509b165-52b1-452f-9d81-993c6ebe528e-kube-api-access-vgxv8\") pod \"insights-operator-555d9d7885-9f4gs\" (UID: \"0509b165-52b1-452f-9d81-993c6ebe528e\") " pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:17.145792 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:17.145764 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-9f4gs" Jul 20 09:58:17.282935 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:17.282898 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-9f4gs"] Jul 20 09:58:17.286579 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:58:17.286554 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0509b165_52b1_452f_9d81_993c6ebe528e.slice/crio-72f9b9bdf1c492cea45f4e43e9aadb0939e65d259e8728fb926e8152f58c5aa7 WatchSource:0}: Error finding container 72f9b9bdf1c492cea45f4e43e9aadb0939e65d259e8728fb926e8152f58c5aa7: Status 404 returned error can't find the container with id 72f9b9bdf1c492cea45f4e43e9aadb0939e65d259e8728fb926e8152f58c5aa7 Jul 20 09:58:17.488139 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:17.488071 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-9f4gs" event={"ID":"0509b165-52b1-452f-9d81-993c6ebe528e","Type":"ContainerStarted","Data":"72f9b9bdf1c492cea45f4e43e9aadb0939e65d259e8728fb926e8152f58c5aa7"} Jul 20 09:58:19.493938 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:19.493904 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-9f4gs" event={"ID":"0509b165-52b1-452f-9d81-993c6ebe528e","Type":"ContainerStarted","Data":"84c3dd0eb29d0ab119b837331eb2d992224c0c211ab1c05bb3d834aa89b192ee"} Jul 20 09:58:19.519066 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:19.519025 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-9f4gs" podStartSLOduration=1.8458713420000001 podStartE2EDuration="3.519010323s" totalImagesPullingTime="1.673138981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:19.518753097 +0000 UTC m=+64.777157773" watchObservedRunningTime="2026-07-20 09:58:19.519010323 +0000 UTC m=+64.777414999" Jul 20 09:58:19.908409 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:19.908374 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gzrt4"] Jul 20 09:58:19.910541 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:19.910526 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:19.912389 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:19.912369 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 09:58:19.912543 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:19.912490 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 09:58:19.912543 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:19.912498 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nffcc\"" Jul 20 09:58:19.921690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:19.921623 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gzrt4"] Jul 20 09:58:19.989925 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:19.989898 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:19.989925 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:19.989928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8ktj\" (UniqueName: \"kubernetes.io/projected/f683429f-cd6a-450d-90ad-a34afdd67739-kube-api-access-x8ktj\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:19.990107 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:19.990018 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f683429f-cd6a-450d-90ad-a34afdd67739-crio-socket\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:19.990107 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:19.990079 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:19.990175 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:19.990126 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f683429f-cd6a-450d-90ad-a34afdd67739-data-volume\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:20.091368 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:20.091339 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f683429f-cd6a-450d-90ad-a34afdd67739-data-volume\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:20.091368 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:20.091370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:20.091560 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:20.091388 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8ktj\" (UniqueName: \"kubernetes.io/projected/f683429f-cd6a-450d-90ad-a34afdd67739-kube-api-access-x8ktj\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:20.091560 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:20.091512 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:20.091637 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:20.091580 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls podName:f683429f-cd6a-450d-90ad-a34afdd67739 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:20.59156215 +0000 UTC m=+65.849966810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gzrt4" (UID: "f683429f-cd6a-450d-90ad-a34afdd67739") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:20.091637 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:20.091610 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f683429f-cd6a-450d-90ad-a34afdd67739-crio-socket\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:20.091724 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:20.091637 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:20.091724 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:20.091697 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f683429f-cd6a-450d-90ad-a34afdd67739-crio-socket\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:20.091724 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:20.091700 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f683429f-cd6a-450d-90ad-a34afdd67739-data-volume\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:20.091724 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:20.091721 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:20.091858 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:20.091767 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm podName:f683429f-cd6a-450d-90ad-a34afdd67739 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:20.591754861 +0000 UTC m=+65.850159532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gzrt4" (UID: "f683429f-cd6a-450d-90ad-a34afdd67739") : configmap "kube-rbac-proxy" not found Jul 20 09:58:20.099051 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:20.099030 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8ktj\" (UniqueName: \"kubernetes.io/projected/f683429f-cd6a-450d-90ad-a34afdd67739-kube-api-access-x8ktj\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:20.595458 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:20.595409 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:20.595883 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:20.595492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:20.595883 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:20.595556 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:20.595883 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:20.595620 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm podName:f683429f-cd6a-450d-90ad-a34afdd67739 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:21.595601353 +0000 UTC m=+66.854006008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gzrt4" (UID: "f683429f-cd6a-450d-90ad-a34afdd67739") : configmap "kube-rbac-proxy" not found Jul 20 09:58:20.595883 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:20.595620 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:20.595883 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:20.595699 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls podName:f683429f-cd6a-450d-90ad-a34afdd67739 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:21.595682483 +0000 UTC m=+66.854087140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gzrt4" (UID: "f683429f-cd6a-450d-90ad-a34afdd67739") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:20.897695 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:20.897660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:58:20.899694 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:20.899672 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 09:58:20.910653 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:20.910627 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e1ce9e-5b4e-49df-bcbd-1bff98386452-original-pull-secret\") pod \"global-pull-secret-syncer-lf8fm\" (UID: \"a7e1ce9e-5b4e-49df-bcbd-1bff98386452\") " pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:58:20.998646 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:20.998612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs\") pod \"network-metrics-daemon-mk7cq\" (UID: \"e31e814a-2c84-4b09-a4f3-06fa6c649cfb\") " pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:58:21.000828 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.000812 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 09:58:21.009370 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:21.009353 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 09:58:21.009432 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:21.009402 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs podName:e31e814a-2c84-4b09-a4f3-06fa6c649cfb nodeName:}" failed. No retries permitted until 2026-07-20 09:59:25.009388663 +0000 UTC m=+130.267793320 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs") pod "network-metrics-daemon-mk7cq" (UID: "e31e814a-2c84-4b09-a4f3-06fa6c649cfb") : secret "metrics-daemon-secret" not found Jul 20 09:58:21.069710 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.069688 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lf8fm" Jul 20 09:58:21.099395 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.099368 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwsmc\" (UniqueName: \"kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc\") pod \"network-check-target-6mxr8\" (UID: \"aa8e2e5f-7dd0-464d-8077-41a497565322\") " pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:58:21.101685 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.101669 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 09:58:21.112121 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.112099 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 09:58:21.123144 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.123120 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwsmc\" (UniqueName: \"kubernetes.io/projected/aa8e2e5f-7dd0-464d-8077-41a497565322-kube-api-access-kwsmc\") pod \"network-check-target-6mxr8\" (UID: \"aa8e2e5f-7dd0-464d-8077-41a497565322\") " pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:58:21.185725 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.185669 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lf8fm"] Jul 20 09:58:21.189233 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:58:21.189208 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e1ce9e_5b4e_49df_bcbd_1bff98386452.slice/crio-f3c599c3311730c6f98d4576c345b3f4787b1fe4e575281b4737791a6dfe99b2 WatchSource:0}: Error finding container f3c599c3311730c6f98d4576c345b3f4787b1fe4e575281b4737791a6dfe99b2: Status 404 returned error can't find the container with id f3c599c3311730c6f98d4576c345b3f4787b1fe4e575281b4737791a6dfe99b2 Jul 20 09:58:21.266482 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.266456 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wrt6f\"" Jul 20 09:58:21.271353 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.271338 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:58:21.394014 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.393986 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6mxr8"] Jul 20 09:58:21.397406 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:58:21.397377 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8e2e5f_7dd0_464d_8077_41a497565322.slice/crio-2b7453ef62208760b156fab42bc7beb40ac4da86d1e59cba2277c8734b53314a WatchSource:0}: Error finding container 2b7453ef62208760b156fab42bc7beb40ac4da86d1e59cba2277c8734b53314a: Status 404 returned error can't find the container with id 2b7453ef62208760b156fab42bc7beb40ac4da86d1e59cba2277c8734b53314a Jul 20 09:58:21.500413 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.500333 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6mxr8" event={"ID":"aa8e2e5f-7dd0-464d-8077-41a497565322","Type":"ContainerStarted","Data":"2b7453ef62208760b156fab42bc7beb40ac4da86d1e59cba2277c8734b53314a"} Jul 20 09:58:21.501335 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.501303 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lf8fm" event={"ID":"a7e1ce9e-5b4e-49df-bcbd-1bff98386452","Type":"ContainerStarted","Data":"f3c599c3311730c6f98d4576c345b3f4787b1fe4e575281b4737791a6dfe99b2"} Jul 20 09:58:21.603275 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.603247 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:21.603681 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.603308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:21.603681 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:21.603389 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:21.603681 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:21.603408 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:21.603681 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:21.603493 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm podName:f683429f-cd6a-450d-90ad-a34afdd67739 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:23.603471319 +0000 UTC m=+68.861875987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gzrt4" (UID: "f683429f-cd6a-450d-90ad-a34afdd67739") : configmap "kube-rbac-proxy" not found Jul 20 09:58:21.603681 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:21.603525 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls podName:f683429f-cd6a-450d-90ad-a34afdd67739 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:23.603505661 +0000 UTC m=+68.861910321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gzrt4" (UID: "f683429f-cd6a-450d-90ad-a34afdd67739") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:21.778000 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:21.777928 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-656q7_65e05599-9f05-4924-8d90-d0c4a7a7f4aa/dns-node-resolver/0.log" Jul 20 09:58:22.412061 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:22.412000 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:58:22.412314 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:22.412151 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:58:22.412314 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:22.412219 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls podName:480a8435-e56c-4ef7-9fe8-2e561760616a nodeName:}" failed. No retries permitted until 2026-07-20 09:58:54.412200461 +0000 UTC m=+99.670605129 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls") pod "dns-default-8d6l7" (UID: "480a8435-e56c-4ef7-9fe8-2e561760616a") : secret "dns-default-metrics-tls" not found Jul 20 09:58:22.977723 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:22.977694 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vmtp7_afa7dced-205f-4733-a059-fbd59fb79687/node-ca/0.log" Jul 20 09:58:23.378469 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:23.378416 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7c6jg_f47dca99-e127-4cca-8468-cdfeb4b56539/serve-healthcheck-canary/0.log" Jul 20 09:58:23.620148 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:23.620114 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:23.620341 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:23.620187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:23.620341 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:23.620270 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:23.620341 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:23.620321 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:23.620543 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:23.620344 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm podName:f683429f-cd6a-450d-90ad-a34afdd67739 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:27.620321886 +0000 UTC m=+72.878726541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gzrt4" (UID: "f683429f-cd6a-450d-90ad-a34afdd67739") : configmap "kube-rbac-proxy" not found Jul 20 09:58:23.620543 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:23.620371 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls podName:f683429f-cd6a-450d-90ad-a34afdd67739 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:27.620355902 +0000 UTC m=+72.878760557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gzrt4" (UID: "f683429f-cd6a-450d-90ad-a34afdd67739") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:26.517219 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.517187 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6mxr8" event={"ID":"aa8e2e5f-7dd0-464d-8077-41a497565322","Type":"ContainerStarted","Data":"9be10c92638a37f7d0b6fa89be3ff9b4ff78ea87a82ef1192064f3f70e3aa5e9"} Jul 20 09:58:26.517676 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.517300 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:58:26.518697 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.518675 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lf8fm" event={"ID":"a7e1ce9e-5b4e-49df-bcbd-1bff98386452","Type":"ContainerStarted","Data":"9b9d0ecc50bf8b48245fe9290888686a84cff1cd27b2232cc016f89e5566b1af"} Jul 20 09:58:26.533982 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.533943 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6mxr8" podStartSLOduration=66.929738783 podStartE2EDuration="1m11.533931359s" totalImagesPullingTime="4.604192576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:26.533643385 +0000 UTC m=+71.792048060" watchObservedRunningTime="2026-07-20 09:58:26.533931359 +0000 UTC m=+71.792336013" Jul 20 09:58:26.551295 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.551260 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lf8fm" podStartSLOduration=66.728050674 podStartE2EDuration="1m11.551247689s" totalImagesPullingTime="4.823197015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:26.550781194 +0000 UTC m=+71.809185869" watchObservedRunningTime="2026-07-20 09:58:26.551247689 +0000 UTC m=+71.809652364" Jul 20 09:58:26.765612 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.765585 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8"] Jul 20 09:58:26.785118 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.785064 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf"] Jul 20 09:58:26.785222 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.785181 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" Jul 20 09:58:26.787223 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.787201 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 20 09:58:26.787485 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.787470 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 20 09:58:26.787571 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.787490 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:58:26.787571 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.787490 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mn78d\"" Jul 20 09:58:26.787674 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.787620 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 20 09:58:26.809154 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.809137 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5"] Jul 20 09:58:26.809263 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.809247 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" Jul 20 09:58:26.811395 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.811378 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 20 09:58:26.811506 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.811452 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 20 09:58:26.811506 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.811453 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 20 09:58:26.811506 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.811429 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7sdqb\"" Jul 20 09:58:26.811676 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.811501 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:58:26.833289 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.833270 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8"] Jul 20 09:58:26.833381 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.833297 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf"] Jul 20 09:58:26.833381 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.833311 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5"] Jul 20 09:58:26.833475 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.833398 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" Jul 20 09:58:26.835310 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.835290 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 20 09:58:26.835409 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.835371 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 20 09:58:26.835409 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.835384 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:58:26.835645 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.835631 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7wmbz\"" Jul 20 09:58:26.845793 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.845774 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v7r5\" (UniqueName: \"kubernetes.io/projected/105b6b48-12fc-4221-901d-59b4fedcc6c0-kube-api-access-5v7r5\") pod \"kube-storage-version-migrator-operator-7658d9b749-zb7t8\" (UID: \"105b6b48-12fc-4221-901d-59b4fedcc6c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" Jul 20 09:58:26.845873 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.845803 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/105b6b48-12fc-4221-901d-59b4fedcc6c0-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zb7t8\" (UID: \"105b6b48-12fc-4221-901d-59b4fedcc6c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" Jul 20 09:58:26.845873 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.845853 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6w79\" (UniqueName: \"kubernetes.io/projected/24ba0b57-9337-45c9-9134-e17cd547da3a-kube-api-access-p6w79\") pod \"service-ca-operator-5bcbc94c78-4fbtf\" (UID: \"24ba0b57-9337-45c9-9134-e17cd547da3a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" Jul 20 09:58:26.845959 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.845888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24ba0b57-9337-45c9-9134-e17cd547da3a-config\") pod \"service-ca-operator-5bcbc94c78-4fbtf\" (UID: \"24ba0b57-9337-45c9-9134-e17cd547da3a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" Jul 20 09:58:26.845959 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.845905 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24ba0b57-9337-45c9-9134-e17cd547da3a-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4fbtf\" (UID: \"24ba0b57-9337-45c9-9134-e17cd547da3a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" Jul 20 09:58:26.845959 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.845921 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/105b6b48-12fc-4221-901d-59b4fedcc6c0-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zb7t8\" (UID: \"105b6b48-12fc-4221-901d-59b4fedcc6c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" Jul 20 09:58:26.863767 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.863746 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kbkhp"] Jul 20 09:58:26.887938 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.887919 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kbkhp"] Jul 20 09:58:26.888015 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.887995 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:26.890049 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.889854 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 20 09:58:26.890049 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.889926 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 20 09:58:26.890049 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.889939 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:58:26.890049 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.890005 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-cjpkw\"" Jul 20 09:58:26.890292 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.890052 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 20 09:58:26.895408 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.895390 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 20 09:58:26.946378 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.946358 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9cdea504-c1e9-4868-affe-0810dbd583f2-config\") pod \"console-operator-565b7b569d-kbkhp\" (UID: \"9cdea504-c1e9-4868-affe-0810dbd583f2\") " pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:26.946481 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.946402 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrxw6\" (UniqueName: \"kubernetes.io/projected/9cdea504-c1e9-4868-affe-0810dbd583f2-kube-api-access-xrxw6\") pod \"console-operator-565b7b569d-kbkhp\" (UID: \"9cdea504-c1e9-4868-affe-0810dbd583f2\") " pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:26.946481 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.946427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6w79\" (UniqueName: \"kubernetes.io/projected/24ba0b57-9337-45c9-9134-e17cd547da3a-kube-api-access-p6w79\") pod \"service-ca-operator-5bcbc94c78-4fbtf\" (UID: \"24ba0b57-9337-45c9-9134-e17cd547da3a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" Jul 20 09:58:26.946561 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.946487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9cdea504-c1e9-4868-affe-0810dbd583f2-serving-cert\") pod \"console-operator-565b7b569d-kbkhp\" (UID: \"9cdea504-c1e9-4868-affe-0810dbd583f2\") " pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:26.946561 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.946532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cdea504-c1e9-4868-affe-0810dbd583f2-trusted-ca\") pod \"console-operator-565b7b569d-kbkhp\" (UID: \"9cdea504-c1e9-4868-affe-0810dbd583f2\") " pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:26.946619 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.946562 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/105b6b48-12fc-4221-901d-59b4fedcc6c0-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zb7t8\" (UID: \"105b6b48-12fc-4221-901d-59b4fedcc6c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" Jul 20 09:58:26.946682 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.946665 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24ba0b57-9337-45c9-9134-e17cd547da3a-config\") pod \"service-ca-operator-5bcbc94c78-4fbtf\" (UID: \"24ba0b57-9337-45c9-9134-e17cd547da3a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" Jul 20 09:58:26.946719 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.946691 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/105b6b48-12fc-4221-901d-59b4fedcc6c0-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zb7t8\" (UID: \"105b6b48-12fc-4221-901d-59b4fedcc6c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" Jul 20 09:58:26.946751 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.946713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24ba0b57-9337-45c9-9134-e17cd547da3a-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4fbtf\" (UID: \"24ba0b57-9337-45c9-9134-e17cd547da3a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" Jul 20 09:58:26.946788 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.946774 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r9wl5\" (UID: \"1b0cfbc3-2103-436c-b4a8-459d7525cf72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" Jul 20 09:58:26.946821 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.946809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v7r5\" (UniqueName: \"kubernetes.io/projected/105b6b48-12fc-4221-901d-59b4fedcc6c0-kube-api-access-5v7r5\") pod \"kube-storage-version-migrator-operator-7658d9b749-zb7t8\" (UID: \"105b6b48-12fc-4221-901d-59b4fedcc6c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" Jul 20 09:58:26.946868 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.946832 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8qwq\" (UniqueName: \"kubernetes.io/projected/1b0cfbc3-2103-436c-b4a8-459d7525cf72-kube-api-access-x8qwq\") pod \"cluster-samples-operator-79b7c55f87-r9wl5\" (UID: \"1b0cfbc3-2103-436c-b4a8-459d7525cf72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" Jul 20 09:58:26.947109 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.947087 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/105b6b48-12fc-4221-901d-59b4fedcc6c0-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zb7t8\" (UID: \"105b6b48-12fc-4221-901d-59b4fedcc6c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" Jul 20 09:58:26.947263 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.947245 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24ba0b57-9337-45c9-9134-e17cd547da3a-config\") pod \"service-ca-operator-5bcbc94c78-4fbtf\" (UID: \"24ba0b57-9337-45c9-9134-e17cd547da3a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" Jul 20 09:58:26.948838 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.948822 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24ba0b57-9337-45c9-9134-e17cd547da3a-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4fbtf\" (UID: \"24ba0b57-9337-45c9-9134-e17cd547da3a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" Jul 20 09:58:26.948917 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.948893 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/105b6b48-12fc-4221-901d-59b4fedcc6c0-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zb7t8\" (UID: \"105b6b48-12fc-4221-901d-59b4fedcc6c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" Jul 20 09:58:26.953698 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.953680 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6w79\" (UniqueName: \"kubernetes.io/projected/24ba0b57-9337-45c9-9134-e17cd547da3a-kube-api-access-p6w79\") pod \"service-ca-operator-5bcbc94c78-4fbtf\" (UID: \"24ba0b57-9337-45c9-9134-e17cd547da3a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" Jul 20 09:58:26.953826 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:26.953810 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v7r5\" (UniqueName: \"kubernetes.io/projected/105b6b48-12fc-4221-901d-59b4fedcc6c0-kube-api-access-5v7r5\") pod \"kube-storage-version-migrator-operator-7658d9b749-zb7t8\" (UID: \"105b6b48-12fc-4221-901d-59b4fedcc6c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" Jul 20 09:58:27.047511 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.047421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r9wl5\" (UID: \"1b0cfbc3-2103-436c-b4a8-459d7525cf72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" Jul 20 09:58:27.047511 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.047473 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8qwq\" (UniqueName: \"kubernetes.io/projected/1b0cfbc3-2103-436c-b4a8-459d7525cf72-kube-api-access-x8qwq\") pod \"cluster-samples-operator-79b7c55f87-r9wl5\" (UID: \"1b0cfbc3-2103-436c-b4a8-459d7525cf72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" Jul 20 09:58:27.047511 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.047494 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9cdea504-c1e9-4868-affe-0810dbd583f2-config\") pod \"console-operator-565b7b569d-kbkhp\" (UID: \"9cdea504-c1e9-4868-affe-0810dbd583f2\") " pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:27.047782 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.047528 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrxw6\" (UniqueName: \"kubernetes.io/projected/9cdea504-c1e9-4868-affe-0810dbd583f2-kube-api-access-xrxw6\") pod \"console-operator-565b7b569d-kbkhp\" (UID: \"9cdea504-c1e9-4868-affe-0810dbd583f2\") " pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:27.047782 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.047549 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9cdea504-c1e9-4868-affe-0810dbd583f2-serving-cert\") pod \"console-operator-565b7b569d-kbkhp\" (UID: \"9cdea504-c1e9-4868-affe-0810dbd583f2\") " pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:27.047782 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:27.047555 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 09:58:27.047782 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.047575 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cdea504-c1e9-4868-affe-0810dbd583f2-trusted-ca\") pod \"console-operator-565b7b569d-kbkhp\" (UID: \"9cdea504-c1e9-4868-affe-0810dbd583f2\") " pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:27.047782 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:27.047611 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls podName:1b0cfbc3-2103-436c-b4a8-459d7525cf72 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:27.547596567 +0000 UTC m=+72.806001224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r9wl5" (UID: "1b0cfbc3-2103-436c-b4a8-459d7525cf72") : secret "samples-operator-tls" not found Jul 20 09:58:27.048752 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.048693 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9cdea504-c1e9-4868-affe-0810dbd583f2-config\") pod \"console-operator-565b7b569d-kbkhp\" (UID: \"9cdea504-c1e9-4868-affe-0810dbd583f2\") " pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:27.048875 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.048856 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cdea504-c1e9-4868-affe-0810dbd583f2-trusted-ca\") pod \"console-operator-565b7b569d-kbkhp\" (UID: \"9cdea504-c1e9-4868-affe-0810dbd583f2\") " pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:27.051966 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.050685 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9cdea504-c1e9-4868-affe-0810dbd583f2-serving-cert\") pod \"console-operator-565b7b569d-kbkhp\" (UID: \"9cdea504-c1e9-4868-affe-0810dbd583f2\") " pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:27.057597 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.057578 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8qwq\" (UniqueName: \"kubernetes.io/projected/1b0cfbc3-2103-436c-b4a8-459d7525cf72-kube-api-access-x8qwq\") pod \"cluster-samples-operator-79b7c55f87-r9wl5\" (UID: \"1b0cfbc3-2103-436c-b4a8-459d7525cf72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" Jul 20 09:58:27.057689 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.057671 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrxw6\" (UniqueName: \"kubernetes.io/projected/9cdea504-c1e9-4868-affe-0810dbd583f2-kube-api-access-xrxw6\") pod \"console-operator-565b7b569d-kbkhp\" (UID: \"9cdea504-c1e9-4868-affe-0810dbd583f2\") " pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:27.095665 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.095645 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" Jul 20 09:58:27.117199 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.117178 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" Jul 20 09:58:27.196976 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.196938 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:27.223486 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.223410 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8"] Jul 20 09:58:27.226720 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:58:27.226701 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105b6b48_12fc_4221_901d_59b4fedcc6c0.slice/crio-1865486ae072fad52fbe87d7ed87fe2f1ed55bfc8297832d0ac36917a6f30eca WatchSource:0}: Error finding container 1865486ae072fad52fbe87d7ed87fe2f1ed55bfc8297832d0ac36917a6f30eca: Status 404 returned error can't find the container with id 1865486ae072fad52fbe87d7ed87fe2f1ed55bfc8297832d0ac36917a6f30eca Jul 20 09:58:27.239105 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.238921 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf"] Jul 20 09:58:27.243385 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:58:27.243362 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ba0b57_9337_45c9_9134_e17cd547da3a.slice/crio-ae10eb3d743a904bdb14c938074a319062d847e83faff1fbbed58dfddff8b50e WatchSource:0}: Error finding container ae10eb3d743a904bdb14c938074a319062d847e83faff1fbbed58dfddff8b50e: Status 404 returned error can't find the container with id ae10eb3d743a904bdb14c938074a319062d847e83faff1fbbed58dfddff8b50e Jul 20 09:58:27.325266 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.325193 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kbkhp"] Jul 20 09:58:27.328613 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:58:27.328591 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cdea504_c1e9_4868_affe_0810dbd583f2.slice/crio-e7362e646f87d6f4839542d60370ca34a44ffc8c88fbf3ab8357ab5e08c10288 WatchSource:0}: Error finding container e7362e646f87d6f4839542d60370ca34a44ffc8c88fbf3ab8357ab5e08c10288: Status 404 returned error can't find the container with id e7362e646f87d6f4839542d60370ca34a44ffc8c88fbf3ab8357ab5e08c10288 Jul 20 09:58:27.522148 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.522108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" event={"ID":"9cdea504-c1e9-4868-affe-0810dbd583f2","Type":"ContainerStarted","Data":"e7362e646f87d6f4839542d60370ca34a44ffc8c88fbf3ab8357ab5e08c10288"} Jul 20 09:58:27.523189 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.523166 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" event={"ID":"24ba0b57-9337-45c9-9134-e17cd547da3a","Type":"ContainerStarted","Data":"ae10eb3d743a904bdb14c938074a319062d847e83faff1fbbed58dfddff8b50e"} Jul 20 09:58:27.524154 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.524130 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" event={"ID":"105b6b48-12fc-4221-901d-59b4fedcc6c0","Type":"ContainerStarted","Data":"1865486ae072fad52fbe87d7ed87fe2f1ed55bfc8297832d0ac36917a6f30eca"} Jul 20 09:58:27.552342 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.552320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r9wl5\" (UID: \"1b0cfbc3-2103-436c-b4a8-459d7525cf72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" Jul 20 09:58:27.552429 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:27.552411 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 09:58:27.552494 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:27.552475 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls podName:1b0cfbc3-2103-436c-b4a8-459d7525cf72 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:28.552462853 +0000 UTC m=+73.810867511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r9wl5" (UID: "1b0cfbc3-2103-436c-b4a8-459d7525cf72") : secret "samples-operator-tls" not found Jul 20 09:58:27.653136 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.653111 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:27.653269 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:27.653184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:27.653269 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:27.653224 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:27.653358 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:27.653269 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:27.653358 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:27.653278 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm podName:f683429f-cd6a-450d-90ad-a34afdd67739 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:35.653264443 +0000 UTC m=+80.911669096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gzrt4" (UID: "f683429f-cd6a-450d-90ad-a34afdd67739") : configmap "kube-rbac-proxy" not found Jul 20 09:58:27.653358 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:27.653306 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls podName:f683429f-cd6a-450d-90ad-a34afdd67739 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:35.65329612 +0000 UTC m=+80.911700774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gzrt4" (UID: "f683429f-cd6a-450d-90ad-a34afdd67739") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:28.560948 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:28.560920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r9wl5\" (UID: \"1b0cfbc3-2103-436c-b4a8-459d7525cf72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" Jul 20 09:58:28.561412 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:28.561105 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 09:58:28.561412 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:28.561189 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls podName:1b0cfbc3-2103-436c-b4a8-459d7525cf72 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:30.56116848 +0000 UTC m=+75.819573154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r9wl5" (UID: "1b0cfbc3-2103-436c-b4a8-459d7525cf72") : secret "samples-operator-tls" not found Jul 20 09:58:30.535349 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:30.535282 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/0.log" Jul 20 09:58:30.535349 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:30.535328 2564 generic.go:356] "Generic (PLEG): container finished" podID="9cdea504-c1e9-4868-affe-0810dbd583f2" containerID="2cf34cea7fe462865474a0175ced69cff20c37c0bb4d7d481cb037a59e74d1c4" exitCode=255 Jul 20 09:58:30.535826 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:30.535408 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" event={"ID":"9cdea504-c1e9-4868-affe-0810dbd583f2","Type":"ContainerDied","Data":"2cf34cea7fe462865474a0175ced69cff20c37c0bb4d7d481cb037a59e74d1c4"} Jul 20 09:58:30.535826 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:30.535620 2564 scope.go:117] "RemoveContainer" containerID="2cf34cea7fe462865474a0175ced69cff20c37c0bb4d7d481cb037a59e74d1c4" Jul 20 09:58:30.536984 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:30.536946 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" event={"ID":"24ba0b57-9337-45c9-9134-e17cd547da3a","Type":"ContainerStarted","Data":"5e12708e5a27480ab99f7eef91182b09881c7a5dcdfa4c5e07b4a4e93b56fe0c"} Jul 20 09:58:30.538730 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:30.538706 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" event={"ID":"105b6b48-12fc-4221-901d-59b4fedcc6c0","Type":"ContainerStarted","Data":"de748430a1bb44eff1271e957fc84a62eaf3a622942285762f1b758ae6a858d8"} Jul 20 09:58:30.570177 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:30.570138 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" podStartSLOduration=1.661470805 podStartE2EDuration="4.570123999s" totalImagesPullingTime="2.908653194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:30.569015232 +0000 UTC m=+75.827419909" watchObservedRunningTime="2026-07-20 09:58:30.570123999 +0000 UTC m=+75.828528674" Jul 20 09:58:30.579362 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:30.579333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r9wl5\" (UID: \"1b0cfbc3-2103-436c-b4a8-459d7525cf72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" Jul 20 09:58:30.579950 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:30.579923 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 09:58:30.580050 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:30.579994 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls podName:1b0cfbc3-2103-436c-b4a8-459d7525cf72 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:34.579976258 +0000 UTC m=+79.838380917 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r9wl5" (UID: "1b0cfbc3-2103-436c-b4a8-459d7525cf72") : secret "samples-operator-tls" not found Jul 20 09:58:30.585462 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:30.584746 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" podStartSLOduration=1.654018492 podStartE2EDuration="4.584729727s" totalImagesPullingTime="2.930711235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:30.584173181 +0000 UTC m=+75.842577874" watchObservedRunningTime="2026-07-20 09:58:30.584729727 +0000 UTC m=+75.843134407" Jul 20 09:58:31.543902 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:31.543873 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/1.log" Jul 20 09:58:31.544335 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:31.544223 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/0.log" Jul 20 09:58:31.544335 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:31.544255 2564 generic.go:356] "Generic (PLEG): container finished" podID="9cdea504-c1e9-4868-affe-0810dbd583f2" containerID="adfc6f98e9277805e8c2da63db6f838b4a2c04b5cf5c25e2578da5fee885dae6" exitCode=255 Jul 20 09:58:31.544464 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:31.544345 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" event={"ID":"9cdea504-c1e9-4868-affe-0810dbd583f2","Type":"ContainerDied","Data":"adfc6f98e9277805e8c2da63db6f838b4a2c04b5cf5c25e2578da5fee885dae6"} Jul 20 09:58:31.544464 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:31.544397 2564 scope.go:117] "RemoveContainer" containerID="2cf34cea7fe462865474a0175ced69cff20c37c0bb4d7d481cb037a59e74d1c4" Jul 20 09:58:31.544660 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:31.544641 2564 scope.go:117] "RemoveContainer" containerID="adfc6f98e9277805e8c2da63db6f838b4a2c04b5cf5c25e2578da5fee885dae6" Jul 20 09:58:31.544855 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:31.544833 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kbkhp_openshift-console-operator(9cdea504-c1e9-4868-affe-0810dbd583f2)\"" pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" podUID="9cdea504-c1e9-4868-affe-0810dbd583f2" Jul 20 09:58:32.549101 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:32.549076 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/1.log" Jul 20 09:58:32.549470 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:32.549374 2564 scope.go:117] "RemoveContainer" containerID="adfc6f98e9277805e8c2da63db6f838b4a2c04b5cf5c25e2578da5fee885dae6" Jul 20 09:58:32.549569 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:32.549549 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kbkhp_openshift-console-operator(9cdea504-c1e9-4868-affe-0810dbd583f2)\"" pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" podUID="9cdea504-c1e9-4868-affe-0810dbd583f2" Jul 20 09:58:34.609088 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:34.609051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r9wl5\" (UID: \"1b0cfbc3-2103-436c-b4a8-459d7525cf72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" Jul 20 09:58:34.609580 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:34.609194 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 09:58:34.609580 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:34.609248 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls podName:1b0cfbc3-2103-436c-b4a8-459d7525cf72 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:42.609234786 +0000 UTC m=+87.867639443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r9wl5" (UID: "1b0cfbc3-2103-436c-b4a8-459d7525cf72") : secret "samples-operator-tls" not found Jul 20 09:58:35.716007 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:35.715976 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:35.716387 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:35.716024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:35.716387 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:35.716133 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:35.716387 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:35.716203 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls podName:f683429f-cd6a-450d-90ad-a34afdd67739 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:51.716184564 +0000 UTC m=+96.974589232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gzrt4" (UID: "f683429f-cd6a-450d-90ad-a34afdd67739") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:35.716640 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:35.716622 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f683429f-cd6a-450d-90ad-a34afdd67739-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:37.197335 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:37.197225 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:37.197335 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:37.197299 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:37.197732 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:37.197613 2564 scope.go:117] "RemoveContainer" containerID="adfc6f98e9277805e8c2da63db6f838b4a2c04b5cf5c25e2578da5fee885dae6" Jul 20 09:58:37.197769 ip-10-0-128-168 kubenswrapper[2564]: E0720 09:58:37.197745 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kbkhp_openshift-console-operator(9cdea504-c1e9-4868-affe-0810dbd583f2)\"" pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" podUID="9cdea504-c1e9-4868-affe-0810dbd583f2" Jul 20 09:58:42.671478 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:42.671404 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r9wl5\" (UID: \"1b0cfbc3-2103-436c-b4a8-459d7525cf72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" Jul 20 09:58:42.673740 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:42.673721 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b0cfbc3-2103-436c-b4a8-459d7525cf72-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r9wl5\" (UID: \"1b0cfbc3-2103-436c-b4a8-459d7525cf72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" Jul 20 09:58:42.741801 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:42.741776 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" Jul 20 09:58:42.861507 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:42.861471 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5"] Jul 20 09:58:43.584721 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:43.584689 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" event={"ID":"1b0cfbc3-2103-436c-b4a8-459d7525cf72","Type":"ContainerStarted","Data":"14e68de4319ed10c2a4fa95ead226ad0b73e339a905482c50d2b72ecba692c6e"} Jul 20 09:58:44.589792 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:44.589760 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" event={"ID":"1b0cfbc3-2103-436c-b4a8-459d7525cf72","Type":"ContainerStarted","Data":"30e272ee365f195d9393c98ae2df5122d37519a32fc692575de5be69ded685b2"} Jul 20 09:58:44.590236 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:44.589808 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" event={"ID":"1b0cfbc3-2103-436c-b4a8-459d7525cf72","Type":"ContainerStarted","Data":"4b1659cc50c07ea7e5bcffa7658c7f35ce4673890dec49585913d23a80334b8b"} Jul 20 09:58:44.614843 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:44.614795 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r9wl5" podStartSLOduration=17.109417933 podStartE2EDuration="18.614779785s" totalImagesPullingTime="1.505361852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:44.613310097 +0000 UTC m=+89.871714788" watchObservedRunningTime="2026-07-20 09:58:44.614779785 +0000 UTC m=+89.873184461" Jul 20 09:58:51.731388 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:51.731352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:51.733611 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:51.733591 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f683429f-cd6a-450d-90ad-a34afdd67739-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gzrt4\" (UID: \"f683429f-cd6a-450d-90ad-a34afdd67739\") " pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:52.018611 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:52.018540 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gzrt4" Jul 20 09:58:52.145623 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:52.145588 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gzrt4"] Jul 20 09:58:52.148349 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:58:52.148325 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf683429f_cd6a_450d_90ad_a34afdd67739.slice/crio-15fb847efaa670639887d13d9c85fc3856473f73c81fbfc2f7f844029e8b9831 WatchSource:0}: Error finding container 15fb847efaa670639887d13d9c85fc3856473f73c81fbfc2f7f844029e8b9831: Status 404 returned error can't find the container with id 15fb847efaa670639887d13d9c85fc3856473f73c81fbfc2f7f844029e8b9831 Jul 20 09:58:52.251199 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:52.251179 2564 scope.go:117] "RemoveContainer" containerID="adfc6f98e9277805e8c2da63db6f838b4a2c04b5cf5c25e2578da5fee885dae6" Jul 20 09:58:52.614936 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:52.614896 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gzrt4" event={"ID":"f683429f-cd6a-450d-90ad-a34afdd67739","Type":"ContainerStarted","Data":"15fb847efaa670639887d13d9c85fc3856473f73c81fbfc2f7f844029e8b9831"} Jul 20 09:58:52.617679 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:52.617658 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/1.log" Jul 20 09:58:52.617806 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:52.617718 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" event={"ID":"9cdea504-c1e9-4868-affe-0810dbd583f2","Type":"ContainerStarted","Data":"296919aa4645f93b666174319b6fb423c412b6099c0492d8e5c013829d5e3088"} Jul 20 09:58:52.618150 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:52.618091 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:52.636820 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:52.636710 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" podStartSLOduration=23.803884973 podStartE2EDuration="26.636691489s" totalImagesPullingTime="2.832806516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:52.634619357 +0000 UTC m=+97.893024057" watchObservedRunningTime="2026-07-20 09:58:52.636691489 +0000 UTC m=+97.895096166" Jul 20 09:58:53.017222 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:53.017139 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-kbkhp" Jul 20 09:58:54.453935 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:54.453903 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:58:54.456179 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:54.456156 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/480a8435-e56c-4ef7-9fe8-2e561760616a-metrics-tls\") pod \"dns-default-8d6l7\" (UID: \"480a8435-e56c-4ef7-9fe8-2e561760616a\") " pod="openshift-dns/dns-default-8d6l7" Jul 20 09:58:54.522385 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:54.522356 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l5b2l\"" Jul 20 09:58:54.531184 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:54.531158 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8d6l7" Jul 20 09:58:55.843259 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:55.843187 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-r7w2d"] Jul 20 09:58:56.008103 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.008074 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-2lkwf"] Jul 20 09:58:56.008282 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.008208 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r7w2d" Jul 20 09:58:56.010398 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.010372 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 20 09:58:56.010643 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.010626 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mhtkp\"" Jul 20 09:58:56.010754 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.010732 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 20 09:58:56.064575 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.064537 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64868475b-fd74m"] Jul 20 09:58:56.064724 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.064679 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2lkwf" Jul 20 09:58:56.066357 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.066331 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6862fd4-abd9-49b5-a0a9-27585101165d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r7w2d\" (UID: \"a6862fd4-abd9-49b5-a0a9-27585101165d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r7w2d" Jul 20 09:58:56.066538 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.066388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6862fd4-abd9-49b5-a0a9-27585101165d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-r7w2d\" (UID: \"a6862fd4-abd9-49b5-a0a9-27585101165d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r7w2d" Jul 20 09:58:56.066538 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.066513 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gq4h9\"" Jul 20 09:58:56.106202 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.106135 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-r7w2d"] Jul 20 09:58:56.106202 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.106191 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-2lkwf"] Jul 20 09:58:56.106369 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.106217 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64868475b-fd74m"] Jul 20 09:58:56.106369 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.106242 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pmd55"] Jul 20 09:58:56.106369 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.106285 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64868475b-fd74m" Jul 20 09:58:56.108677 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.108630 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-j5p9p\"" Jul 20 09:58:56.108677 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.108655 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 20 09:58:56.109600 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.109581 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 20 09:58:56.109712 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.109602 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 20 09:58:56.109767 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.109584 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 20 09:58:56.128118 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.128098 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pmd55"] Jul 20 09:58:56.128280 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.128194 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pmd55" Jul 20 09:58:56.130456 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.130423 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sd5cd\"" Jul 20 09:58:56.130567 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.130542 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 20 09:58:56.166996 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.166969 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ldgc\" (UniqueName: \"kubernetes.io/projected/db766356-b6b2-4981-8a02-c777414f5af4-kube-api-access-6ldgc\") pod \"managed-serviceaccount-addon-agent-64868475b-fd74m\" (UID: \"db766356-b6b2-4981-8a02-c777414f5af4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64868475b-fd74m" Jul 20 09:58:56.167121 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.167016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6862fd4-abd9-49b5-a0a9-27585101165d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-r7w2d\" (UID: \"a6862fd4-abd9-49b5-a0a9-27585101165d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r7w2d" Jul 20 09:58:56.167121 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.167081 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khx7f\" (UniqueName: \"kubernetes.io/projected/bbc4e206-0700-45d8-b36b-3ac890116e18-kube-api-access-khx7f\") pod \"network-check-source-7bc5b6bf85-2lkwf\" (UID: \"bbc4e206-0700-45d8-b36b-3ac890116e18\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2lkwf" Jul 20 09:58:56.167245 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.167156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6862fd4-abd9-49b5-a0a9-27585101165d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r7w2d\" (UID: \"a6862fd4-abd9-49b5-a0a9-27585101165d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r7w2d" Jul 20 09:58:56.167245 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.167193 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db766356-b6b2-4981-8a02-c777414f5af4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64868475b-fd74m\" (UID: \"db766356-b6b2-4981-8a02-c777414f5af4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64868475b-fd74m" Jul 20 09:58:56.167779 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.167751 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6862fd4-abd9-49b5-a0a9-27585101165d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-r7w2d\" (UID: \"a6862fd4-abd9-49b5-a0a9-27585101165d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r7w2d" Jul 20 09:58:56.169802 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.169777 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6862fd4-abd9-49b5-a0a9-27585101165d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r7w2d\" (UID: \"a6862fd4-abd9-49b5-a0a9-27585101165d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r7w2d" Jul 20 09:58:56.268554 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.268522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db766356-b6b2-4981-8a02-c777414f5af4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64868475b-fd74m\" (UID: \"db766356-b6b2-4981-8a02-c777414f5af4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64868475b-fd74m" Jul 20 09:58:56.268724 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.268570 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ldgc\" (UniqueName: \"kubernetes.io/projected/db766356-b6b2-4981-8a02-c777414f5af4-kube-api-access-6ldgc\") pod \"managed-serviceaccount-addon-agent-64868475b-fd74m\" (UID: \"db766356-b6b2-4981-8a02-c777414f5af4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64868475b-fd74m" Jul 20 09:58:56.268724 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.268618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khx7f\" (UniqueName: \"kubernetes.io/projected/bbc4e206-0700-45d8-b36b-3ac890116e18-kube-api-access-khx7f\") pod \"network-check-source-7bc5b6bf85-2lkwf\" (UID: \"bbc4e206-0700-45d8-b36b-3ac890116e18\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2lkwf" Jul 20 09:58:56.268724 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.268691 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/44078841-2364-40da-ac2a-531fedca748f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-pmd55\" (UID: \"44078841-2364-40da-ac2a-531fedca748f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pmd55" Jul 20 09:58:56.271559 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.271531 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db766356-b6b2-4981-8a02-c777414f5af4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64868475b-fd74m\" (UID: \"db766356-b6b2-4981-8a02-c777414f5af4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64868475b-fd74m" Jul 20 09:58:56.277795 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.277770 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khx7f\" (UniqueName: \"kubernetes.io/projected/bbc4e206-0700-45d8-b36b-3ac890116e18-kube-api-access-khx7f\") pod \"network-check-source-7bc5b6bf85-2lkwf\" (UID: \"bbc4e206-0700-45d8-b36b-3ac890116e18\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2lkwf" Jul 20 09:58:56.278735 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.278709 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ldgc\" (UniqueName: \"kubernetes.io/projected/db766356-b6b2-4981-8a02-c777414f5af4-kube-api-access-6ldgc\") pod \"managed-serviceaccount-addon-agent-64868475b-fd74m\" (UID: \"db766356-b6b2-4981-8a02-c777414f5af4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64868475b-fd74m" Jul 20 09:58:56.319659 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.319634 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r7w2d" Jul 20 09:58:56.369961 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.369941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/44078841-2364-40da-ac2a-531fedca748f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-pmd55\" (UID: \"44078841-2364-40da-ac2a-531fedca748f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pmd55" Jul 20 09:58:56.372005 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.371987 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/44078841-2364-40da-ac2a-531fedca748f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-pmd55\" (UID: \"44078841-2364-40da-ac2a-531fedca748f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pmd55" Jul 20 09:58:56.375310 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.375286 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2lkwf" Jul 20 09:58:56.433138 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.433097 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64868475b-fd74m" Jul 20 09:58:56.440026 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:56.440010 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pmd55" Jul 20 09:58:57.528646 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:57.528153 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6mxr8" Jul 20 09:58:57.606919 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:57.606885 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64868475b-fd74m"] Jul 20 09:58:57.616804 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:57.616774 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pmd55"] Jul 20 09:58:57.712981 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:58:57.712912 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb766356_b6b2_4981_8a02_c777414f5af4.slice/crio-1ed758b84930d5f1595f57ceb066a4240da3f7b473d71804925f112bd9b71094 WatchSource:0}: Error finding container 1ed758b84930d5f1595f57ceb066a4240da3f7b473d71804925f112bd9b71094: Status 404 returned error can't find the container with id 1ed758b84930d5f1595f57ceb066a4240da3f7b473d71804925f112bd9b71094 Jul 20 09:58:57.713303 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:58:57.713284 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44078841_2364_40da_ac2a_531fedca748f.slice/crio-2ea210745e95ffca3bb989971958997a482440420ddd4d20e6936fb27fa5a623 WatchSource:0}: Error finding container 2ea210745e95ffca3bb989971958997a482440420ddd4d20e6936fb27fa5a623: Status 404 returned error can't find the container with id 2ea210745e95ffca3bb989971958997a482440420ddd4d20e6936fb27fa5a623 Jul 20 09:58:57.831576 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:57.831554 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-2lkwf"] Jul 20 09:58:57.835475 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:58:57.835410 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc4e206_0700_45d8_b36b_3ac890116e18.slice/crio-60f6defe192971c75a601fd1b41f8add3c10d3c83f053f0a52c380d1f5e4c548 WatchSource:0}: Error finding container 60f6defe192971c75a601fd1b41f8add3c10d3c83f053f0a52c380d1f5e4c548: Status 404 returned error can't find the container with id 60f6defe192971c75a601fd1b41f8add3c10d3c83f053f0a52c380d1f5e4c548 Jul 20 09:58:57.836270 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:57.836110 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-r7w2d"] Jul 20 09:58:57.837474 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:57.837454 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8d6l7"] Jul 20 09:58:57.839248 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:58:57.839223 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480a8435_e56c_4ef7_9fe8_2e561760616a.slice/crio-c475feda2875d01413b41e34870c555f6c0ab035914142d714b5c2116fd987c4 WatchSource:0}: Error finding container c475feda2875d01413b41e34870c555f6c0ab035914142d714b5c2116fd987c4: Status 404 returned error can't find the container with id c475feda2875d01413b41e34870c555f6c0ab035914142d714b5c2116fd987c4 Jul 20 09:58:57.840261 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:58:57.840239 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6862fd4_abd9_49b5_a0a9_27585101165d.slice/crio-24994b2919e3ccbb0ae6ec376f90937e061507a2f4dbca23a616fbda9ebb1fbb WatchSource:0}: Error finding container 24994b2919e3ccbb0ae6ec376f90937e061507a2f4dbca23a616fbda9ebb1fbb: Status 404 returned error can't find the container with id 24994b2919e3ccbb0ae6ec376f90937e061507a2f4dbca23a616fbda9ebb1fbb Jul 20 09:58:58.642690 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:58.642598 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r7w2d" event={"ID":"a6862fd4-abd9-49b5-a0a9-27585101165d","Type":"ContainerStarted","Data":"24994b2919e3ccbb0ae6ec376f90937e061507a2f4dbca23a616fbda9ebb1fbb"} Jul 20 09:58:58.644616 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:58.644536 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8d6l7" event={"ID":"480a8435-e56c-4ef7-9fe8-2e561760616a","Type":"ContainerStarted","Data":"c475feda2875d01413b41e34870c555f6c0ab035914142d714b5c2116fd987c4"} Jul 20 09:58:58.653335 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:58.653272 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pmd55" event={"ID":"44078841-2364-40da-ac2a-531fedca748f","Type":"ContainerStarted","Data":"2ea210745e95ffca3bb989971958997a482440420ddd4d20e6936fb27fa5a623"} Jul 20 09:58:58.657381 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:58.656653 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2lkwf" event={"ID":"bbc4e206-0700-45d8-b36b-3ac890116e18","Type":"ContainerStarted","Data":"d5569717aae00f7f921fd05a4b64e4d9bd99a55d23477ebb76af3cfa54d746d4"} Jul 20 09:58:58.657381 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:58.656694 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2lkwf" event={"ID":"bbc4e206-0700-45d8-b36b-3ac890116e18","Type":"ContainerStarted","Data":"60f6defe192971c75a601fd1b41f8add3c10d3c83f053f0a52c380d1f5e4c548"} Jul 20 09:58:58.661948 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:58.661907 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64868475b-fd74m" event={"ID":"db766356-b6b2-4981-8a02-c777414f5af4","Type":"ContainerStarted","Data":"1ed758b84930d5f1595f57ceb066a4240da3f7b473d71804925f112bd9b71094"} Jul 20 09:58:58.667712 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:58.667639 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gzrt4" event={"ID":"f683429f-cd6a-450d-90ad-a34afdd67739","Type":"ContainerStarted","Data":"6cbe64c2d2f01a08c267ddd2df4bd7714c70eb7f375a436b802e886f0a282f55"} Jul 20 09:58:58.675321 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:58:58.674335 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2lkwf" podStartSLOduration=3.67431834 podStartE2EDuration="3.67431834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:58.673794839 +0000 UTC m=+103.932199516" watchObservedRunningTime="2026-07-20 09:58:58.67431834 +0000 UTC m=+103.932723020" Jul 20 09:59:03.693905 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:03.693812 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pmd55" event={"ID":"44078841-2364-40da-ac2a-531fedca748f","Type":"ContainerStarted","Data":"98e2e3900d0692743410b7c40bbc9c691fc0ab9894223187f92fa1f25c7bdcd8"} Jul 20 09:59:03.694307 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:03.693986 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pmd55" Jul 20 09:59:03.695465 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:03.695421 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64868475b-fd74m" event={"ID":"db766356-b6b2-4981-8a02-c777414f5af4","Type":"ContainerStarted","Data":"a5549f97f305818ea4504874ab998cfc796bf207567337be99544e5705ab683e"} Jul 20 09:59:03.697387 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:03.697362 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gzrt4" event={"ID":"f683429f-cd6a-450d-90ad-a34afdd67739","Type":"ContainerStarted","Data":"beb43f0781c47c77466a8664ad79103a2c95677fe5ca05dc98513fbb1b472bca"} Jul 20 09:59:03.698874 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:03.698848 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r7w2d" event={"ID":"a6862fd4-abd9-49b5-a0a9-27585101165d","Type":"ContainerStarted","Data":"f814e19cfe52de8b853dc37ae9ce46b83a12abbdfb92c7165517459883022653"} Jul 20 09:59:03.699124 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:03.699105 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pmd55" Jul 20 09:59:03.700354 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:03.700333 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8d6l7" event={"ID":"480a8435-e56c-4ef7-9fe8-2e561760616a","Type":"ContainerStarted","Data":"9db6218902eecb9e2ea6b8ce8a816dedf3863412577595ebe08d01f4c49e2184"} Jul 20 09:59:03.700425 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:03.700374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8d6l7" event={"ID":"480a8435-e56c-4ef7-9fe8-2e561760616a","Type":"ContainerStarted","Data":"e02c3df94679bdb3b7b74193c662e5e0848b2fb544618b6e7769fa55aa8c1602"} Jul 20 09:59:03.700502 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:03.700469 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8d6l7" Jul 20 09:59:03.710217 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:03.710182 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pmd55" podStartSLOduration=3.8777818809999998 podStartE2EDuration="8.710170835s" totalImagesPullingTime="4.832388954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:03.709802317 +0000 UTC m=+108.968206991" watchObservedRunningTime="2026-07-20 09:59:03.710170835 +0000 UTC m=+108.968575522" Jul 20 09:59:03.729365 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:03.729318 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8d6l7" podStartSLOduration=68.337855678 podStartE2EDuration="1m13.729305462s" totalImagesPullingTime="5.391449784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:03.728596058 +0000 UTC m=+108.987000734" watchObservedRunningTime="2026-07-20 09:59:03.729305462 +0000 UTC m=+108.987710184" Jul 20 09:59:03.744608 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:03.744572 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64868475b-fd74m" podStartSLOduration=3.251210085 podStartE2EDuration="8.744559967s" totalImagesPullingTime="5.493349882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:03.74435844 +0000 UTC m=+109.002763116" watchObservedRunningTime="2026-07-20 09:59:03.744559967 +0000 UTC m=+109.002964642" Jul 20 09:59:03.801581 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:03.801541 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r7w2d" podStartSLOduration=3.410893193 podStartE2EDuration="8.801524125s" totalImagesPullingTime="5.390630932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:03.799718833 +0000 UTC m=+109.058123523" watchObservedRunningTime="2026-07-20 09:59:03.801524125 +0000 UTC m=+109.059928805" Jul 20 09:59:04.715067 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.715028 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c"] Jul 20 09:59:04.735951 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.735918 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c"] Jul 20 09:59:04.736103 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.736019 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" Jul 20 09:59:04.741646 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.741611 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 09:59:04.741783 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.741660 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 20 09:59:04.741958 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.741939 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bbq5h\"" Jul 20 09:59:04.742191 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.742175 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 20 09:59:04.742359 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.742335 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 09:59:04.742488 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.742468 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 09:59:04.847451 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.847392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1362197e-4b76-4a16-8765-f9def7825192-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-sgz6c\" (UID: \"1362197e-4b76-4a16-8765-f9def7825192\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" Jul 20 09:59:04.847624 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.847458 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1362197e-4b76-4a16-8765-f9def7825192-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-sgz6c\" (UID: \"1362197e-4b76-4a16-8765-f9def7825192\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" Jul 20 09:59:04.847624 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.847536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t22q9\" (UniqueName: \"kubernetes.io/projected/1362197e-4b76-4a16-8765-f9def7825192-kube-api-access-t22q9\") pod \"prometheus-operator-5945b5cfd-sgz6c\" (UID: \"1362197e-4b76-4a16-8765-f9def7825192\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" Jul 20 09:59:04.847741 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.847687 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1362197e-4b76-4a16-8765-f9def7825192-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-sgz6c\" (UID: \"1362197e-4b76-4a16-8765-f9def7825192\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" Jul 20 09:59:04.948838 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.948805 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1362197e-4b76-4a16-8765-f9def7825192-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-sgz6c\" (UID: \"1362197e-4b76-4a16-8765-f9def7825192\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" Jul 20 09:59:04.949023 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.948848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1362197e-4b76-4a16-8765-f9def7825192-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-sgz6c\" (UID: \"1362197e-4b76-4a16-8765-f9def7825192\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" Jul 20 09:59:04.949023 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.948875 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t22q9\" (UniqueName: \"kubernetes.io/projected/1362197e-4b76-4a16-8765-f9def7825192-kube-api-access-t22q9\") pod \"prometheus-operator-5945b5cfd-sgz6c\" (UID: \"1362197e-4b76-4a16-8765-f9def7825192\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" Jul 20 09:59:04.949023 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.948939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1362197e-4b76-4a16-8765-f9def7825192-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-sgz6c\" (UID: \"1362197e-4b76-4a16-8765-f9def7825192\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" Jul 20 09:59:04.949726 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.949702 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1362197e-4b76-4a16-8765-f9def7825192-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-sgz6c\" (UID: \"1362197e-4b76-4a16-8765-f9def7825192\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" Jul 20 09:59:04.951494 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.951473 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1362197e-4b76-4a16-8765-f9def7825192-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-sgz6c\" (UID: \"1362197e-4b76-4a16-8765-f9def7825192\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" Jul 20 09:59:04.951772 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.951745 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1362197e-4b76-4a16-8765-f9def7825192-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-sgz6c\" (UID: \"1362197e-4b76-4a16-8765-f9def7825192\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" Jul 20 09:59:04.958756 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:04.958733 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t22q9\" (UniqueName: \"kubernetes.io/projected/1362197e-4b76-4a16-8765-f9def7825192-kube-api-access-t22q9\") pod \"prometheus-operator-5945b5cfd-sgz6c\" (UID: \"1362197e-4b76-4a16-8765-f9def7825192\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" Jul 20 09:59:05.050685 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:05.050610 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" Jul 20 09:59:05.210880 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:05.210854 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c"] Jul 20 09:59:05.213692 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:59:05.213664 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1362197e_4b76_4a16_8765_f9def7825192.slice/crio-fbe04c2a3f396f7f6510e3bafad1b6fbaf453a67a6456c698cec1a00de1a26cf WatchSource:0}: Error finding container fbe04c2a3f396f7f6510e3bafad1b6fbaf453a67a6456c698cec1a00de1a26cf: Status 404 returned error can't find the container with id fbe04c2a3f396f7f6510e3bafad1b6fbaf453a67a6456c698cec1a00de1a26cf Jul 20 09:59:05.709897 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:05.709848 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" event={"ID":"1362197e-4b76-4a16-8765-f9def7825192","Type":"ContainerStarted","Data":"fbe04c2a3f396f7f6510e3bafad1b6fbaf453a67a6456c698cec1a00de1a26cf"} Jul 20 09:59:07.718695 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:07.718660 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gzrt4" event={"ID":"f683429f-cd6a-450d-90ad-a34afdd67739","Type":"ContainerStarted","Data":"c82073a996adff33d25647c8ea1b831cb65aa6996b24894f6af7601862869555"} Jul 20 09:59:07.735193 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:07.735148 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gzrt4" podStartSLOduration=34.050218546 podStartE2EDuration="48.735132285s" totalImagesPullingTime="14.684913739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:58:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:07.734745995 +0000 UTC m=+112.993150668" watchObservedRunningTime="2026-07-20 09:59:07.735132285 +0000 UTC m=+112.993536939" Jul 20 09:59:08.723559 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:08.723527 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" event={"ID":"1362197e-4b76-4a16-8765-f9def7825192","Type":"ContainerStarted","Data":"aba8eeb3d4393fbd62f32d50754569cd4bcb5dffc1d2cd533a574190ec9a813a"} Jul 20 09:59:08.723961 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:08.723578 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" event={"ID":"1362197e-4b76-4a16-8765-f9def7825192","Type":"ContainerStarted","Data":"684907573f78937fd1468006a126dbfe847e34a19ea70cefc4fba441e13488ce"} Jul 20 09:59:08.740331 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:08.740289 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-sgz6c" podStartSLOduration=2.197673223 podStartE2EDuration="4.740274417s" totalImagesPullingTime="2.542601194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:08.739723024 +0000 UTC m=+113.998127700" watchObservedRunningTime="2026-07-20 09:59:08.740274417 +0000 UTC m=+113.998679093" Jul 20 09:59:11.216360 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.216330 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z4ht2"] Jul 20 09:59:11.219874 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.219853 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.221914 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.221892 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 09:59:11.222053 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.222011 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2n548\"" Jul 20 09:59:11.222178 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.222158 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 09:59:11.222241 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.222224 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 09:59:11.403016 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.402984 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe6431eb-29ba-4303-84ef-94706c598358-root\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.403173 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.403038 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-tls\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.403173 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.403090 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-accelerators-collector-config\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.403173 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.403125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe6431eb-29ba-4303-84ef-94706c598358-metrics-client-ca\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.403277 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.403190 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.403277 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.403221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-wtmp\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.403277 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.403242 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe6431eb-29ba-4303-84ef-94706c598358-sys\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.403277 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.403266 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg6h9\" (UniqueName: \"kubernetes.io/projected/fe6431eb-29ba-4303-84ef-94706c598358-kube-api-access-bg6h9\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.403399 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.403316 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-textfile\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.504505 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.504414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe6431eb-29ba-4303-84ef-94706c598358-root\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.504505 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.504485 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-tls\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.504714 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.504516 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-accelerators-collector-config\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.504714 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.504535 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe6431eb-29ba-4303-84ef-94706c598358-root\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.504714 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.504553 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe6431eb-29ba-4303-84ef-94706c598358-metrics-client-ca\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.504714 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.504607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.504714 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.504640 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-wtmp\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.504714 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.504668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe6431eb-29ba-4303-84ef-94706c598358-sys\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.504714 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.504706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg6h9\" (UniqueName: \"kubernetes.io/projected/fe6431eb-29ba-4303-84ef-94706c598358-kube-api-access-bg6h9\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.505011 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.504738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-textfile\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.505011 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.504791 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-wtmp\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.505011 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.504803 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe6431eb-29ba-4303-84ef-94706c598358-sys\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.505158 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.505054 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-textfile\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.505219 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.505193 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-accelerators-collector-config\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.505308 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.505289 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe6431eb-29ba-4303-84ef-94706c598358-metrics-client-ca\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.506892 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.506871 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-tls\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.506980 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.506955 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe6431eb-29ba-4303-84ef-94706c598358-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.512511 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.512490 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg6h9\" (UniqueName: \"kubernetes.io/projected/fe6431eb-29ba-4303-84ef-94706c598358-kube-api-access-bg6h9\") pod \"node-exporter-z4ht2\" (UID: \"fe6431eb-29ba-4303-84ef-94706c598358\") " pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.528157 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.528132 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z4ht2" Jul 20 09:59:11.544022 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:59:11.543992 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe6431eb_29ba_4303_84ef_94706c598358.slice/crio-5b6787e4e63d5867eceeb9703a7ac5eb300fbc0b2caa75bc201d1659b3f61cbe WatchSource:0}: Error finding container 5b6787e4e63d5867eceeb9703a7ac5eb300fbc0b2caa75bc201d1659b3f61cbe: Status 404 returned error can't find the container with id 5b6787e4e63d5867eceeb9703a7ac5eb300fbc0b2caa75bc201d1659b3f61cbe Jul 20 09:59:11.734737 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:11.734705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z4ht2" event={"ID":"fe6431eb-29ba-4303-84ef-94706c598358","Type":"ContainerStarted","Data":"5b6787e4e63d5867eceeb9703a7ac5eb300fbc0b2caa75bc201d1659b3f61cbe"} Jul 20 09:59:12.255118 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.255067 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 09:59:12.259120 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.259091 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.262013 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.261280 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 20 09:59:12.263673 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.263651 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 20 09:59:12.263821 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.263750 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 20 09:59:12.264003 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.263984 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 20 09:59:12.264091 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.264032 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 20 09:59:12.264091 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.264064 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ll2kn\"" Jul 20 09:59:12.264575 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.264556 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 20 09:59:12.265143 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.264986 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 20 09:59:12.265143 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.265010 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 20 09:59:12.265143 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.264986 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 20 09:59:12.278465 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.278409 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 09:59:12.413497 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.413466 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-config-volume\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.413680 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.413512 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vhsv\" (UniqueName: \"kubernetes.io/projected/75ebc58e-ca55-46ab-a944-035de67dfd71-kube-api-access-6vhsv\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.413680 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.413570 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75ebc58e-ca55-46ab-a944-035de67dfd71-config-out\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.413680 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.413606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75ebc58e-ca55-46ab-a944-035de67dfd71-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.413680 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.413663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75ebc58e-ca55-46ab-a944-035de67dfd71-tls-assets\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.413892 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.413721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.413892 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.413769 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.413892 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.413788 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.413892 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.413813 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.413892 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.413858 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75ebc58e-ca55-46ab-a944-035de67dfd71-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.413892 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.413888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/75ebc58e-ca55-46ab-a944-035de67dfd71-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.414192 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.413912 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-web-config\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.414192 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.413939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.514339 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.514254 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-web-config\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.514339 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.514298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.514339 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.514320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-config-volume\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.514339 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.514338 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vhsv\" (UniqueName: \"kubernetes.io/projected/75ebc58e-ca55-46ab-a944-035de67dfd71-kube-api-access-6vhsv\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.514670 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.514366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75ebc58e-ca55-46ab-a944-035de67dfd71-config-out\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.514670 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.514397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75ebc58e-ca55-46ab-a944-035de67dfd71-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.514670 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.514471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75ebc58e-ca55-46ab-a944-035de67dfd71-tls-assets\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.514670 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.514537 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.514670 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.514573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.514670 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.514595 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.514670 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.514634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.514950 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.514680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75ebc58e-ca55-46ab-a944-035de67dfd71-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.514950 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.514712 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/75ebc58e-ca55-46ab-a944-035de67dfd71-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.515304 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.515076 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/75ebc58e-ca55-46ab-a944-035de67dfd71-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.516852 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.516820 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75ebc58e-ca55-46ab-a944-035de67dfd71-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.518266 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.518036 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75ebc58e-ca55-46ab-a944-035de67dfd71-config-out\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.518266 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.518126 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75ebc58e-ca55-46ab-a944-035de67dfd71-tls-assets\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.518266 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.518167 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.518823 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.518561 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.518823 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.518817 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-web-config\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.518957 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.518903 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-config-volume\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.523453 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.519143 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75ebc58e-ca55-46ab-a944-035de67dfd71-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.524275 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.524250 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.525240 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.525215 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.525339 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.525304 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.526357 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.526337 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vhsv\" (UniqueName: \"kubernetes.io/projected/75ebc58e-ca55-46ab-a944-035de67dfd71-kube-api-access-6vhsv\") pod \"alertmanager-main-0\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.572370 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.572338 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:12.758347 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:12.758325 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 09:59:12.760663 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:59:12.760642 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ebc58e_ca55_46ab_a944_035de67dfd71.slice/crio-82f5583156eb0c81f662f05a439c7621d9235ea8f83627b4df839ba4558ef9fb WatchSource:0}: Error finding container 82f5583156eb0c81f662f05a439c7621d9235ea8f83627b4df839ba4558ef9fb: Status 404 returned error can't find the container with id 82f5583156eb0c81f662f05a439c7621d9235ea8f83627b4df839ba4558ef9fb Jul 20 09:59:13.707071 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:13.707043 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8d6l7" Jul 20 09:59:13.744931 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:13.744896 2564 generic.go:356] "Generic (PLEG): container finished" podID="fe6431eb-29ba-4303-84ef-94706c598358" containerID="0d202329f46deff0144f12dc67207f731de9b73c431c771dc02f48b3edb2d1ca" exitCode=0 Jul 20 09:59:13.745108 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:13.744980 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z4ht2" event={"ID":"fe6431eb-29ba-4303-84ef-94706c598358","Type":"ContainerDied","Data":"0d202329f46deff0144f12dc67207f731de9b73c431c771dc02f48b3edb2d1ca"} Jul 20 09:59:13.746705 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:13.746678 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerStarted","Data":"82f5583156eb0c81f662f05a439c7621d9235ea8f83627b4df839ba4558ef9fb"} Jul 20 09:59:14.752247 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:14.752216 2564 generic.go:356] "Generic (PLEG): container finished" podID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerID="7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f" exitCode=0 Jul 20 09:59:14.752641 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:14.752302 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerDied","Data":"7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f"} Jul 20 09:59:14.754526 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:14.754507 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z4ht2" event={"ID":"fe6431eb-29ba-4303-84ef-94706c598358","Type":"ContainerStarted","Data":"8e80784f056417225b1c8738b27a4ac88baa4efed5c3fb6263dd404b98ab2229"} Jul 20 09:59:14.754599 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:14.754551 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z4ht2" event={"ID":"fe6431eb-29ba-4303-84ef-94706c598358","Type":"ContainerStarted","Data":"540b094a33e4d78f8b53af478f1aca2d0163fb7ff0f3fcd8cb0dd6c874abb805"} Jul 20 09:59:15.615633 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.615556 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z4ht2" podStartSLOduration=3.430054646 podStartE2EDuration="4.615534842s" totalImagesPullingTime="1.121573989s" totalInitContainerRuntime="63.906207ms" isStatefulPod=true podCreationTimestamp="2026-07-20 09:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:14.831315888 +0000 UTC m=+120.089720567" watchObservedRunningTime="2026-07-20 09:59:15.615534842 +0000 UTC m=+120.873939519" Jul 20 09:59:15.616471 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.616427 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5bd7d7c455-4dklj"] Jul 20 09:59:15.622949 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.622931 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.625532 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.625510 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-c8ft8\"" Jul 20 09:59:15.625642 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.625554 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 20 09:59:15.625642 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.625569 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 20 09:59:15.625642 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.625510 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 20 09:59:15.625839 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.625822 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1q2mrqj6gcf4p\"" Jul 20 09:59:15.625894 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.625883 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 20 09:59:15.630325 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.630303 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bd7d7c455-4dklj"] Jul 20 09:59:15.644094 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.644061 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.644213 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.644111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-secret-metrics-server-client-certs\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.644213 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.644140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-client-ca-bundle\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.644213 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.644197 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-metrics-server-audit-profiles\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.644371 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.644262 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-secret-metrics-server-tls\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.644371 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.644285 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sx99\" (UniqueName: \"kubernetes.io/projected/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-kube-api-access-5sx99\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.644371 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.644361 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-audit-log\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.744936 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.744903 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.745097 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.744955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-secret-metrics-server-client-certs\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.745097 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.745079 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-client-ca-bundle\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.745201 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.745122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-metrics-server-audit-profiles\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.745201 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.745188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-secret-metrics-server-tls\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.745297 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.745213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sx99\" (UniqueName: \"kubernetes.io/projected/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-kube-api-access-5sx99\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.745297 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.745274 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-audit-log\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.745790 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.745763 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-audit-log\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.745913 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.745857 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.746400 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.746240 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-metrics-server-audit-profiles\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.748110 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.748088 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-secret-metrics-server-tls\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.748256 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.748117 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-client-ca-bundle\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.748256 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.748177 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-secret-metrics-server-client-certs\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.753376 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.753344 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sx99\" (UniqueName: \"kubernetes.io/projected/2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401-kube-api-access-5sx99\") pod \"metrics-server-5bd7d7c455-4dklj\" (UID: \"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401\") " pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.888943 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.888861 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84599d74bb-k2xkd"] Jul 20 09:59:15.895095 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.895073 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:15.896874 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.896851 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 20 09:59:15.897014 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.896994 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 20 09:59:15.897128 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.897111 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 20 09:59:15.897187 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.897140 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 20 09:59:15.897229 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.897219 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 20 09:59:15.897270 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.897239 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 20 09:59:15.897421 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.897405 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tcc2t\"" Jul 20 09:59:15.897577 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.897554 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 20 09:59:15.901741 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.901689 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84599d74bb-k2xkd"] Jul 20 09:59:15.903149 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.903092 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 20 09:59:15.934199 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.934169 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:15.947562 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.947537 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-config\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:15.947674 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.947613 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-oauth-config\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:15.947674 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.947647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-oauth-serving-cert\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:15.947767 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.947691 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-service-ca\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:15.947767 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.947743 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-serving-cert\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:15.947767 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.947762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbwlz\" (UniqueName: \"kubernetes.io/projected/ee44527c-8247-4ab1-bcc7-7649395b68c9-kube-api-access-rbwlz\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:15.947883 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:15.947828 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-trusted-ca-bundle\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.048744 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.048712 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-oauth-serving-cert\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.048910 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.048760 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-service-ca\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.048910 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.048793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-serving-cert\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.048910 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.048840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbwlz\" (UniqueName: \"kubernetes.io/projected/ee44527c-8247-4ab1-bcc7-7649395b68c9-kube-api-access-rbwlz\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.048910 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.048878 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-trusted-ca-bundle\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.049098 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.048913 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-config\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.049098 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.048970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-oauth-config\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.049606 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.049570 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-oauth-serving-cert\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.049753 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.049730 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-config\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.049963 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.049932 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-service-ca\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.050377 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.050354 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-trusted-ca-bundle\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.051520 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.051503 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-serving-cert\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.051632 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.051600 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-oauth-config\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.057468 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.057403 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbwlz\" (UniqueName: \"kubernetes.io/projected/ee44527c-8247-4ab1-bcc7-7649395b68c9-kube-api-access-rbwlz\") pod \"console-84599d74bb-k2xkd\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.207934 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.207854 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:16.369423 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.369401 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84599d74bb-k2xkd"] Jul 20 09:59:16.372254 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:59:16.372223 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee44527c_8247_4ab1_bcc7_7649395b68c9.slice/crio-5feed006008b449451c0b8c1e0710f154f2d38677999c5f0e056f4751e16459b WatchSource:0}: Error finding container 5feed006008b449451c0b8c1e0710f154f2d38677999c5f0e056f4751e16459b: Status 404 returned error can't find the container with id 5feed006008b449451c0b8c1e0710f154f2d38677999c5f0e056f4751e16459b Jul 20 09:59:16.397133 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.397106 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bd7d7c455-4dklj"] Jul 20 09:59:16.400561 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:59:16.400540 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac2e2bc_ca33_4e5d_a39b_a4671f6c0401.slice/crio-ad761c80561ca86220fdd55282949d67c3ba5b2904a06cf07f99d317f3a41c80 WatchSource:0}: Error finding container ad761c80561ca86220fdd55282949d67c3ba5b2904a06cf07f99d317f3a41c80: Status 404 returned error can't find the container with id ad761c80561ca86220fdd55282949d67c3ba5b2904a06cf07f99d317f3a41c80 Jul 20 09:59:16.764560 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.764488 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" event={"ID":"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401","Type":"ContainerStarted","Data":"ad761c80561ca86220fdd55282949d67c3ba5b2904a06cf07f99d317f3a41c80"} Jul 20 09:59:16.767415 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.767390 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerStarted","Data":"d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b"} Jul 20 09:59:16.767557 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.767475 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerStarted","Data":"41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606"} Jul 20 09:59:16.767557 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.767503 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerStarted","Data":"632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b"} Jul 20 09:59:16.767557 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.767529 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerStarted","Data":"0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9"} Jul 20 09:59:16.767710 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.767558 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerStarted","Data":"7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044"} Jul 20 09:59:16.768650 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:16.768622 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84599d74bb-k2xkd" event={"ID":"ee44527c-8247-4ab1-bcc7-7649395b68c9","Type":"ContainerStarted","Data":"5feed006008b449451c0b8c1e0710f154f2d38677999c5f0e056f4751e16459b"} Jul 20 09:59:17.527142 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.527058 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 09:59:17.531969 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.531890 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.539520 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.538701 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 20 09:59:17.539520 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.538934 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 20 09:59:17.542380 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.542349 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 20 09:59:17.542606 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.542585 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 20 09:59:17.543018 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.542996 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 20 09:59:17.543114 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.543060 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 20 09:59:17.543579 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.543197 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 20 09:59:17.543579 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.543349 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 20 09:59:17.543579 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.543500 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 20 09:59:17.543795 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.543610 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 20 09:59:17.543795 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.543680 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 20 09:59:17.543917 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.543895 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 20 09:59:17.544364 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.542999 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-83l8p6ag1fuit\"" Jul 20 09:59:17.544835 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.544815 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-trbcg\"" Jul 20 09:59:17.545520 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.545272 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 20 09:59:17.545902 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.545880 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 20 09:59:17.560825 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.560718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7319b963-1733-48c2-a5d7-54c205e4cf4a-config-out\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.560825 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.560753 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.561031 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.560849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-web-config\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.561031 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.560924 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.561031 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.560990 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.561031 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561024 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75mwn\" (UniqueName: \"kubernetes.io/projected/7319b963-1733-48c2-a5d7-54c205e4cf4a-kube-api-access-75mwn\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.561331 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.561331 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7319b963-1733-48c2-a5d7-54c205e4cf4a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.561331 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.561331 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561255 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.561331 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-config\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.561331 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.562085 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.562085 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.562085 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.562085 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561514 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.562085 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.562085 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561588 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.562085 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.562085 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.561649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.564577 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.564556 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 09:59:17.662402 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.662182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.662402 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.662231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.662402 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.662265 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.662402 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.662291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666301 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7319b963-1733-48c2-a5d7-54c205e4cf4a-config-out\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666301 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666562 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-web-config\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666562 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666562 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666562 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666468 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75mwn\" (UniqueName: \"kubernetes.io/projected/7319b963-1733-48c2-a5d7-54c205e4cf4a-kube-api-access-75mwn\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666562 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666562 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7319b963-1733-48c2-a5d7-54c205e4cf4a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666872 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666872 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666872 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-config\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666872 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666872 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666872 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666774 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666872 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.666872 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666831 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.667332 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.667309 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.668013 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.666846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.668917 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.668635 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.669492 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.669179 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.670267 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.670094 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.670267 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.670103 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.671367 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.671028 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.672319 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.672292 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.673733 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.673264 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.674744 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.674336 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.674842 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.674765 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.674902 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.674841 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-config\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.675605 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.675360 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.675853 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.675780 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-web-config\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.678160 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.676221 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7319b963-1733-48c2-a5d7-54c205e4cf4a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.679771 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.679088 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7319b963-1733-48c2-a5d7-54c205e4cf4a-config-out\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.681632 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.681152 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.681632 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.681182 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.683456 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.683407 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.687387 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.687369 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75mwn\" (UniqueName: \"kubernetes.io/projected/7319b963-1733-48c2-a5d7-54c205e4cf4a-kube-api-access-75mwn\") pod \"prometheus-k8s-0\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:17.847827 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:17.847745 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:18.224108 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:18.224010 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 09:59:18.228116 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:59:18.228082 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7319b963_1733_48c2_a5d7_54c205e4cf4a.slice/crio-c221cdbfdb982eccde25e04a02cb0d732173f63793a666b242b3a8c61cc6dd18 WatchSource:0}: Error finding container c221cdbfdb982eccde25e04a02cb0d732173f63793a666b242b3a8c61cc6dd18: Status 404 returned error can't find the container with id c221cdbfdb982eccde25e04a02cb0d732173f63793a666b242b3a8c61cc6dd18 Jul 20 09:59:18.780637 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:18.780606 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" event={"ID":"2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401","Type":"ContainerStarted","Data":"550f9146b74e2eae8c6258cdb5c0d05702cdff9914f37fbdb7d811e8fe4e6924"} Jul 20 09:59:18.782509 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:18.782478 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerStarted","Data":"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea"} Jul 20 09:59:18.782662 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:18.782546 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerStarted","Data":"c221cdbfdb982eccde25e04a02cb0d732173f63793a666b242b3a8c61cc6dd18"} Jul 20 09:59:18.786323 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:18.786295 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerStarted","Data":"2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b"} Jul 20 09:59:18.801626 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:18.801579 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" podStartSLOduration=2.122884674 podStartE2EDuration="3.801561824s" totalImagesPullingTime="1.67867715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:18.801052776 +0000 UTC m=+124.059457453" watchObservedRunningTime="2026-07-20 09:59:18.801561824 +0000 UTC m=+124.059966501" Jul 20 09:59:18.883025 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:18.882970 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.799028952 podStartE2EDuration="6.882947093s" totalImagesPullingTime="4.065003457s" totalInitContainerRuntime="18.914684ms" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:18.846224991 +0000 UTC m=+124.104629681" watchObservedRunningTime="2026-07-20 09:59:18.882947093 +0000 UTC m=+124.141351769" Jul 20 09:59:19.791846 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:19.791761 2564 generic.go:356] "Generic (PLEG): container finished" podID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerID="10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea" exitCode=0 Jul 20 09:59:19.791996 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:19.791856 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerDied","Data":"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea"} Jul 20 09:59:19.793565 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:19.793395 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84599d74bb-k2xkd" event={"ID":"ee44527c-8247-4ab1-bcc7-7649395b68c9","Type":"ContainerStarted","Data":"ce162d0dcde5091a856d9fa4ccf7b510eb77c00f0b1bede0210629268fe8f372"} Jul 20 09:59:19.854912 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:19.854854 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84599d74bb-k2xkd" podStartSLOduration=1.81419814 podStartE2EDuration="4.854835503s" totalImagesPullingTime="3.040637363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:19.853595478 +0000 UTC m=+125.112000153" watchObservedRunningTime="2026-07-20 09:59:19.854835503 +0000 UTC m=+125.113240180" Jul 20 09:59:22.809242 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:22.809218 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerStarted","Data":"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a"} Jul 20 09:59:23.815986 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:23.815949 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerStarted","Data":"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083"} Jul 20 09:59:24.824733 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:24.824703 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerStarted","Data":"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3"} Jul 20 09:59:24.825052 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:24.824786 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerStarted","Data":"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1"} Jul 20 09:59:24.825052 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:24.824830 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerStarted","Data":"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec"} Jul 20 09:59:24.825052 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:24.824877 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerStarted","Data":"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751"} Jul 20 09:59:24.856236 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:24.856187 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.21372426 podStartE2EDuration="7.856170854s" totalImagesPullingTime="4.620023087s" totalInitContainerRuntime="22.423507ms" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:24.855529303 +0000 UTC m=+130.113933985" watchObservedRunningTime="2026-07-20 09:59:24.856170854 +0000 UTC m=+130.114575531" Jul 20 09:59:25.042808 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:25.042773 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs\") pod \"network-metrics-daemon-mk7cq\" (UID: \"e31e814a-2c84-4b09-a4f3-06fa6c649cfb\") " pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:59:25.045007 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:25.044982 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e31e814a-2c84-4b09-a4f3-06fa6c649cfb-metrics-certs\") pod \"network-metrics-daemon-mk7cq\" (UID: \"e31e814a-2c84-4b09-a4f3-06fa6c649cfb\") " pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:59:25.265458 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:25.265418 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8dwl2\"" Jul 20 09:59:25.273507 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:25.273478 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk7cq" Jul 20 09:59:25.402459 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:25.402418 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mk7cq"] Jul 20 09:59:25.405570 ip-10-0-128-168 kubenswrapper[2564]: W0720 09:59:25.405546 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31e814a_2c84_4b09_a4f3_06fa6c649cfb.slice/crio-5e9d5e33f97ae04001aa5f6c3bbddf0a12b0c85bb8718449666d2e5ed75a401d WatchSource:0}: Error finding container 5e9d5e33f97ae04001aa5f6c3bbddf0a12b0c85bb8718449666d2e5ed75a401d: Status 404 returned error can't find the container with id 5e9d5e33f97ae04001aa5f6c3bbddf0a12b0c85bb8718449666d2e5ed75a401d Jul 20 09:59:25.829427 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:25.829384 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mk7cq" event={"ID":"e31e814a-2c84-4b09-a4f3-06fa6c649cfb","Type":"ContainerStarted","Data":"5e9d5e33f97ae04001aa5f6c3bbddf0a12b0c85bb8718449666d2e5ed75a401d"} Jul 20 09:59:26.208135 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:26.208099 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:26.208452 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:26.208414 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:26.213802 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:26.213779 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:26.836097 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:26.836015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mk7cq" event={"ID":"e31e814a-2c84-4b09-a4f3-06fa6c649cfb","Type":"ContainerStarted","Data":"e0a64a94c635d8b78bb0fa33db23f113d56759f36a09858e1ae8e01198154fa3"} Jul 20 09:59:26.836097 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:26.836076 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mk7cq" event={"ID":"e31e814a-2c84-4b09-a4f3-06fa6c649cfb","Type":"ContainerStarted","Data":"9f4690d1b18689d39c03eb1fd01eaed330d125d05f45b30f2c0193b995ac7e93"} Jul 20 09:59:26.839846 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:26.839823 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 09:59:26.863081 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:26.863032 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mk7cq" podStartSLOduration=130.903282586 podStartE2EDuration="2m11.863013121s" totalImagesPullingTime="959.730535ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:26.861151847 +0000 UTC m=+132.119556529" watchObservedRunningTime="2026-07-20 09:59:26.863013121 +0000 UTC m=+132.121417798" Jul 20 09:59:27.848286 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:27.848261 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:35.935246 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:35.935209 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:35.935628 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:35.935283 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:39.889815 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:39.889782 2564 generic.go:356] "Generic (PLEG): container finished" podID="0509b165-52b1-452f-9d81-993c6ebe528e" containerID="84c3dd0eb29d0ab119b837331eb2d992224c0c211ab1c05bb3d834aa89b192ee" exitCode=0 Jul 20 09:59:39.890222 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:39.889865 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-9f4gs" event={"ID":"0509b165-52b1-452f-9d81-993c6ebe528e","Type":"ContainerDied","Data":"84c3dd0eb29d0ab119b837331eb2d992224c0c211ab1c05bb3d834aa89b192ee"} Jul 20 09:59:39.890222 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:39.890215 2564 scope.go:117] "RemoveContainer" containerID="84c3dd0eb29d0ab119b837331eb2d992224c0c211ab1c05bb3d834aa89b192ee" Jul 20 09:59:40.896069 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:40.896037 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-9f4gs" event={"ID":"0509b165-52b1-452f-9d81-993c6ebe528e","Type":"ContainerStarted","Data":"3b9e360ca44fc366a7f32a9295b27a70b2e32eddbaea10799eec4c323eb6147e"} Jul 20 09:59:55.939923 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:55.939894 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 09:59:55.943695 ip-10-0-128-168 kubenswrapper[2564]: I0720 09:59:55.943672 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5bd7d7c455-4dklj" Jul 20 10:00:00.978907 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:00.978871 2564 generic.go:356] "Generic (PLEG): container finished" podID="105b6b48-12fc-4221-901d-59b4fedcc6c0" containerID="de748430a1bb44eff1271e957fc84a62eaf3a622942285762f1b758ae6a858d8" exitCode=0 Jul 20 10:00:00.979375 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:00.978907 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" event={"ID":"105b6b48-12fc-4221-901d-59b4fedcc6c0","Type":"ContainerDied","Data":"de748430a1bb44eff1271e957fc84a62eaf3a622942285762f1b758ae6a858d8"} Jul 20 10:00:00.979375 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:00.979346 2564 scope.go:117] "RemoveContainer" containerID="de748430a1bb44eff1271e957fc84a62eaf3a622942285762f1b758ae6a858d8" Jul 20 10:00:01.984792 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:01.984757 2564 generic.go:356] "Generic (PLEG): container finished" podID="24ba0b57-9337-45c9-9134-e17cd547da3a" containerID="5e12708e5a27480ab99f7eef91182b09881c7a5dcdfa4c5e07b4a4e93b56fe0c" exitCode=0 Jul 20 10:00:01.985260 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:01.984833 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" event={"ID":"24ba0b57-9337-45c9-9134-e17cd547da3a","Type":"ContainerDied","Data":"5e12708e5a27480ab99f7eef91182b09881c7a5dcdfa4c5e07b4a4e93b56fe0c"} Jul 20 10:00:01.985260 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:01.985236 2564 scope.go:117] "RemoveContainer" containerID="5e12708e5a27480ab99f7eef91182b09881c7a5dcdfa4c5e07b4a4e93b56fe0c" Jul 20 10:00:01.986706 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:01.986689 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zb7t8" event={"ID":"105b6b48-12fc-4221-901d-59b4fedcc6c0","Type":"ContainerStarted","Data":"96a644d3953949f3ec4fe35618b1a553fa384708d1c689dc534190c69c814b85"} Jul 20 10:00:02.992301 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:02.992267 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4fbtf" event={"ID":"24ba0b57-9337-45c9-9134-e17cd547da3a","Type":"ContainerStarted","Data":"44c43028976084c563f3dd47aaa22274991a441b19a4c8f51f286cf7a6ef9ac6"} Jul 20 10:00:17.848419 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:17.848381 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:17.867225 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:17.867198 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:18.066469 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:18.066423 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:31.548054 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:31.548017 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 10:00:31.549077 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:31.549021 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="alertmanager" containerID="cri-o://7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044" gracePeriod=120 Jul 20 10:00:31.549996 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:31.549247 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="kube-rbac-proxy-metric" containerID="cri-o://d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b" gracePeriod=120 Jul 20 10:00:31.550624 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:31.549555 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="prom-label-proxy" containerID="cri-o://2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b" gracePeriod=120 Jul 20 10:00:31.551672 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:31.549577 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="kube-rbac-proxy-web" containerID="cri-o://632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b" gracePeriod=120 Jul 20 10:00:31.551857 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:31.549592 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="kube-rbac-proxy" containerID="cri-o://41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606" gracePeriod=120 Jul 20 10:00:31.552274 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:31.549608 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="config-reloader" containerID="cri-o://0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9" gracePeriod=120 Jul 20 10:00:32.108561 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:32.108531 2564 generic.go:356] "Generic (PLEG): container finished" podID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerID="2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b" exitCode=0 Jul 20 10:00:32.108561 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:32.108554 2564 generic.go:356] "Generic (PLEG): container finished" podID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerID="41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606" exitCode=0 Jul 20 10:00:32.108561 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:32.108560 2564 generic.go:356] "Generic (PLEG): container finished" podID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerID="0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9" exitCode=0 Jul 20 10:00:32.108561 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:32.108566 2564 generic.go:356] "Generic (PLEG): container finished" podID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerID="7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044" exitCode=0 Jul 20 10:00:32.108815 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:32.108604 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerDied","Data":"2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b"} Jul 20 10:00:32.108815 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:32.108665 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerDied","Data":"41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606"} Jul 20 10:00:32.108815 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:32.108691 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerDied","Data":"0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9"} Jul 20 10:00:32.108815 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:32.108715 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerDied","Data":"7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044"} Jul 20 10:00:32.907154 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:32.907131 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.003782 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.003755 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75ebc58e-ca55-46ab-a944-035de67dfd71-tls-assets\") pod \"75ebc58e-ca55-46ab-a944-035de67dfd71\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " Jul 20 10:00:33.003956 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.003814 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy-metric\") pod \"75ebc58e-ca55-46ab-a944-035de67dfd71\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " Jul 20 10:00:33.003956 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.003830 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-web-config\") pod \"75ebc58e-ca55-46ab-a944-035de67dfd71\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " Jul 20 10:00:33.003956 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.003854 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vhsv\" (UniqueName: \"kubernetes.io/projected/75ebc58e-ca55-46ab-a944-035de67dfd71-kube-api-access-6vhsv\") pod \"75ebc58e-ca55-46ab-a944-035de67dfd71\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " Jul 20 10:00:33.003956 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.003885 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy\") pod \"75ebc58e-ca55-46ab-a944-035de67dfd71\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " Jul 20 10:00:33.003956 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.003902 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-config-volume\") pod \"75ebc58e-ca55-46ab-a944-035de67dfd71\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " Jul 20 10:00:33.003956 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.003917 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-cluster-tls-config\") pod \"75ebc58e-ca55-46ab-a944-035de67dfd71\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " Jul 20 10:00:33.003956 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.003939 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75ebc58e-ca55-46ab-a944-035de67dfd71-alertmanager-trusted-ca-bundle\") pod \"75ebc58e-ca55-46ab-a944-035de67dfd71\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " Jul 20 10:00:33.004321 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.003964 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75ebc58e-ca55-46ab-a944-035de67dfd71-metrics-client-ca\") pod \"75ebc58e-ca55-46ab-a944-035de67dfd71\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " Jul 20 10:00:33.004321 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.004014 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-main-tls\") pod \"75ebc58e-ca55-46ab-a944-035de67dfd71\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " Jul 20 10:00:33.004321 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.004042 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy-web\") pod \"75ebc58e-ca55-46ab-a944-035de67dfd71\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " Jul 20 10:00:33.004321 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.004075 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/75ebc58e-ca55-46ab-a944-035de67dfd71-alertmanager-main-db\") pod \"75ebc58e-ca55-46ab-a944-035de67dfd71\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " Jul 20 10:00:33.004321 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.004114 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75ebc58e-ca55-46ab-a944-035de67dfd71-config-out\") pod \"75ebc58e-ca55-46ab-a944-035de67dfd71\" (UID: \"75ebc58e-ca55-46ab-a944-035de67dfd71\") " Jul 20 10:00:33.005873 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.005789 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75ebc58e-ca55-46ab-a944-035de67dfd71-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "75ebc58e-ca55-46ab-a944-035de67dfd71" (UID: "75ebc58e-ca55-46ab-a944-035de67dfd71"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:33.005873 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.005792 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75ebc58e-ca55-46ab-a944-035de67dfd71-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "75ebc58e-ca55-46ab-a944-035de67dfd71" (UID: "75ebc58e-ca55-46ab-a944-035de67dfd71"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:33.006564 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.006509 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75ebc58e-ca55-46ab-a944-035de67dfd71-kube-api-access-6vhsv" (OuterVolumeSpecName: "kube-api-access-6vhsv") pod "75ebc58e-ca55-46ab-a944-035de67dfd71" (UID: "75ebc58e-ca55-46ab-a944-035de67dfd71"). InnerVolumeSpecName "kube-api-access-6vhsv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:00:33.006564 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.006520 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ebc58e-ca55-46ab-a944-035de67dfd71-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "75ebc58e-ca55-46ab-a944-035de67dfd71" (UID: "75ebc58e-ca55-46ab-a944-035de67dfd71"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:00:33.007233 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.007206 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "75ebc58e-ca55-46ab-a944-035de67dfd71" (UID: "75ebc58e-ca55-46ab-a944-035de67dfd71"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:33.007361 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.007279 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ebc58e-ca55-46ab-a944-035de67dfd71-config-out" (OuterVolumeSpecName: "config-out") pod "75ebc58e-ca55-46ab-a944-035de67dfd71" (UID: "75ebc58e-ca55-46ab-a944-035de67dfd71"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:00:33.007532 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.007501 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75ebc58e-ca55-46ab-a944-035de67dfd71-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "75ebc58e-ca55-46ab-a944-035de67dfd71" (UID: "75ebc58e-ca55-46ab-a944-035de67dfd71"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:00:33.007752 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.007722 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-config-volume" (OuterVolumeSpecName: "config-volume") pod "75ebc58e-ca55-46ab-a944-035de67dfd71" (UID: "75ebc58e-ca55-46ab-a944-035de67dfd71"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:33.007752 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.007736 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "75ebc58e-ca55-46ab-a944-035de67dfd71" (UID: "75ebc58e-ca55-46ab-a944-035de67dfd71"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:33.008544 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.008507 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "75ebc58e-ca55-46ab-a944-035de67dfd71" (UID: "75ebc58e-ca55-46ab-a944-035de67dfd71"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:33.008634 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.008599 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "75ebc58e-ca55-46ab-a944-035de67dfd71" (UID: "75ebc58e-ca55-46ab-a944-035de67dfd71"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:33.011622 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.011483 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "75ebc58e-ca55-46ab-a944-035de67dfd71" (UID: "75ebc58e-ca55-46ab-a944-035de67dfd71"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:33.017729 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.017691 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-web-config" (OuterVolumeSpecName: "web-config") pod "75ebc58e-ca55-46ab-a944-035de67dfd71" (UID: "75ebc58e-ca55-46ab-a944-035de67dfd71"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:33.105780 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.105757 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/75ebc58e-ca55-46ab-a944-035de67dfd71-alertmanager-main-db\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:33.105780 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.105776 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75ebc58e-ca55-46ab-a944-035de67dfd71-config-out\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:33.105900 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.105785 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75ebc58e-ca55-46ab-a944-035de67dfd71-tls-assets\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:33.105900 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.105794 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:33.105900 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.105804 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-web-config\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:33.105900 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.105812 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vhsv\" (UniqueName: \"kubernetes.io/projected/75ebc58e-ca55-46ab-a944-035de67dfd71-kube-api-access-6vhsv\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:33.105900 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.105820 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:33.105900 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.105829 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-config-volume\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:33.105900 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.105837 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-cluster-tls-config\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:33.105900 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.105844 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75ebc58e-ca55-46ab-a944-035de67dfd71-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:33.105900 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.105853 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75ebc58e-ca55-46ab-a944-035de67dfd71-metrics-client-ca\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:33.105900 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.105861 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-main-tls\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:33.105900 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.105870 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75ebc58e-ca55-46ab-a944-035de67dfd71-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:33.116021 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.115989 2564 generic.go:356] "Generic (PLEG): container finished" podID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerID="d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b" exitCode=0 Jul 20 10:00:33.116021 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.116017 2564 generic.go:356] "Generic (PLEG): container finished" podID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerID="632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b" exitCode=0 Jul 20 10:00:33.116151 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.116076 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.116188 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.116069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerDied","Data":"d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b"} Jul 20 10:00:33.116230 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.116220 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerDied","Data":"632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b"} Jul 20 10:00:33.116263 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.116252 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75ebc58e-ca55-46ab-a944-035de67dfd71","Type":"ContainerDied","Data":"82f5583156eb0c81f662f05a439c7621d9235ea8f83627b4df839ba4558ef9fb"} Jul 20 10:00:33.116305 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.116283 2564 scope.go:117] "RemoveContainer" containerID="2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b" Jul 20 10:00:33.124125 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.124014 2564 scope.go:117] "RemoveContainer" containerID="d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b" Jul 20 10:00:33.130937 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.130921 2564 scope.go:117] "RemoveContainer" containerID="41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606" Jul 20 10:00:33.137867 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.137835 2564 scope.go:117] "RemoveContainer" containerID="632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b" Jul 20 10:00:33.139352 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.139334 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 10:00:33.143826 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.143799 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 10:00:33.145516 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.145503 2564 scope.go:117] "RemoveContainer" containerID="0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9" Jul 20 10:00:33.152074 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.152056 2564 scope.go:117] "RemoveContainer" containerID="7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044" Jul 20 10:00:33.158696 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.158676 2564 scope.go:117] "RemoveContainer" containerID="7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f" Jul 20 10:00:33.165394 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.165378 2564 scope.go:117] "RemoveContainer" containerID="2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b" Jul 20 10:00:33.165658 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:00:33.165640 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b\": container with ID starting with 2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b not found: ID does not exist" containerID="2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b" Jul 20 10:00:33.165712 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.165668 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b"} err="failed to get container status \"2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b\": rpc error: code = NotFound desc = could not find container \"2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b\": container with ID starting with 2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b not found: ID does not exist" Jul 20 10:00:33.165712 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.165704 2564 scope.go:117] "RemoveContainer" containerID="d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b" Jul 20 10:00:33.165948 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:00:33.165931 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b\": container with ID starting with d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b not found: ID does not exist" containerID="d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b" Jul 20 10:00:33.166013 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.165957 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b"} err="failed to get container status \"d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b\": rpc error: code = NotFound desc = could not find container \"d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b\": container with ID starting with d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b not found: ID does not exist" Jul 20 10:00:33.166013 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.165979 2564 scope.go:117] "RemoveContainer" containerID="41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606" Jul 20 10:00:33.166242 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:00:33.166226 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606\": container with ID starting with 41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606 not found: ID does not exist" containerID="41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606" Jul 20 10:00:33.166279 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.166248 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606"} err="failed to get container status \"41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606\": rpc error: code = NotFound desc = could not find container \"41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606\": container with ID starting with 41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606 not found: ID does not exist" Jul 20 10:00:33.166279 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.166261 2564 scope.go:117] "RemoveContainer" containerID="632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b" Jul 20 10:00:33.166500 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:00:33.166477 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b\": container with ID starting with 632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b not found: ID does not exist" containerID="632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b" Jul 20 10:00:33.166601 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.166502 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b"} err="failed to get container status \"632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b\": rpc error: code = NotFound desc = could not find container \"632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b\": container with ID starting with 632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b not found: ID does not exist" Jul 20 10:00:33.166601 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.166516 2564 scope.go:117] "RemoveContainer" containerID="0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9" Jul 20 10:00:33.166762 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:00:33.166746 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9\": container with ID starting with 0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9 not found: ID does not exist" containerID="0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9" Jul 20 10:00:33.166801 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.166766 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9"} err="failed to get container status \"0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9\": rpc error: code = NotFound desc = could not find container \"0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9\": container with ID starting with 0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9 not found: ID does not exist" Jul 20 10:00:33.166801 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.166781 2564 scope.go:117] "RemoveContainer" containerID="7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044" Jul 20 10:00:33.167002 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:00:33.166987 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044\": container with ID starting with 7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044 not found: ID does not exist" containerID="7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044" Jul 20 10:00:33.167042 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.167006 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044"} err="failed to get container status \"7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044\": rpc error: code = NotFound desc = could not find container \"7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044\": container with ID starting with 7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044 not found: ID does not exist" Jul 20 10:00:33.167042 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.167019 2564 scope.go:117] "RemoveContainer" containerID="7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f" Jul 20 10:00:33.167246 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:00:33.167229 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f\": container with ID starting with 7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f not found: ID does not exist" containerID="7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f" Jul 20 10:00:33.167281 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.167250 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f"} err="failed to get container status \"7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f\": rpc error: code = NotFound desc = could not find container \"7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f\": container with ID starting with 7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f not found: ID does not exist" Jul 20 10:00:33.167281 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.167264 2564 scope.go:117] "RemoveContainer" containerID="2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b" Jul 20 10:00:33.167509 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.167490 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b"} err="failed to get container status \"2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b\": rpc error: code = NotFound desc = could not find container \"2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b\": container with ID starting with 2ca1effbe5e51c1f5cd02680944712e9c95040ecf9469c59a1bfef7a7ace911b not found: ID does not exist" Jul 20 10:00:33.167570 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.167510 2564 scope.go:117] "RemoveContainer" containerID="d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b" Jul 20 10:00:33.167740 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.167721 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b"} err="failed to get container status \"d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b\": rpc error: code = NotFound desc = could not find container \"d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b\": container with ID starting with d283b7bf7e42fa6ef8ec0a418dfce5b52cc4196d60bdbb1d747f8eff8bb5110b not found: ID does not exist" Jul 20 10:00:33.167803 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.167742 2564 scope.go:117] "RemoveContainer" containerID="41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606" Jul 20 10:00:33.167953 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.167938 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606"} err="failed to get container status \"41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606\": rpc error: code = NotFound desc = could not find container \"41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606\": container with ID starting with 41a4bc91eeab5e60c553e639ed7685faa0a9740e102339ac8d66b73a7bb25606 not found: ID does not exist" Jul 20 10:00:33.167994 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.167954 2564 scope.go:117] "RemoveContainer" containerID="632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b" Jul 20 10:00:33.168162 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.168145 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b"} err="failed to get container status \"632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b\": rpc error: code = NotFound desc = could not find container \"632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b\": container with ID starting with 632e621ee605c7d2f8bec5283822fad37e02112077b7e7c98cad7e925ddde55b not found: ID does not exist" Jul 20 10:00:33.168212 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.168162 2564 scope.go:117] "RemoveContainer" containerID="0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9" Jul 20 10:00:33.168358 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.168343 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9"} err="failed to get container status \"0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9\": rpc error: code = NotFound desc = could not find container \"0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9\": container with ID starting with 0dcaf46352234b75de7d2b0340be16572c4216f21eddde7a2d054cd992bf4bd9 not found: ID does not exist" Jul 20 10:00:33.168395 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.168358 2564 scope.go:117] "RemoveContainer" containerID="7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044" Jul 20 10:00:33.168577 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.168559 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044"} err="failed to get container status \"7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044\": rpc error: code = NotFound desc = could not find container \"7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044\": container with ID starting with 7e1382c971887aeb02e5dabd12192a5d58f5f5d8bb5869cbb0706e4226ea9044 not found: ID does not exist" Jul 20 10:00:33.168633 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.168578 2564 scope.go:117] "RemoveContainer" containerID="7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f" Jul 20 10:00:33.168786 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.168769 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f"} err="failed to get container status \"7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f\": rpc error: code = NotFound desc = could not find container \"7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f\": container with ID starting with 7f37ce6aaefa228afb8c4ad6bd8464c30e48ca8bbc8e962c6f6d1800826ab96f not found: ID does not exist" Jul 20 10:00:33.171166 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171149 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 10:00:33.171450 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171425 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="init-config-reloader" Jul 20 10:00:33.171492 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171453 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="init-config-reloader" Jul 20 10:00:33.171492 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171466 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="alertmanager" Jul 20 10:00:33.171492 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171472 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="alertmanager" Jul 20 10:00:33.171492 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171484 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="kube-rbac-proxy-metric" Jul 20 10:00:33.171492 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171489 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="kube-rbac-proxy-metric" Jul 20 10:00:33.171701 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171495 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="prom-label-proxy" Jul 20 10:00:33.171701 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171500 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="prom-label-proxy" Jul 20 10:00:33.171701 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171506 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="config-reloader" Jul 20 10:00:33.171701 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171512 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="config-reloader" Jul 20 10:00:33.171701 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171524 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="kube-rbac-proxy-web" Jul 20 10:00:33.171701 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171529 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="kube-rbac-proxy-web" Jul 20 10:00:33.171701 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171536 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="kube-rbac-proxy" Jul 20 10:00:33.171701 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171542 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="kube-rbac-proxy" Jul 20 10:00:33.171701 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171586 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="alertmanager" Jul 20 10:00:33.171701 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171594 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="kube-rbac-proxy-metric" Jul 20 10:00:33.171701 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171599 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="kube-rbac-proxy" Jul 20 10:00:33.171701 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171605 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="prom-label-proxy" Jul 20 10:00:33.171701 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171610 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="config-reloader" Jul 20 10:00:33.171701 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.171615 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" containerName="kube-rbac-proxy-web" Jul 20 10:00:33.175048 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.175031 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.177340 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.177321 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 20 10:00:33.177449 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.177426 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 20 10:00:33.177518 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.177428 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 20 10:00:33.177717 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.177700 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ll2kn\"" Jul 20 10:00:33.177787 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.177754 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 20 10:00:33.177873 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.177856 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 20 10:00:33.177937 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.177868 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 20 10:00:33.178229 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.178214 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 20 10:00:33.178299 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.178215 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 20 10:00:33.184176 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.184159 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 20 10:00:33.195516 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.195495 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 10:00:33.258183 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.258147 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75ebc58e-ca55-46ab-a944-035de67dfd71" path="/var/lib/kubelet/pods/75ebc58e-ca55-46ab-a944-035de67dfd71/volumes" Jul 20 10:00:33.307580 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.307550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-web-config\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.307580 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.307580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce4457d7-2d51-4488-adf6-b525c885093f-config-out\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.307787 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.307599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msk8r\" (UniqueName: \"kubernetes.io/projected/ce4457d7-2d51-4488-adf6-b525c885093f-kube-api-access-msk8r\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.307787 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.307618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce4457d7-2d51-4488-adf6-b525c885093f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.307787 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.307709 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce4457d7-2d51-4488-adf6-b525c885093f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.307787 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.307781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce4457d7-2d51-4488-adf6-b525c885093f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.307990 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.307819 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.307990 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.307880 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.307990 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.307911 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce4457d7-2d51-4488-adf6-b525c885093f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.307990 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.307937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.307990 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.307964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.308176 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.307997 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.308176 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.308024 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.409324 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.409261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce4457d7-2d51-4488-adf6-b525c885093f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.409324 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.409293 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.409324 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.409310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.409594 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.409328 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.409594 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.409348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.409594 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.409376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-web-config\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.409594 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.409398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce4457d7-2d51-4488-adf6-b525c885093f-config-out\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.409594 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.409429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msk8r\" (UniqueName: \"kubernetes.io/projected/ce4457d7-2d51-4488-adf6-b525c885093f-kube-api-access-msk8r\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.409594 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.409479 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce4457d7-2d51-4488-adf6-b525c885093f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.409594 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.409506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce4457d7-2d51-4488-adf6-b525c885093f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.409594 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.409560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce4457d7-2d51-4488-adf6-b525c885093f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.409594 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.409593 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.410021 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.409638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.411964 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.411931 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce4457d7-2d51-4488-adf6-b525c885093f-config-out\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.412570 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.412109 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce4457d7-2d51-4488-adf6-b525c885093f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.412570 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.412216 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-web-config\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.412570 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.412264 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.412570 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.412264 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.412570 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.412532 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.412849 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.412580 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce4457d7-2d51-4488-adf6-b525c885093f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.412849 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.412626 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.412849 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.412644 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce4457d7-2d51-4488-adf6-b525c885093f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.412849 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.412626 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.413154 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.413133 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce4457d7-2d51-4488-adf6-b525c885093f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.414060 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.414044 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce4457d7-2d51-4488-adf6-b525c885093f-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.419789 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.419773 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msk8r\" (UniqueName: \"kubernetes.io/projected/ce4457d7-2d51-4488-adf6-b525c885093f-kube-api-access-msk8r\") pod \"alertmanager-main-0\" (UID: \"ce4457d7-2d51-4488-adf6-b525c885093f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.484298 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.484276 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:33.618932 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:33.618905 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 10:00:33.620896 ip-10-0-128-168 kubenswrapper[2564]: W0720 10:00:33.620865 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce4457d7_2d51_4488_adf6_b525c885093f.slice/crio-17804dc5e17bb7cc482c175058faa33ebcd86f8f185ba2ccdd8f2a15a8a04d96 WatchSource:0}: Error finding container 17804dc5e17bb7cc482c175058faa33ebcd86f8f185ba2ccdd8f2a15a8a04d96: Status 404 returned error can't find the container with id 17804dc5e17bb7cc482c175058faa33ebcd86f8f185ba2ccdd8f2a15a8a04d96 Jul 20 10:00:34.121903 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:34.121875 2564 generic.go:356] "Generic (PLEG): container finished" podID="ce4457d7-2d51-4488-adf6-b525c885093f" containerID="cbcfe22617b642130bdac61111bb4510509aad21c3f191b26fe7fcf88ee57439" exitCode=0 Jul 20 10:00:34.122238 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:34.121921 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce4457d7-2d51-4488-adf6-b525c885093f","Type":"ContainerDied","Data":"cbcfe22617b642130bdac61111bb4510509aad21c3f191b26fe7fcf88ee57439"} Jul 20 10:00:34.122238 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:34.121968 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce4457d7-2d51-4488-adf6-b525c885093f","Type":"ContainerStarted","Data":"17804dc5e17bb7cc482c175058faa33ebcd86f8f185ba2ccdd8f2a15a8a04d96"} Jul 20 10:00:35.129968 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:35.129929 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce4457d7-2d51-4488-adf6-b525c885093f","Type":"ContainerStarted","Data":"58082b35a341893e6d5f1d8d4e0fb0846845313506cad54a38ff6bc71169f6c6"} Jul 20 10:00:35.130330 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:35.130008 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce4457d7-2d51-4488-adf6-b525c885093f","Type":"ContainerStarted","Data":"b6446ae434e1b7041dd54b0deae5fc34c0eec7d5467d41df50dafc81bfd747be"} Jul 20 10:00:35.130330 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:35.130050 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce4457d7-2d51-4488-adf6-b525c885093f","Type":"ContainerStarted","Data":"0ae57889200223841708691ad989641df689a3c2d621a4b14e044a9af988a262"} Jul 20 10:00:35.130330 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:35.130095 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce4457d7-2d51-4488-adf6-b525c885093f","Type":"ContainerStarted","Data":"8a10541d405b9712cf715616ae057f76d7fa45a659c0f17b90352f96a7037e01"} Jul 20 10:00:35.130330 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:35.130131 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce4457d7-2d51-4488-adf6-b525c885093f","Type":"ContainerStarted","Data":"d33af7ecc78c3bb86d67910479348e6ede3e9ccce688dd5c65b6b83deaeb2098"} Jul 20 10:00:35.130330 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:35.130165 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce4457d7-2d51-4488-adf6-b525c885093f","Type":"ContainerStarted","Data":"f96aef895ea479666eafd92c408926232720132e2f9a8133aa0d24cb0f0ae954"} Jul 20 10:00:35.163306 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:35.163251 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.146632979 podStartE2EDuration="2.163232566s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.599587ms" isStatefulPod=false podCreationTimestamp="2026-07-20 10:00:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:00:35.162051602 +0000 UTC m=+200.420456280" watchObservedRunningTime="2026-07-20 10:00:35.163232566 +0000 UTC m=+200.421637243" Jul 20 10:00:35.866684 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:35.866646 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:35.867317 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:35.866996 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="prometheus" containerID="cri-o://67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a" gracePeriod=600 Jul 20 10:00:35.867317 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:35.867042 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="kube-rbac-proxy" containerID="cri-o://6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1" gracePeriod=600 Jul 20 10:00:35.867317 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:35.867104 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3" gracePeriod=600 Jul 20 10:00:35.867317 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:35.867061 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="thanos-sidecar" containerID="cri-o://e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751" gracePeriod=600 Jul 20 10:00:35.867317 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:35.867058 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="kube-rbac-proxy-web" containerID="cri-o://d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec" gracePeriod=600 Jul 20 10:00:35.867317 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:35.867067 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="config-reloader" containerID="cri-o://4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083" gracePeriod=600 Jul 20 10:00:36.117836 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.117775 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.138089 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138056 2564 generic.go:356] "Generic (PLEG): container finished" podID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerID="3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3" exitCode=0 Jul 20 10:00:36.138089 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138080 2564 generic.go:356] "Generic (PLEG): container finished" podID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerID="6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1" exitCode=0 Jul 20 10:00:36.138089 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138086 2564 generic.go:356] "Generic (PLEG): container finished" podID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerID="d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec" exitCode=0 Jul 20 10:00:36.138089 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138091 2564 generic.go:356] "Generic (PLEG): container finished" podID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerID="e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751" exitCode=0 Jul 20 10:00:36.138089 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138096 2564 generic.go:356] "Generic (PLEG): container finished" podID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerID="4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083" exitCode=0 Jul 20 10:00:36.138089 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138101 2564 generic.go:356] "Generic (PLEG): container finished" podID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerID="67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a" exitCode=0 Jul 20 10:00:36.138738 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138139 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.138738 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138139 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerDied","Data":"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3"} Jul 20 10:00:36.138738 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138212 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerDied","Data":"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1"} Jul 20 10:00:36.138738 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138242 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerDied","Data":"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec"} Jul 20 10:00:36.138738 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerDied","Data":"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751"} Jul 20 10:00:36.138738 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138280 2564 scope.go:117] "RemoveContainer" containerID="3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3" Jul 20 10:00:36.138738 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138298 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerDied","Data":"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083"} Jul 20 10:00:36.138738 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138323 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerDied","Data":"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a"} Jul 20 10:00:36.138738 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.138352 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7319b963-1733-48c2-a5d7-54c205e4cf4a","Type":"ContainerDied","Data":"c221cdbfdb982eccde25e04a02cb0d732173f63793a666b242b3a8c61cc6dd18"} Jul 20 10:00:36.147929 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.147571 2564 scope.go:117] "RemoveContainer" containerID="6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1" Jul 20 10:00:36.156571 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.156541 2564 scope.go:117] "RemoveContainer" containerID="d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec" Jul 20 10:00:36.172573 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.172330 2564 scope.go:117] "RemoveContainer" containerID="e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751" Jul 20 10:00:36.182199 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.182106 2564 scope.go:117] "RemoveContainer" containerID="4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083" Jul 20 10:00:36.190765 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.190745 2564 scope.go:117] "RemoveContainer" containerID="67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a" Jul 20 10:00:36.198135 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.198118 2564 scope.go:117] "RemoveContainer" containerID="10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea" Jul 20 10:00:36.205181 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.205164 2564 scope.go:117] "RemoveContainer" containerID="3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3" Jul 20 10:00:36.205508 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:00:36.205486 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3\": container with ID starting with 3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3 not found: ID does not exist" containerID="3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3" Jul 20 10:00:36.205588 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.205514 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3"} err="failed to get container status \"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3\": rpc error: code = NotFound desc = could not find container \"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3\": container with ID starting with 3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3 not found: ID does not exist" Jul 20 10:00:36.205588 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.205532 2564 scope.go:117] "RemoveContainer" containerID="6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1" Jul 20 10:00:36.205798 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:00:36.205776 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1\": container with ID starting with 6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1 not found: ID does not exist" containerID="6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1" Jul 20 10:00:36.205842 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.205806 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1"} err="failed to get container status \"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1\": rpc error: code = NotFound desc = could not find container \"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1\": container with ID starting with 6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1 not found: ID does not exist" Jul 20 10:00:36.205842 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.205825 2564 scope.go:117] "RemoveContainer" containerID="d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec" Jul 20 10:00:36.206083 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:00:36.206064 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec\": container with ID starting with d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec not found: ID does not exist" containerID="d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec" Jul 20 10:00:36.206148 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.206091 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec"} err="failed to get container status \"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec\": rpc error: code = NotFound desc = could not find container \"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec\": container with ID starting with d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec not found: ID does not exist" Jul 20 10:00:36.206148 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.206112 2564 scope.go:117] "RemoveContainer" containerID="e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751" Jul 20 10:00:36.206327 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:00:36.206311 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751\": container with ID starting with e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751 not found: ID does not exist" containerID="e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751" Jul 20 10:00:36.206381 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.206332 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751"} err="failed to get container status \"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751\": rpc error: code = NotFound desc = could not find container \"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751\": container with ID starting with e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751 not found: ID does not exist" Jul 20 10:00:36.206381 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.206352 2564 scope.go:117] "RemoveContainer" containerID="4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083" Jul 20 10:00:36.206617 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:00:36.206599 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083\": container with ID starting with 4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083 not found: ID does not exist" containerID="4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083" Jul 20 10:00:36.206664 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.206628 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083"} err="failed to get container status \"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083\": rpc error: code = NotFound desc = could not find container \"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083\": container with ID starting with 4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083 not found: ID does not exist" Jul 20 10:00:36.206664 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.206641 2564 scope.go:117] "RemoveContainer" containerID="67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a" Jul 20 10:00:36.206872 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:00:36.206856 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a\": container with ID starting with 67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a not found: ID does not exist" containerID="67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a" Jul 20 10:00:36.206908 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.206877 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a"} err="failed to get container status \"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a\": rpc error: code = NotFound desc = could not find container \"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a\": container with ID starting with 67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a not found: ID does not exist" Jul 20 10:00:36.206908 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.206893 2564 scope.go:117] "RemoveContainer" containerID="10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea" Jul 20 10:00:36.207102 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:00:36.207088 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea\": container with ID starting with 10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea not found: ID does not exist" containerID="10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea" Jul 20 10:00:36.207142 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.207104 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea"} err="failed to get container status \"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea\": rpc error: code = NotFound desc = could not find container \"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea\": container with ID starting with 10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea not found: ID does not exist" Jul 20 10:00:36.207142 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.207116 2564 scope.go:117] "RemoveContainer" containerID="3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3" Jul 20 10:00:36.207293 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.207278 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3"} err="failed to get container status \"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3\": rpc error: code = NotFound desc = could not find container \"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3\": container with ID starting with 3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3 not found: ID does not exist" Jul 20 10:00:36.207330 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.207293 2564 scope.go:117] "RemoveContainer" containerID="6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1" Jul 20 10:00:36.207545 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.207529 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1"} err="failed to get container status \"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1\": rpc error: code = NotFound desc = could not find container \"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1\": container with ID starting with 6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1 not found: ID does not exist" Jul 20 10:00:36.207545 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.207544 2564 scope.go:117] "RemoveContainer" containerID="d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec" Jul 20 10:00:36.207730 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.207714 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec"} err="failed to get container status \"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec\": rpc error: code = NotFound desc = could not find container \"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec\": container with ID starting with d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec not found: ID does not exist" Jul 20 10:00:36.207773 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.207731 2564 scope.go:117] "RemoveContainer" containerID="e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751" Jul 20 10:00:36.207943 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.207920 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751"} err="failed to get container status \"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751\": rpc error: code = NotFound desc = could not find container \"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751\": container with ID starting with e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751 not found: ID does not exist" Jul 20 10:00:36.207992 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.207945 2564 scope.go:117] "RemoveContainer" containerID="4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083" Jul 20 10:00:36.208118 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.208101 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083"} err="failed to get container status \"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083\": rpc error: code = NotFound desc = could not find container \"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083\": container with ID starting with 4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083 not found: ID does not exist" Jul 20 10:00:36.208160 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.208119 2564 scope.go:117] "RemoveContainer" containerID="67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a" Jul 20 10:00:36.208401 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.208367 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a"} err="failed to get container status \"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a\": rpc error: code = NotFound desc = could not find container \"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a\": container with ID starting with 67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a not found: ID does not exist" Jul 20 10:00:36.208492 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.208401 2564 scope.go:117] "RemoveContainer" containerID="10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea" Jul 20 10:00:36.208719 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.208692 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea"} err="failed to get container status \"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea\": rpc error: code = NotFound desc = could not find container \"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea\": container with ID starting with 10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea not found: ID does not exist" Jul 20 10:00:36.208719 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.208718 2564 scope.go:117] "RemoveContainer" containerID="3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3" Jul 20 10:00:36.208957 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.208942 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3"} err="failed to get container status \"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3\": rpc error: code = NotFound desc = could not find container \"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3\": container with ID starting with 3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3 not found: ID does not exist" Jul 20 10:00:36.208998 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.208957 2564 scope.go:117] "RemoveContainer" containerID="6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1" Jul 20 10:00:36.209180 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.209163 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1"} err="failed to get container status \"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1\": rpc error: code = NotFound desc = could not find container \"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1\": container with ID starting with 6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1 not found: ID does not exist" Jul 20 10:00:36.209226 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.209182 2564 scope.go:117] "RemoveContainer" containerID="d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec" Jul 20 10:00:36.209426 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.209403 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec"} err="failed to get container status \"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec\": rpc error: code = NotFound desc = could not find container \"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec\": container with ID starting with d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec not found: ID does not exist" Jul 20 10:00:36.209426 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.209425 2564 scope.go:117] "RemoveContainer" containerID="e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751" Jul 20 10:00:36.209678 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.209663 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751"} err="failed to get container status \"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751\": rpc error: code = NotFound desc = could not find container \"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751\": container with ID starting with e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751 not found: ID does not exist" Jul 20 10:00:36.209678 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.209677 2564 scope.go:117] "RemoveContainer" containerID="4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083" Jul 20 10:00:36.209954 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.209931 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083"} err="failed to get container status \"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083\": rpc error: code = NotFound desc = could not find container \"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083\": container with ID starting with 4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083 not found: ID does not exist" Jul 20 10:00:36.210000 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.209957 2564 scope.go:117] "RemoveContainer" containerID="67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a" Jul 20 10:00:36.210199 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.210181 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a"} err="failed to get container status \"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a\": rpc error: code = NotFound desc = could not find container \"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a\": container with ID starting with 67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a not found: ID does not exist" Jul 20 10:00:36.210270 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.210200 2564 scope.go:117] "RemoveContainer" containerID="10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea" Jul 20 10:00:36.210461 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.210429 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea"} err="failed to get container status \"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea\": rpc error: code = NotFound desc = could not find container \"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea\": container with ID starting with 10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea not found: ID does not exist" Jul 20 10:00:36.210517 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.210462 2564 scope.go:117] "RemoveContainer" containerID="3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3" Jul 20 10:00:36.210688 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.210670 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3"} err="failed to get container status \"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3\": rpc error: code = NotFound desc = could not find container \"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3\": container with ID starting with 3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3 not found: ID does not exist" Jul 20 10:00:36.210732 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.210688 2564 scope.go:117] "RemoveContainer" containerID="6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1" Jul 20 10:00:36.210913 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.210895 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1"} err="failed to get container status \"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1\": rpc error: code = NotFound desc = could not find container \"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1\": container with ID starting with 6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1 not found: ID does not exist" Jul 20 10:00:36.210950 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.210925 2564 scope.go:117] "RemoveContainer" containerID="d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec" Jul 20 10:00:36.211145 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.211128 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec"} err="failed to get container status \"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec\": rpc error: code = NotFound desc = could not find container \"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec\": container with ID starting with d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec not found: ID does not exist" Jul 20 10:00:36.211200 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.211145 2564 scope.go:117] "RemoveContainer" containerID="e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751" Jul 20 10:00:36.211351 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.211325 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751"} err="failed to get container status \"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751\": rpc error: code = NotFound desc = could not find container \"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751\": container with ID starting with e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751 not found: ID does not exist" Jul 20 10:00:36.211402 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.211352 2564 scope.go:117] "RemoveContainer" containerID="4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083" Jul 20 10:00:36.211576 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.211557 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083"} err="failed to get container status \"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083\": rpc error: code = NotFound desc = could not find container \"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083\": container with ID starting with 4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083 not found: ID does not exist" Jul 20 10:00:36.211576 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.211576 2564 scope.go:117] "RemoveContainer" containerID="67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a" Jul 20 10:00:36.211767 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.211749 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a"} err="failed to get container status \"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a\": rpc error: code = NotFound desc = could not find container \"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a\": container with ID starting with 67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a not found: ID does not exist" Jul 20 10:00:36.211813 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.211767 2564 scope.go:117] "RemoveContainer" containerID="10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea" Jul 20 10:00:36.211997 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.211977 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea"} err="failed to get container status \"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea\": rpc error: code = NotFound desc = could not find container \"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea\": container with ID starting with 10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea not found: ID does not exist" Jul 20 10:00:36.211997 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.211996 2564 scope.go:117] "RemoveContainer" containerID="3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3" Jul 20 10:00:36.212228 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.212212 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3"} err="failed to get container status \"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3\": rpc error: code = NotFound desc = could not find container \"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3\": container with ID starting with 3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3 not found: ID does not exist" Jul 20 10:00:36.212269 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.212228 2564 scope.go:117] "RemoveContainer" containerID="6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1" Jul 20 10:00:36.212430 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.212410 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1"} err="failed to get container status \"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1\": rpc error: code = NotFound desc = could not find container \"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1\": container with ID starting with 6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1 not found: ID does not exist" Jul 20 10:00:36.212430 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.212428 2564 scope.go:117] "RemoveContainer" containerID="d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec" Jul 20 10:00:36.212679 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.212660 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec"} err="failed to get container status \"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec\": rpc error: code = NotFound desc = could not find container \"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec\": container with ID starting with d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec not found: ID does not exist" Jul 20 10:00:36.212679 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.212678 2564 scope.go:117] "RemoveContainer" containerID="e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751" Jul 20 10:00:36.212920 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.212900 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751"} err="failed to get container status \"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751\": rpc error: code = NotFound desc = could not find container \"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751\": container with ID starting with e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751 not found: ID does not exist" Jul 20 10:00:36.212963 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.212921 2564 scope.go:117] "RemoveContainer" containerID="4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083" Jul 20 10:00:36.213139 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.213123 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083"} err="failed to get container status \"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083\": rpc error: code = NotFound desc = could not find container \"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083\": container with ID starting with 4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083 not found: ID does not exist" Jul 20 10:00:36.213181 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.213140 2564 scope.go:117] "RemoveContainer" containerID="67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a" Jul 20 10:00:36.213340 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.213325 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a"} err="failed to get container status \"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a\": rpc error: code = NotFound desc = could not find container \"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a\": container with ID starting with 67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a not found: ID does not exist" Jul 20 10:00:36.213385 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.213340 2564 scope.go:117] "RemoveContainer" containerID="10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea" Jul 20 10:00:36.213555 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.213540 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea"} err="failed to get container status \"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea\": rpc error: code = NotFound desc = could not find container \"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea\": container with ID starting with 10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea not found: ID does not exist" Jul 20 10:00:36.213555 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.213555 2564 scope.go:117] "RemoveContainer" containerID="3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3" Jul 20 10:00:36.213785 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.213765 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3"} err="failed to get container status \"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3\": rpc error: code = NotFound desc = could not find container \"3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3\": container with ID starting with 3f98fef5f5419520bd0ad18ea63ee9c04a78b0bcf18ccce0845dfb05123e34b3 not found: ID does not exist" Jul 20 10:00:36.213845 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.213787 2564 scope.go:117] "RemoveContainer" containerID="6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1" Jul 20 10:00:36.214000 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.213982 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1"} err="failed to get container status \"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1\": rpc error: code = NotFound desc = could not find container \"6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1\": container with ID starting with 6c4dca0378f38ca6ed0cad9d748468ce3933872537b752321794de6f6201cbe1 not found: ID does not exist" Jul 20 10:00:36.214045 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.214001 2564 scope.go:117] "RemoveContainer" containerID="d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec" Jul 20 10:00:36.214188 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.214171 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec"} err="failed to get container status \"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec\": rpc error: code = NotFound desc = could not find container \"d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec\": container with ID starting with d7f2d196acb88997430f051597c96bc515fd9a32618290e159157aa985e7e8ec not found: ID does not exist" Jul 20 10:00:36.214252 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.214190 2564 scope.go:117] "RemoveContainer" containerID="e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751" Jul 20 10:00:36.214396 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.214381 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751"} err="failed to get container status \"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751\": rpc error: code = NotFound desc = could not find container \"e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751\": container with ID starting with e92392f44bd239c25486d3056afa18533720bad6a765581139823bb100cad751 not found: ID does not exist" Jul 20 10:00:36.214450 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.214397 2564 scope.go:117] "RemoveContainer" containerID="4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083" Jul 20 10:00:36.214616 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.214599 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083"} err="failed to get container status \"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083\": rpc error: code = NotFound desc = could not find container \"4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083\": container with ID starting with 4af3fe80dced8679d0b54e24944bd6b8ac5a07c7fe35d762483ac98b307b1083 not found: ID does not exist" Jul 20 10:00:36.214659 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.214618 2564 scope.go:117] "RemoveContainer" containerID="67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a" Jul 20 10:00:36.214794 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.214777 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a"} err="failed to get container status \"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a\": rpc error: code = NotFound desc = could not find container \"67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a\": container with ID starting with 67657686a5e206054af54b17c106c6b4903e7adaf97c86ad1db55e8f85ab082a not found: ID does not exist" Jul 20 10:00:36.214852 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.214796 2564 scope.go:117] "RemoveContainer" containerID="10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea" Jul 20 10:00:36.214983 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.214965 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea"} err="failed to get container status \"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea\": rpc error: code = NotFound desc = could not find container \"10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea\": container with ID starting with 10a1ac433982e7c0b1f9201824333359da0c3e2883def0d3b8ba63ac11e804ea not found: ID does not exist" Jul 20 10:00:36.234345 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234322 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-db\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.234432 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234353 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-2\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.234432 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234383 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-serving-certs-ca-bundle\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.234432 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234411 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7319b963-1733-48c2-a5d7-54c205e4cf4a-config-out\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.234608 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234496 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-config\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.234608 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234537 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-metrics-client-ca\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.234608 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234569 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-tls\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.234608 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234598 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75mwn\" (UniqueName: \"kubernetes.io/projected/7319b963-1733-48c2-a5d7-54c205e4cf4a-kube-api-access-75mwn\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.234796 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234620 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-kubelet-serving-ca-bundle\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.234796 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234672 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-grpc-tls\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.234796 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234719 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-trusted-ca-bundle\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.234796 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234743 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.234796 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234749 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:36.235039 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234802 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-web-config\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.235039 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234840 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7319b963-1733-48c2-a5d7-54c205e4cf4a-tls-assets\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.235039 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234868 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-metrics-client-certs\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.235039 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234870 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:36.235039 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234896 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-kube-rbac-proxy\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.235039 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234935 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-1\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.235039 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.234977 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-thanos-prometheus-http-client-file\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.235039 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.235011 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.235039 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.235037 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-0\") pod \"7319b963-1733-48c2-a5d7-54c205e4cf4a\" (UID: \"7319b963-1733-48c2-a5d7-54c205e4cf4a\") " Jul 20 10:00:36.235482 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.235067 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:36.235482 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.235074 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:36.235482 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.235469 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:36.235654 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.235510 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.235654 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.235530 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.235654 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.235545 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.235654 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.235561 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-configmap-metrics-client-ca\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.237665 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.236856 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:00:36.237762 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.237738 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:36.237861 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.237838 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7319b963-1733-48c2-a5d7-54c205e4cf4a-config-out" (OuterVolumeSpecName: "config-out") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:00:36.237967 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.237946 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:36.238339 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.238288 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:36.238500 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.238332 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:36.238500 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.238337 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7319b963-1733-48c2-a5d7-54c205e4cf4a-kube-api-access-75mwn" (OuterVolumeSpecName: "kube-api-access-75mwn") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "kube-api-access-75mwn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:00:36.238659 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.238631 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-config" (OuterVolumeSpecName: "config") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:36.238776 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.238743 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:36.239140 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.239119 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7319b963-1733-48c2-a5d7-54c205e4cf4a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:00:36.239432 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.239407 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:36.239736 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.239714 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:36.239882 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.239866 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:36.239960 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.239941 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:36.249586 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.249568 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-web-config" (OuterVolumeSpecName: "web-config") pod "7319b963-1733-48c2-a5d7-54c205e4cf4a" (UID: "7319b963-1733-48c2-a5d7-54c205e4cf4a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:36.336522 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336488 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336522 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336519 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336522 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336529 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-web-config\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336680 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336538 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7319b963-1733-48c2-a5d7-54c205e4cf4a-tls-assets\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336680 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336546 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-metrics-client-certs\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336680 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336555 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-kube-rbac-proxy\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336680 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336563 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336680 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336572 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336680 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336582 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336680 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336590 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336680 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336598 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7319b963-1733-48c2-a5d7-54c205e4cf4a-prometheus-k8s-db\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336680 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336606 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7319b963-1733-48c2-a5d7-54c205e4cf4a-config-out\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336680 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336614 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-config\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336680 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336621 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336680 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336629 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75mwn\" (UniqueName: \"kubernetes.io/projected/7319b963-1733-48c2-a5d7-54c205e4cf4a-kube-api-access-75mwn\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.336680 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.336637 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7319b963-1733-48c2-a5d7-54c205e4cf4a-secret-grpc-tls\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:00:36.461938 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.461916 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:36.465827 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.465804 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:36.500160 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500136 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:36.500432 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500418 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="kube-rbac-proxy" Jul 20 10:00:36.500432 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500446 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="kube-rbac-proxy" Jul 20 10:00:36.500432 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500456 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="config-reloader" Jul 20 10:00:36.500547 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500462 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="config-reloader" Jul 20 10:00:36.500547 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500470 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="thanos-sidecar" Jul 20 10:00:36.500547 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500475 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="thanos-sidecar" Jul 20 10:00:36.500547 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500487 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="prometheus" Jul 20 10:00:36.500547 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500492 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="prometheus" Jul 20 10:00:36.500547 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500505 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="kube-rbac-proxy-thanos" Jul 20 10:00:36.500547 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500511 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="kube-rbac-proxy-thanos" Jul 20 10:00:36.500547 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500518 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="init-config-reloader" Jul 20 10:00:36.500547 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500523 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="init-config-reloader" Jul 20 10:00:36.500547 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500529 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="kube-rbac-proxy-web" Jul 20 10:00:36.500547 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500533 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="kube-rbac-proxy-web" Jul 20 10:00:36.500856 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500583 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="kube-rbac-proxy-thanos" Jul 20 10:00:36.500856 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500591 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="prometheus" Jul 20 10:00:36.500856 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500597 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="thanos-sidecar" Jul 20 10:00:36.500856 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500605 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="config-reloader" Jul 20 10:00:36.500856 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500610 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="kube-rbac-proxy-web" Jul 20 10:00:36.500856 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.500616 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" containerName="kube-rbac-proxy" Jul 20 10:00:36.505377 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.505361 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.508046 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.508027 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 20 10:00:36.508046 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.508041 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 20 10:00:36.508173 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.508035 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 20 10:00:36.508407 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.508391 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 20 10:00:36.508487 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.508423 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-83l8p6ag1fuit\"" Jul 20 10:00:36.508487 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.508458 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 20 10:00:36.508595 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.508540 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 20 10:00:36.508595 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.508553 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 20 10:00:36.508863 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.508842 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 20 10:00:36.508863 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.508856 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 20 10:00:36.508972 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.508920 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 20 10:00:36.509044 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.509026 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-trbcg\"" Jul 20 10:00:36.509165 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.509149 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 20 10:00:36.509638 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.509621 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 20 10:00:36.511311 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.511291 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 20 10:00:36.514536 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.514518 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 20 10:00:36.519470 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.519422 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:36.639789 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.639760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9eb326d6-a010-42a3-9283-8cdea92a9619-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.639916 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.639796 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.639916 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.639819 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.639916 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.639886 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640022 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.639937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640022 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.639961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640022 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.639980 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640022 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.640002 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9eb326d6-a010-42a3-9283-8cdea92a9619-config-out\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640138 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.640029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640138 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.640051 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640138 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.640071 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640138 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.640092 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-web-config\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640138 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.640112 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640287 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.640140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnth5\" (UniqueName: \"kubernetes.io/projected/9eb326d6-a010-42a3-9283-8cdea92a9619-kube-api-access-jnth5\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640287 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.640171 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640287 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.640196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640287 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.640212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-config\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640287 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.640235 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640287 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.640255 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.640287 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.640271 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.741406 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnth5\" (UniqueName: \"kubernetes.io/projected/9eb326d6-a010-42a3-9283-8cdea92a9619-kube-api-access-jnth5\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.741406 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.741406 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.741592 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741420 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-config\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.741592 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.741592 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741480 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.741592 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.741592 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9eb326d6-a010-42a3-9283-8cdea92a9619-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.741826 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.741826 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.741826 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.741826 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.741826 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.742057 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741834 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.742057 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741861 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9eb326d6-a010-42a3-9283-8cdea92a9619-config-out\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.742057 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.742057 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.742057 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.742057 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.741975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-web-config\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.742057 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.742000 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.742714 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.742378 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.742817 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.742747 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.745025 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.743080 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.745025 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.744964 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.745774 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.745614 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.746087 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.746059 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.746199 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.746066 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.746260 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.746232 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.746607 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.746561 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.746757 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.746735 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.746757 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.746750 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.746858 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.746764 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9eb326d6-a010-42a3-9283-8cdea92a9619-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.746858 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.746841 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.747015 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.746993 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9eb326d6-a010-42a3-9283-8cdea92a9619-config-out\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.747117 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.747097 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.747187 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.747143 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9eb326d6-a010-42a3-9283-8cdea92a9619-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.747257 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.747240 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-config\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.747298 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.747274 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-web-config\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.747735 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.747720 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9eb326d6-a010-42a3-9283-8cdea92a9619-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.750711 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.750692 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnth5\" (UniqueName: \"kubernetes.io/projected/9eb326d6-a010-42a3-9283-8cdea92a9619-kube-api-access-jnth5\") pod \"prometheus-k8s-0\" (UID: \"9eb326d6-a010-42a3-9283-8cdea92a9619\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.814769 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.814744 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:36.959107 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:36.959079 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:36.962006 ip-10-0-128-168 kubenswrapper[2564]: W0720 10:00:36.961980 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb326d6_a010_42a3_9283_8cdea92a9619.slice/crio-7876993524f65173bc5ad294577b8d89fd7803c3ff194210f3ee7b9f8a326ba3 WatchSource:0}: Error finding container 7876993524f65173bc5ad294577b8d89fd7803c3ff194210f3ee7b9f8a326ba3: Status 404 returned error can't find the container with id 7876993524f65173bc5ad294577b8d89fd7803c3ff194210f3ee7b9f8a326ba3 Jul 20 10:00:37.144517 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:37.144482 2564 generic.go:356] "Generic (PLEG): container finished" podID="9eb326d6-a010-42a3-9283-8cdea92a9619" containerID="954ee1265dea1c60cdfe3ece0fe8c5d9ac31c79ad06f50bb444d27d36fe62820" exitCode=0 Jul 20 10:00:37.144922 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:37.144564 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9eb326d6-a010-42a3-9283-8cdea92a9619","Type":"ContainerDied","Data":"954ee1265dea1c60cdfe3ece0fe8c5d9ac31c79ad06f50bb444d27d36fe62820"} Jul 20 10:00:37.144922 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:37.144648 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9eb326d6-a010-42a3-9283-8cdea92a9619","Type":"ContainerStarted","Data":"7876993524f65173bc5ad294577b8d89fd7803c3ff194210f3ee7b9f8a326ba3"} Jul 20 10:00:37.257788 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:37.257758 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7319b963-1733-48c2-a5d7-54c205e4cf4a" path="/var/lib/kubelet/pods/7319b963-1733-48c2-a5d7-54c205e4cf4a/volumes" Jul 20 10:00:38.154149 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:38.154077 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9eb326d6-a010-42a3-9283-8cdea92a9619","Type":"ContainerStarted","Data":"68de28bbde83fa09c4c6b520183c1b15279d3dfd41d15136b28af2ed16572b28"} Jul 20 10:00:38.154149 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:38.154134 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9eb326d6-a010-42a3-9283-8cdea92a9619","Type":"ContainerStarted","Data":"7c7a577e53d0803d6f65d48e1db768c0db022ae8199af89da71639a587975bac"} Jul 20 10:00:38.154556 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:38.154161 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9eb326d6-a010-42a3-9283-8cdea92a9619","Type":"ContainerStarted","Data":"89b0329ba539084ab59de1b87dff362c215a287f20dba79e12acc8ded6def791"} Jul 20 10:00:38.154556 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:38.154185 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9eb326d6-a010-42a3-9283-8cdea92a9619","Type":"ContainerStarted","Data":"d8dd2b337d692459894d614e235e7a98be30e481db81469de6aff7e56d7682fb"} Jul 20 10:00:38.154556 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:38.154209 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9eb326d6-a010-42a3-9283-8cdea92a9619","Type":"ContainerStarted","Data":"66220ba814aae41196f0258f664adf420b4231133f6fc5a7d8d267ea0b27fa89"} Jul 20 10:00:38.154556 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:38.154234 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9eb326d6-a010-42a3-9283-8cdea92a9619","Type":"ContainerStarted","Data":"3c99e38e6227a768e242da255ffb0b8003ad8b21beb6dbbbc3913e11f4afac95"} Jul 20 10:00:38.186528 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:38.186480 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.165064967 podStartE2EDuration="2.186464085s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.399118ms" isStatefulPod=false podCreationTimestamp="2026-07-20 10:00:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:00:38.184736758 +0000 UTC m=+203.443141433" watchObservedRunningTime="2026-07-20 10:00:38.186464085 +0000 UTC m=+203.444868767" Jul 20 10:00:41.815371 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:41.815324 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.575944 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:00:51.575907 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84599d74bb-k2xkd"] Jul 20 10:01:16.602951 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.602892 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84599d74bb-k2xkd" podUID="ee44527c-8247-4ab1-bcc7-7649395b68c9" containerName="console" containerID="cri-o://ce162d0dcde5091a856d9fa4ccf7b510eb77c00f0b1bede0210629268fe8f372" gracePeriod=15 Jul 20 10:01:16.842959 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.842937 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 10:01:16.857637 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.857580 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-service-ca\") pod \"ee44527c-8247-4ab1-bcc7-7649395b68c9\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " Jul 20 10:01:16.857637 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.857618 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-oauth-serving-cert\") pod \"ee44527c-8247-4ab1-bcc7-7649395b68c9\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " Jul 20 10:01:16.857803 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.857670 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbwlz\" (UniqueName: \"kubernetes.io/projected/ee44527c-8247-4ab1-bcc7-7649395b68c9-kube-api-access-rbwlz\") pod \"ee44527c-8247-4ab1-bcc7-7649395b68c9\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " Jul 20 10:01:16.857803 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.857722 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-config\") pod \"ee44527c-8247-4ab1-bcc7-7649395b68c9\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " Jul 20 10:01:16.857902 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.857843 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-serving-cert\") pod \"ee44527c-8247-4ab1-bcc7-7649395b68c9\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " Jul 20 10:01:16.857902 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.857894 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-trusted-ca-bundle\") pod \"ee44527c-8247-4ab1-bcc7-7649395b68c9\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " Jul 20 10:01:16.858007 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.857928 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-oauth-config\") pod \"ee44527c-8247-4ab1-bcc7-7649395b68c9\" (UID: \"ee44527c-8247-4ab1-bcc7-7649395b68c9\") " Jul 20 10:01:16.858007 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.857999 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-service-ca" (OuterVolumeSpecName: "service-ca") pod "ee44527c-8247-4ab1-bcc7-7649395b68c9" (UID: "ee44527c-8247-4ab1-bcc7-7649395b68c9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:01:16.858108 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.858061 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ee44527c-8247-4ab1-bcc7-7649395b68c9" (UID: "ee44527c-8247-4ab1-bcc7-7649395b68c9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:01:16.858108 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.858085 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-config" (OuterVolumeSpecName: "console-config") pod "ee44527c-8247-4ab1-bcc7-7649395b68c9" (UID: "ee44527c-8247-4ab1-bcc7-7649395b68c9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:01:16.858230 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.858213 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-service-ca\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:01:16.858330 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.858309 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-oauth-serving-cert\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:01:16.858330 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.858331 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-config\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:01:16.858525 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.858430 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ee44527c-8247-4ab1-bcc7-7649395b68c9" (UID: "ee44527c-8247-4ab1-bcc7-7649395b68c9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:01:16.859953 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.859930 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ee44527c-8247-4ab1-bcc7-7649395b68c9" (UID: "ee44527c-8247-4ab1-bcc7-7649395b68c9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:01:16.860208 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.860189 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee44527c-8247-4ab1-bcc7-7649395b68c9-kube-api-access-rbwlz" (OuterVolumeSpecName: "kube-api-access-rbwlz") pod "ee44527c-8247-4ab1-bcc7-7649395b68c9" (UID: "ee44527c-8247-4ab1-bcc7-7649395b68c9"). InnerVolumeSpecName "kube-api-access-rbwlz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:01:16.860208 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.860195 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ee44527c-8247-4ab1-bcc7-7649395b68c9" (UID: "ee44527c-8247-4ab1-bcc7-7649395b68c9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:01:16.959398 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.959366 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbwlz\" (UniqueName: \"kubernetes.io/projected/ee44527c-8247-4ab1-bcc7-7649395b68c9-kube-api-access-rbwlz\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:01:16.959398 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.959397 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-serving-cert\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:01:16.959547 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.959407 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee44527c-8247-4ab1-bcc7-7649395b68c9-trusted-ca-bundle\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:01:16.959547 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:16.959417 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee44527c-8247-4ab1-bcc7-7649395b68c9-console-oauth-config\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:01:17.319103 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:17.319070 2564 generic.go:356] "Generic (PLEG): container finished" podID="ee44527c-8247-4ab1-bcc7-7649395b68c9" containerID="ce162d0dcde5091a856d9fa4ccf7b510eb77c00f0b1bede0210629268fe8f372" exitCode=0 Jul 20 10:01:17.319258 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:17.319145 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84599d74bb-k2xkd" Jul 20 10:01:17.319258 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:17.319158 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84599d74bb-k2xkd" event={"ID":"ee44527c-8247-4ab1-bcc7-7649395b68c9","Type":"ContainerDied","Data":"ce162d0dcde5091a856d9fa4ccf7b510eb77c00f0b1bede0210629268fe8f372"} Jul 20 10:01:17.319258 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:17.319215 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84599d74bb-k2xkd" event={"ID":"ee44527c-8247-4ab1-bcc7-7649395b68c9","Type":"ContainerDied","Data":"5feed006008b449451c0b8c1e0710f154f2d38677999c5f0e056f4751e16459b"} Jul 20 10:01:17.319258 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:17.319241 2564 scope.go:117] "RemoveContainer" containerID="ce162d0dcde5091a856d9fa4ccf7b510eb77c00f0b1bede0210629268fe8f372" Jul 20 10:01:17.329121 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:17.329094 2564 scope.go:117] "RemoveContainer" containerID="ce162d0dcde5091a856d9fa4ccf7b510eb77c00f0b1bede0210629268fe8f372" Jul 20 10:01:17.329350 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:01:17.329331 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce162d0dcde5091a856d9fa4ccf7b510eb77c00f0b1bede0210629268fe8f372\": container with ID starting with ce162d0dcde5091a856d9fa4ccf7b510eb77c00f0b1bede0210629268fe8f372 not found: ID does not exist" containerID="ce162d0dcde5091a856d9fa4ccf7b510eb77c00f0b1bede0210629268fe8f372" Jul 20 10:01:17.329430 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:17.329357 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce162d0dcde5091a856d9fa4ccf7b510eb77c00f0b1bede0210629268fe8f372"} err="failed to get container status \"ce162d0dcde5091a856d9fa4ccf7b510eb77c00f0b1bede0210629268fe8f372\": rpc error: code = NotFound desc = could not find container \"ce162d0dcde5091a856d9fa4ccf7b510eb77c00f0b1bede0210629268fe8f372\": container with ID starting with ce162d0dcde5091a856d9fa4ccf7b510eb77c00f0b1bede0210629268fe8f372 not found: ID does not exist" Jul 20 10:01:17.333690 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:17.333668 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84599d74bb-k2xkd"] Jul 20 10:01:17.337924 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:17.337902 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84599d74bb-k2xkd"] Jul 20 10:01:17.837526 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:17.837477 2564 patch_prober.go:28] interesting pod/console-84599d74bb-k2xkd container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.21:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 20 10:01:17.837922 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:17.837564 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-84599d74bb-k2xkd" podUID="ee44527c-8247-4ab1-bcc7-7649395b68c9" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 20 10:01:19.256837 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:19.256807 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee44527c-8247-4ab1-bcc7-7649395b68c9" path="/var/lib/kubelet/pods/ee44527c-8247-4ab1-bcc7-7649395b68c9/volumes" Jul 20 10:01:36.814969 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:36.814885 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:01:36.830108 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:36.830086 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:01:37.412834 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:01:37.412809 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:02:15.132860 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:02:15.132830 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/1.log" Jul 20 10:02:15.135905 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:02:15.135879 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/1.log" Jul 20 10:02:15.145377 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:02:15.145357 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 10:06:38.843959 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:38.843929 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-zhffs"] Jul 20 10:06:38.844420 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:38.844260 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee44527c-8247-4ab1-bcc7-7649395b68c9" containerName="console" Jul 20 10:06:38.844420 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:38.844272 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee44527c-8247-4ab1-bcc7-7649395b68c9" containerName="console" Jul 20 10:06:38.844420 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:38.844323 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee44527c-8247-4ab1-bcc7-7649395b68c9" containerName="console" Jul 20 10:06:38.847355 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:38.847339 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-zhffs" Jul 20 10:06:38.849526 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:38.849507 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 20 10:06:38.849665 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:38.849562 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-zk8mq\"" Jul 20 10:06:38.849665 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:38.849615 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 20 10:06:38.850009 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:38.849994 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 20 10:06:38.855178 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:38.855159 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-zhffs"] Jul 20 10:06:38.931933 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:38.931906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/358c15a0-cba2-4a84-806d-c75057dbd95b-model-cache\") pod \"s3-init-zhffs\" (UID: \"358c15a0-cba2-4a84-806d-c75057dbd95b\") " pod="kserve/s3-init-zhffs" Jul 20 10:06:38.932021 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:38.931948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtxjm\" (UniqueName: \"kubernetes.io/projected/358c15a0-cba2-4a84-806d-c75057dbd95b-kube-api-access-gtxjm\") pod \"s3-init-zhffs\" (UID: \"358c15a0-cba2-4a84-806d-c75057dbd95b\") " pod="kserve/s3-init-zhffs" Jul 20 10:06:39.032564 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:39.032534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/358c15a0-cba2-4a84-806d-c75057dbd95b-model-cache\") pod \"s3-init-zhffs\" (UID: \"358c15a0-cba2-4a84-806d-c75057dbd95b\") " pod="kserve/s3-init-zhffs" Jul 20 10:06:39.032667 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:39.032584 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtxjm\" (UniqueName: \"kubernetes.io/projected/358c15a0-cba2-4a84-806d-c75057dbd95b-kube-api-access-gtxjm\") pod \"s3-init-zhffs\" (UID: \"358c15a0-cba2-4a84-806d-c75057dbd95b\") " pod="kserve/s3-init-zhffs" Jul 20 10:06:39.032882 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:39.032865 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/358c15a0-cba2-4a84-806d-c75057dbd95b-model-cache\") pod \"s3-init-zhffs\" (UID: \"358c15a0-cba2-4a84-806d-c75057dbd95b\") " pod="kserve/s3-init-zhffs" Jul 20 10:06:39.043030 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:39.043011 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtxjm\" (UniqueName: \"kubernetes.io/projected/358c15a0-cba2-4a84-806d-c75057dbd95b-kube-api-access-gtxjm\") pod \"s3-init-zhffs\" (UID: \"358c15a0-cba2-4a84-806d-c75057dbd95b\") " pod="kserve/s3-init-zhffs" Jul 20 10:06:39.156759 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:39.156737 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-zhffs" Jul 20 10:06:39.286721 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:39.286699 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-zhffs"] Jul 20 10:06:39.289487 ip-10-0-128-168 kubenswrapper[2564]: W0720 10:06:39.289464 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod358c15a0_cba2_4a84_806d_c75057dbd95b.slice/crio-cc2a7557965525ebf3d05e243bc30fadec8626700faf1d567cadceaa62bfc380 WatchSource:0}: Error finding container cc2a7557965525ebf3d05e243bc30fadec8626700faf1d567cadceaa62bfc380: Status 404 returned error can't find the container with id cc2a7557965525ebf3d05e243bc30fadec8626700faf1d567cadceaa62bfc380 Jul 20 10:06:39.291711 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:39.291697 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 10:06:39.559325 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:39.559243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-zhffs" event={"ID":"358c15a0-cba2-4a84-806d-c75057dbd95b","Type":"ContainerStarted","Data":"cc2a7557965525ebf3d05e243bc30fadec8626700faf1d567cadceaa62bfc380"} Jul 20 10:06:43.581045 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:43.581014 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-zhffs" event={"ID":"358c15a0-cba2-4a84-806d-c75057dbd95b","Type":"ContainerStarted","Data":"2721dff6e9bb34fe43724aeaf4c66f4df22d52d29fc6f532800425b96bbdb0f6"} Jul 20 10:06:44.586062 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:44.585980 2564 generic.go:356] "Generic (PLEG): container finished" podID="358c15a0-cba2-4a84-806d-c75057dbd95b" containerID="2721dff6e9bb34fe43724aeaf4c66f4df22d52d29fc6f532800425b96bbdb0f6" exitCode=0 Jul 20 10:06:44.586062 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:44.586020 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-zhffs" event={"ID":"358c15a0-cba2-4a84-806d-c75057dbd95b","Type":"ContainerDied","Data":"2721dff6e9bb34fe43724aeaf4c66f4df22d52d29fc6f532800425b96bbdb0f6"} Jul 20 10:06:49.610068 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:49.610033 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-zhffs" event={"ID":"358c15a0-cba2-4a84-806d-c75057dbd95b","Type":"ContainerStarted","Data":"6120216ce357aa02d926c765ef2cad1ca9e6bffbb8217d3c5a306b8d53a66727"} Jul 20 10:06:49.631355 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:06:49.631294 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-zhffs" podStartSLOduration=2.258725871 podStartE2EDuration="11.63127631s" totalImagesPullingTime="8.205500096s" totalInitContainerRuntime="1.167050343s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:06:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:06:49.626691809 +0000 UTC m=+574.885096489" watchObservedRunningTime="2026-07-20 10:06:49.63127631 +0000 UTC m=+574.889680986" Jul 20 10:07:15.162361 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:07:15.162333 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/1.log" Jul 20 10:07:15.162844 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:07:15.162418 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/1.log" Jul 20 10:07:54.858785 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:07:54.858755 2564 generic.go:356] "Generic (PLEG): container finished" podID="358c15a0-cba2-4a84-806d-c75057dbd95b" containerID="6120216ce357aa02d926c765ef2cad1ca9e6bffbb8217d3c5a306b8d53a66727" exitCode=0 Jul 20 10:07:54.859194 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:07:54.858835 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-zhffs" event={"ID":"358c15a0-cba2-4a84-806d-c75057dbd95b","Type":"ContainerDied","Data":"6120216ce357aa02d926c765ef2cad1ca9e6bffbb8217d3c5a306b8d53a66727"} Jul 20 10:07:55.991479 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:07:55.991455 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-zhffs" Jul 20 10:07:56.159490 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:07:56.159401 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/358c15a0-cba2-4a84-806d-c75057dbd95b-model-cache\") pod \"358c15a0-cba2-4a84-806d-c75057dbd95b\" (UID: \"358c15a0-cba2-4a84-806d-c75057dbd95b\") " Jul 20 10:07:56.159647 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:07:56.159505 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtxjm\" (UniqueName: \"kubernetes.io/projected/358c15a0-cba2-4a84-806d-c75057dbd95b-kube-api-access-gtxjm\") pod \"358c15a0-cba2-4a84-806d-c75057dbd95b\" (UID: \"358c15a0-cba2-4a84-806d-c75057dbd95b\") " Jul 20 10:07:56.161747 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:07:56.161721 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358c15a0-cba2-4a84-806d-c75057dbd95b-kube-api-access-gtxjm" (OuterVolumeSpecName: "kube-api-access-gtxjm") pod "358c15a0-cba2-4a84-806d-c75057dbd95b" (UID: "358c15a0-cba2-4a84-806d-c75057dbd95b"). InnerVolumeSpecName "kube-api-access-gtxjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:07:56.178164 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:07:56.178137 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/358c15a0-cba2-4a84-806d-c75057dbd95b-model-cache" (OuterVolumeSpecName: "model-cache") pod "358c15a0-cba2-4a84-806d-c75057dbd95b" (UID: "358c15a0-cba2-4a84-806d-c75057dbd95b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:07:56.260795 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:07:56.260773 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/358c15a0-cba2-4a84-806d-c75057dbd95b-model-cache\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:07:56.260795 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:07:56.260792 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtxjm\" (UniqueName: \"kubernetes.io/projected/358c15a0-cba2-4a84-806d-c75057dbd95b-kube-api-access-gtxjm\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:07:56.870251 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:07:56.870219 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-zhffs" event={"ID":"358c15a0-cba2-4a84-806d-c75057dbd95b","Type":"ContainerDied","Data":"cc2a7557965525ebf3d05e243bc30fadec8626700faf1d567cadceaa62bfc380"} Jul 20 10:07:56.870251 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:07:56.870237 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-zhffs" Jul 20 10:07:56.870251 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:07:56.870256 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc2a7557965525ebf3d05e243bc30fadec8626700faf1d567cadceaa62bfc380" Jul 20 10:11:55.578656 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.578626 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb"] Jul 20 10:11:55.579105 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.578941 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="358c15a0-cba2-4a84-806d-c75057dbd95b" containerName="download-hf-model" Jul 20 10:11:55.579105 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.578952 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="358c15a0-cba2-4a84-806d-c75057dbd95b" containerName="download-hf-model" Jul 20 10:11:55.579105 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.578961 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="358c15a0-cba2-4a84-806d-c75057dbd95b" containerName="s3-init" Jul 20 10:11:55.579105 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.578966 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="358c15a0-cba2-4a84-806d-c75057dbd95b" containerName="s3-init" Jul 20 10:11:55.579105 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.579023 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="358c15a0-cba2-4a84-806d-c75057dbd95b" containerName="s3-init" Jul 20 10:11:55.581290 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.581275 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:55.583948 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.583922 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-0bd3d-kube-rbac-proxy-sar-config\"" Jul 20 10:11:55.584080 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.583980 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 20 10:11:55.584146 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.584087 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 20 10:11:55.584495 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.584467 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-jbsdb\"" Jul 20 10:11:55.584614 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.584498 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 20 10:11:55.584614 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.584589 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 20 10:11:55.584733 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.584659 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-serving-cert\"" Jul 20 10:11:55.594631 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.594611 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb"] Jul 20 10:11:55.643654 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.643628 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/352a995a-0109-4338-8ced-1bdef39b05e5-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:55.643777 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.643668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/352a995a-0109-4338-8ced-1bdef39b05e5-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:55.643777 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.643720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqwn6\" (UniqueName: \"kubernetes.io/projected/352a995a-0109-4338-8ced-1bdef39b05e5-kube-api-access-cqwn6\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:55.643848 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.643792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/352a995a-0109-4338-8ced-1bdef39b05e5-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:55.643848 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.643817 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/352a995a-0109-4338-8ced-1bdef39b05e5-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:55.744785 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.744759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/352a995a-0109-4338-8ced-1bdef39b05e5-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:55.744934 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.744796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqwn6\" (UniqueName: \"kubernetes.io/projected/352a995a-0109-4338-8ced-1bdef39b05e5-kube-api-access-cqwn6\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:55.744934 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.744855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/352a995a-0109-4338-8ced-1bdef39b05e5-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:55.744934 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.744887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/352a995a-0109-4338-8ced-1bdef39b05e5-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:55.745052 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.744935 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/352a995a-0109-4338-8ced-1bdef39b05e5-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:55.745052 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:11:55.744995 2564 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-serving-cert: secret "isvc-xgboost-graph-raw-hpa-0bd3d-predictor-serving-cert" not found Jul 20 10:11:55.745151 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:11:55.745060 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352a995a-0109-4338-8ced-1bdef39b05e5-proxy-tls podName:352a995a-0109-4338-8ced-1bdef39b05e5 nodeName:}" failed. No retries permitted until 2026-07-20 10:11:56.245041189 +0000 UTC m=+881.503445842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/352a995a-0109-4338-8ced-1bdef39b05e5-proxy-tls") pod "isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" (UID: "352a995a-0109-4338-8ced-1bdef39b05e5") : secret "isvc-xgboost-graph-raw-hpa-0bd3d-predictor-serving-cert" not found Jul 20 10:11:55.745206 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.745193 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/352a995a-0109-4338-8ced-1bdef39b05e5-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:55.745528 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.745511 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/352a995a-0109-4338-8ced-1bdef39b05e5-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:55.745604 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.745588 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/352a995a-0109-4338-8ced-1bdef39b05e5-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:55.755607 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:55.755576 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqwn6\" (UniqueName: \"kubernetes.io/projected/352a995a-0109-4338-8ced-1bdef39b05e5-kube-api-access-cqwn6\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:56.249017 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:56.248979 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/352a995a-0109-4338-8ced-1bdef39b05e5-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:56.251329 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:56.251304 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/352a995a-0109-4338-8ced-1bdef39b05e5-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:56.492194 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:56.492165 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:11:56.627290 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:56.627260 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb"] Jul 20 10:11:56.630768 ip-10-0-128-168 kubenswrapper[2564]: W0720 10:11:56.630742 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod352a995a_0109_4338_8ced_1bdef39b05e5.slice/crio-ab4ba030db95ffe4f515ad69de5d903b2ea83f8c2dad37628cd656a22d53b411 WatchSource:0}: Error finding container ab4ba030db95ffe4f515ad69de5d903b2ea83f8c2dad37628cd656a22d53b411: Status 404 returned error can't find the container with id ab4ba030db95ffe4f515ad69de5d903b2ea83f8c2dad37628cd656a22d53b411 Jul 20 10:11:56.814148 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:56.814070 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" event={"ID":"352a995a-0109-4338-8ced-1bdef39b05e5","Type":"ContainerStarted","Data":"001ae0664c57ec434377a02a1ac2d0550949a7e2b7c98c6b76c7b739ca01ca9d"} Jul 20 10:11:56.814148 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:11:56.814146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" event={"ID":"352a995a-0109-4338-8ced-1bdef39b05e5","Type":"ContainerStarted","Data":"ab4ba030db95ffe4f515ad69de5d903b2ea83f8c2dad37628cd656a22d53b411"} Jul 20 10:12:00.832993 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:00.832962 2564 generic.go:356] "Generic (PLEG): container finished" podID="352a995a-0109-4338-8ced-1bdef39b05e5" containerID="001ae0664c57ec434377a02a1ac2d0550949a7e2b7c98c6b76c7b739ca01ca9d" exitCode=0 Jul 20 10:12:00.833368 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:00.833018 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" event={"ID":"352a995a-0109-4338-8ced-1bdef39b05e5","Type":"ContainerDied","Data":"001ae0664c57ec434377a02a1ac2d0550949a7e2b7c98c6b76c7b739ca01ca9d"} Jul 20 10:12:00.834338 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:00.834322 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 10:12:19.806907 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:19.806881 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/1.log" Jul 20 10:12:19.807293 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:19.806891 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/1.log" Jul 20 10:12:20.925276 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:20.925242 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" event={"ID":"352a995a-0109-4338-8ced-1bdef39b05e5","Type":"ContainerStarted","Data":"0c41dcd39c2e3f24601e9ce395f4a108b2fecb5f99437c909d7772949db9d74a"} Jul 20 10:12:22.935785 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:22.935743 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" event={"ID":"352a995a-0109-4338-8ced-1bdef39b05e5","Type":"ContainerStarted","Data":"a6571b62f8182df4b76c6fde9f62269252b536a1e833f484d7970044f00b25c1"} Jul 20 10:12:22.936340 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:22.935846 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:12:22.959085 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:22.959042 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" podStartSLOduration=2.999189056 podStartE2EDuration="27.9590293s" totalImagesPullingTime="21.323492976s" totalInitContainerRuntime="3.636347268s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:11:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:12:22.95697392 +0000 UTC m=+908.215378606" watchObservedRunningTime="2026-07-20 10:12:22.9590293 +0000 UTC m=+908.217433975" Jul 20 10:12:23.940249 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:23.940217 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:12:23.941648 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:23.941622 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 20 10:12:24.944449 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:24.944410 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 20 10:12:29.948624 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:29.948596 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:12:29.949101 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:29.949074 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 20 10:12:39.949111 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:39.949072 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 20 10:12:49.949565 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:49.949530 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 20 10:12:59.949629 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:12:59.949590 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 20 10:13:09.949245 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:09.949208 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Jul 20 10:13:19.949532 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:19.949502 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:13:46.372730 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:46.372655 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb"] Jul 20 10:13:46.373193 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:46.372924 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kserve-container" containerID="cri-o://0c41dcd39c2e3f24601e9ce395f4a108b2fecb5f99437c909d7772949db9d74a" gracePeriod=30 Jul 20 10:13:46.373193 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:46.372946 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kube-rbac-proxy" containerID="cri-o://a6571b62f8182df4b76c6fde9f62269252b536a1e833f484d7970044f00b25c1" gracePeriod=30 Jul 20 10:13:47.267226 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:47.267192 2564 generic.go:356] "Generic (PLEG): container finished" podID="352a995a-0109-4338-8ced-1bdef39b05e5" containerID="a6571b62f8182df4b76c6fde9f62269252b536a1e833f484d7970044f00b25c1" exitCode=2 Jul 20 10:13:47.267387 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:47.267267 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" event={"ID":"352a995a-0109-4338-8ced-1bdef39b05e5","Type":"ContainerDied","Data":"a6571b62f8182df4b76c6fde9f62269252b536a1e833f484d7970044f00b25c1"} Jul 20 10:13:49.609185 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.609165 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:13:49.676696 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.676643 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/352a995a-0109-4338-8ced-1bdef39b05e5-kserve-provision-location\") pod \"352a995a-0109-4338-8ced-1bdef39b05e5\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " Jul 20 10:13:49.676789 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.676715 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqwn6\" (UniqueName: \"kubernetes.io/projected/352a995a-0109-4338-8ced-1bdef39b05e5-kube-api-access-cqwn6\") pod \"352a995a-0109-4338-8ced-1bdef39b05e5\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " Jul 20 10:13:49.676789 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.676744 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/352a995a-0109-4338-8ced-1bdef39b05e5-proxy-tls\") pod \"352a995a-0109-4338-8ced-1bdef39b05e5\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " Jul 20 10:13:49.676907 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.676795 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/352a995a-0109-4338-8ced-1bdef39b05e5-cabundle-cert\") pod \"352a995a-0109-4338-8ced-1bdef39b05e5\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " Jul 20 10:13:49.676907 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.676822 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/352a995a-0109-4338-8ced-1bdef39b05e5-kube-rbac-proxy-sar-config\") pod \"352a995a-0109-4338-8ced-1bdef39b05e5\" (UID: \"352a995a-0109-4338-8ced-1bdef39b05e5\") " Jul 20 10:13:49.677072 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.676969 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/352a995a-0109-4338-8ced-1bdef39b05e5-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "352a995a-0109-4338-8ced-1bdef39b05e5" (UID: "352a995a-0109-4338-8ced-1bdef39b05e5"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:13:49.677129 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.677084 2564 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/352a995a-0109-4338-8ced-1bdef39b05e5-kserve-provision-location\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:13:49.677247 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.677220 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/352a995a-0109-4338-8ced-1bdef39b05e5-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "352a995a-0109-4338-8ced-1bdef39b05e5" (UID: "352a995a-0109-4338-8ced-1bdef39b05e5"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:13:49.677291 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.677226 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/352a995a-0109-4338-8ced-1bdef39b05e5-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "352a995a-0109-4338-8ced-1bdef39b05e5" (UID: "352a995a-0109-4338-8ced-1bdef39b05e5"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:13:49.678939 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.678916 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/352a995a-0109-4338-8ced-1bdef39b05e5-kube-api-access-cqwn6" (OuterVolumeSpecName: "kube-api-access-cqwn6") pod "352a995a-0109-4338-8ced-1bdef39b05e5" (UID: "352a995a-0109-4338-8ced-1bdef39b05e5"). InnerVolumeSpecName "kube-api-access-cqwn6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:13:49.679014 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.678945 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/352a995a-0109-4338-8ced-1bdef39b05e5-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "352a995a-0109-4338-8ced-1bdef39b05e5" (UID: "352a995a-0109-4338-8ced-1bdef39b05e5"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:13:49.778298 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.778275 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqwn6\" (UniqueName: \"kubernetes.io/projected/352a995a-0109-4338-8ced-1bdef39b05e5-kube-api-access-cqwn6\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:13:49.778298 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.778295 2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/352a995a-0109-4338-8ced-1bdef39b05e5-proxy-tls\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:13:49.778424 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.778304 2564 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/352a995a-0109-4338-8ced-1bdef39b05e5-cabundle-cert\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:13:49.778424 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:49.778314 2564 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/352a995a-0109-4338-8ced-1bdef39b05e5-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:13:50.281069 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.281029 2564 generic.go:356] "Generic (PLEG): container finished" podID="352a995a-0109-4338-8ced-1bdef39b05e5" containerID="0c41dcd39c2e3f24601e9ce395f4a108b2fecb5f99437c909d7772949db9d74a" exitCode=0 Jul 20 10:13:50.281228 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.281077 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" Jul 20 10:13:50.281228 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.281112 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" event={"ID":"352a995a-0109-4338-8ced-1bdef39b05e5","Type":"ContainerDied","Data":"0c41dcd39c2e3f24601e9ce395f4a108b2fecb5f99437c909d7772949db9d74a"} Jul 20 10:13:50.281228 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.281168 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb" event={"ID":"352a995a-0109-4338-8ced-1bdef39b05e5","Type":"ContainerDied","Data":"ab4ba030db95ffe4f515ad69de5d903b2ea83f8c2dad37628cd656a22d53b411"} Jul 20 10:13:50.281228 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.281196 2564 scope.go:117] "RemoveContainer" containerID="a6571b62f8182df4b76c6fde9f62269252b536a1e833f484d7970044f00b25c1" Jul 20 10:13:50.291249 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.291168 2564 scope.go:117] "RemoveContainer" containerID="0c41dcd39c2e3f24601e9ce395f4a108b2fecb5f99437c909d7772949db9d74a" Jul 20 10:13:50.298958 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.298940 2564 scope.go:117] "RemoveContainer" containerID="001ae0664c57ec434377a02a1ac2d0550949a7e2b7c98c6b76c7b739ca01ca9d" Jul 20 10:13:50.304912 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.304893 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb"] Jul 20 10:13:50.306352 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.306339 2564 scope.go:117] "RemoveContainer" containerID="a6571b62f8182df4b76c6fde9f62269252b536a1e833f484d7970044f00b25c1" Jul 20 10:13:50.306683 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:13:50.306659 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6571b62f8182df4b76c6fde9f62269252b536a1e833f484d7970044f00b25c1\": container with ID starting with a6571b62f8182df4b76c6fde9f62269252b536a1e833f484d7970044f00b25c1 not found: ID does not exist" containerID="a6571b62f8182df4b76c6fde9f62269252b536a1e833f484d7970044f00b25c1" Jul 20 10:13:50.306756 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.306690 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6571b62f8182df4b76c6fde9f62269252b536a1e833f484d7970044f00b25c1"} err="failed to get container status \"a6571b62f8182df4b76c6fde9f62269252b536a1e833f484d7970044f00b25c1\": rpc error: code = NotFound desc = could not find container \"a6571b62f8182df4b76c6fde9f62269252b536a1e833f484d7970044f00b25c1\": container with ID starting with a6571b62f8182df4b76c6fde9f62269252b536a1e833f484d7970044f00b25c1 not found: ID does not exist" Jul 20 10:13:50.306756 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.306704 2564 scope.go:117] "RemoveContainer" containerID="0c41dcd39c2e3f24601e9ce395f4a108b2fecb5f99437c909d7772949db9d74a" Jul 20 10:13:50.307042 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:13:50.307025 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c41dcd39c2e3f24601e9ce395f4a108b2fecb5f99437c909d7772949db9d74a\": container with ID starting with 0c41dcd39c2e3f24601e9ce395f4a108b2fecb5f99437c909d7772949db9d74a not found: ID does not exist" containerID="0c41dcd39c2e3f24601e9ce395f4a108b2fecb5f99437c909d7772949db9d74a" Jul 20 10:13:50.307086 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.307046 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c41dcd39c2e3f24601e9ce395f4a108b2fecb5f99437c909d7772949db9d74a"} err="failed to get container status \"0c41dcd39c2e3f24601e9ce395f4a108b2fecb5f99437c909d7772949db9d74a\": rpc error: code = NotFound desc = could not find container \"0c41dcd39c2e3f24601e9ce395f4a108b2fecb5f99437c909d7772949db9d74a\": container with ID starting with 0c41dcd39c2e3f24601e9ce395f4a108b2fecb5f99437c909d7772949db9d74a not found: ID does not exist" Jul 20 10:13:50.307086 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.307065 2564 scope.go:117] "RemoveContainer" containerID="001ae0664c57ec434377a02a1ac2d0550949a7e2b7c98c6b76c7b739ca01ca9d" Jul 20 10:13:50.307334 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:13:50.307317 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"001ae0664c57ec434377a02a1ac2d0550949a7e2b7c98c6b76c7b739ca01ca9d\": container with ID starting with 001ae0664c57ec434377a02a1ac2d0550949a7e2b7c98c6b76c7b739ca01ca9d not found: ID does not exist" containerID="001ae0664c57ec434377a02a1ac2d0550949a7e2b7c98c6b76c7b739ca01ca9d" Jul 20 10:13:50.307384 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.307340 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"001ae0664c57ec434377a02a1ac2d0550949a7e2b7c98c6b76c7b739ca01ca9d"} err="failed to get container status \"001ae0664c57ec434377a02a1ac2d0550949a7e2b7c98c6b76c7b739ca01ca9d\": rpc error: code = NotFound desc = could not find container \"001ae0664c57ec434377a02a1ac2d0550949a7e2b7c98c6b76c7b739ca01ca9d\": container with ID starting with 001ae0664c57ec434377a02a1ac2d0550949a7e2b7c98c6b76c7b739ca01ca9d not found: ID does not exist" Jul 20 10:13:50.310335 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:50.310316 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-0bd3d-predictor-8556478b9c-crbhb"] Jul 20 10:13:51.257191 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:13:51.257159 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" path="/var/lib/kubelet/pods/352a995a-0109-4338-8ced-1bdef39b05e5/volumes" Jul 20 10:17:19.838690 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:17:19.838664 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/1.log" Jul 20 10:17:19.841058 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:17:19.841039 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/1.log" Jul 20 10:22:19.870739 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:22:19.870713 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/1.log" Jul 20 10:22:19.874103 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:22:19.874082 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/1.log" Jul 20 10:24:21.685615 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.685578 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xht4p/must-gather-j9zlv"] Jul 20 10:24:21.686198 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.686046 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kserve-container" Jul 20 10:24:21.686198 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.686065 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kserve-container" Jul 20 10:24:21.686198 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.686077 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kube-rbac-proxy" Jul 20 10:24:21.686198 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.686086 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kube-rbac-proxy" Jul 20 10:24:21.686198 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.686128 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="storage-initializer" Jul 20 10:24:21.686198 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.686136 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="storage-initializer" Jul 20 10:24:21.686540 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.686218 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kube-rbac-proxy" Jul 20 10:24:21.686540 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.686228 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="352a995a-0109-4338-8ced-1bdef39b05e5" containerName="kserve-container" Jul 20 10:24:21.689218 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.689198 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xht4p/must-gather-j9zlv" Jul 20 10:24:21.691715 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.691695 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xht4p\"/\"kube-root-ca.crt\"" Jul 20 10:24:21.692213 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.692196 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xht4p\"/\"openshift-service-ca.crt\"" Jul 20 10:24:21.692326 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.692198 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xht4p\"/\"default-dockercfg-5pskd\"" Jul 20 10:24:21.697286 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.697268 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xht4p/must-gather-j9zlv"] Jul 20 10:24:21.739394 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.739364 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f9252672-146b-4026-bfa0-1016170519a8-must-gather-output\") pod \"must-gather-j9zlv\" (UID: \"f9252672-146b-4026-bfa0-1016170519a8\") " pod="openshift-must-gather-xht4p/must-gather-j9zlv" Jul 20 10:24:21.739514 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.739396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz4ss\" (UniqueName: \"kubernetes.io/projected/f9252672-146b-4026-bfa0-1016170519a8-kube-api-access-wz4ss\") pod \"must-gather-j9zlv\" (UID: \"f9252672-146b-4026-bfa0-1016170519a8\") " pod="openshift-must-gather-xht4p/must-gather-j9zlv" Jul 20 10:24:21.840426 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.840397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f9252672-146b-4026-bfa0-1016170519a8-must-gather-output\") pod \"must-gather-j9zlv\" (UID: \"f9252672-146b-4026-bfa0-1016170519a8\") " pod="openshift-must-gather-xht4p/must-gather-j9zlv" Jul 20 10:24:21.840426 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.840423 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz4ss\" (UniqueName: \"kubernetes.io/projected/f9252672-146b-4026-bfa0-1016170519a8-kube-api-access-wz4ss\") pod \"must-gather-j9zlv\" (UID: \"f9252672-146b-4026-bfa0-1016170519a8\") " pod="openshift-must-gather-xht4p/must-gather-j9zlv" Jul 20 10:24:21.840733 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.840715 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f9252672-146b-4026-bfa0-1016170519a8-must-gather-output\") pod \"must-gather-j9zlv\" (UID: \"f9252672-146b-4026-bfa0-1016170519a8\") " pod="openshift-must-gather-xht4p/must-gather-j9zlv" Jul 20 10:24:21.848254 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.848235 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz4ss\" (UniqueName: \"kubernetes.io/projected/f9252672-146b-4026-bfa0-1016170519a8-kube-api-access-wz4ss\") pod \"must-gather-j9zlv\" (UID: \"f9252672-146b-4026-bfa0-1016170519a8\") " pod="openshift-must-gather-xht4p/must-gather-j9zlv" Jul 20 10:24:21.998697 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:21.998614 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xht4p/must-gather-j9zlv" Jul 20 10:24:22.132201 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:22.132105 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xht4p/must-gather-j9zlv"] Jul 20 10:24:22.134811 ip-10-0-128-168 kubenswrapper[2564]: W0720 10:24:22.134782 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9252672_146b_4026_bfa0_1016170519a8.slice/crio-2bdc6ed586b9c5e4e8980333cbe615075670f346f2ec1618c875259862f4ea7e WatchSource:0}: Error finding container 2bdc6ed586b9c5e4e8980333cbe615075670f346f2ec1618c875259862f4ea7e: Status 404 returned error can't find the container with id 2bdc6ed586b9c5e4e8980333cbe615075670f346f2ec1618c875259862f4ea7e Jul 20 10:24:22.136571 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:22.136553 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 10:24:22.765397 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:22.765352 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xht4p/must-gather-j9zlv" event={"ID":"f9252672-146b-4026-bfa0-1016170519a8","Type":"ContainerStarted","Data":"2bdc6ed586b9c5e4e8980333cbe615075670f346f2ec1618c875259862f4ea7e"} Jul 20 10:24:28.794868 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:28.794786 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xht4p/must-gather-j9zlv" event={"ID":"f9252672-146b-4026-bfa0-1016170519a8","Type":"ContainerStarted","Data":"5b8ef65e6bce2b8b7e4338253e3c37f5cb24d740be157bf16da40e470d671aaa"} Jul 20 10:24:28.794868 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:28.794827 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xht4p/must-gather-j9zlv" event={"ID":"f9252672-146b-4026-bfa0-1016170519a8","Type":"ContainerStarted","Data":"35496340a18955475413af6f525aac1a4e0d3c12bef635b68a70db6ac30a92ad"} Jul 20 10:24:28.822346 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:28.822298 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xht4p/must-gather-j9zlv" podStartSLOduration=1.762859407 podStartE2EDuration="7.822282524s" totalImagesPullingTime="6.059423117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:24:28.820700498 +0000 UTC m=+1634.079105173" watchObservedRunningTime="2026-07-20 10:24:28.822282524 +0000 UTC m=+1634.080687200" Jul 20 10:24:49.890375 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:49.890343 2564 generic.go:356] "Generic (PLEG): container finished" podID="f9252672-146b-4026-bfa0-1016170519a8" containerID="35496340a18955475413af6f525aac1a4e0d3c12bef635b68a70db6ac30a92ad" exitCode=0 Jul 20 10:24:49.890775 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:49.890416 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xht4p/must-gather-j9zlv" event={"ID":"f9252672-146b-4026-bfa0-1016170519a8","Type":"ContainerDied","Data":"35496340a18955475413af6f525aac1a4e0d3c12bef635b68a70db6ac30a92ad"} Jul 20 10:24:49.890775 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:49.890745 2564 scope.go:117] "RemoveContainer" containerID="35496340a18955475413af6f525aac1a4e0d3c12bef635b68a70db6ac30a92ad" Jul 20 10:24:50.237930 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:50.237840 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xht4p_must-gather-j9zlv_f9252672-146b-4026-bfa0-1016170519a8/gather/0.log" Jul 20 10:24:53.695041 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:53.695010 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lf8fm_a7e1ce9e-5b4e-49df-bcbd-1bff98386452/global-pull-secret-syncer/0.log" Jul 20 10:24:53.824811 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:53.824784 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jmcfd_dfdceec5-4d97-4521-a8d4-83d163fdc371/konnectivity-agent/0.log" Jul 20 10:24:53.851375 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:53.851350 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-168.ec2.internal_d97e9e3433a54f7fc5fb31270e8cbde7/haproxy/0.log" Jul 20 10:24:55.618845 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.618814 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-xht4p/must-gather-j9zlv"] Jul 20 10:24:55.619282 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.618971 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-xht4p/must-gather-j9zlv" podUID="f9252672-146b-4026-bfa0-1016170519a8" containerName="copy" containerID="cri-o://5b8ef65e6bce2b8b7e4338253e3c37f5cb24d740be157bf16da40e470d671aaa" gracePeriod=2 Jul 20 10:24:55.623103 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.622988 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-xht4p/must-gather-j9zlv"] Jul 20 10:24:55.843611 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.843583 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xht4p_must-gather-j9zlv_f9252672-146b-4026-bfa0-1016170519a8/copy/0.log" Jul 20 10:24:55.845238 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.845220 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xht4p/must-gather-j9zlv" Jul 20 10:24:55.847138 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:24:55.847113 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-j9zlv\" is forbidden: User \"system:node:ip-10-0-128-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xht4p\": no relationship found between node 'ip-10-0-128-168.ec2.internal' and this object" podUID="f9252672-146b-4026-bfa0-1016170519a8" pod="openshift-must-gather-xht4p/must-gather-j9zlv" Jul 20 10:24:55.917397 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.917333 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xht4p_must-gather-j9zlv_f9252672-146b-4026-bfa0-1016170519a8/copy/0.log" Jul 20 10:24:55.917748 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.917728 2564 generic.go:356] "Generic (PLEG): container finished" podID="f9252672-146b-4026-bfa0-1016170519a8" containerID="5b8ef65e6bce2b8b7e4338253e3c37f5cb24d740be157bf16da40e470d671aaa" exitCode=143 Jul 20 10:24:55.917831 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.917772 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xht4p/must-gather-j9zlv" Jul 20 10:24:55.917831 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.917809 2564 scope.go:117] "RemoveContainer" containerID="5b8ef65e6bce2b8b7e4338253e3c37f5cb24d740be157bf16da40e470d671aaa" Jul 20 10:24:55.919505 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:24:55.919430 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-j9zlv\" is forbidden: User \"system:node:ip-10-0-128-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xht4p\": no relationship found between node 'ip-10-0-128-168.ec2.internal' and this object" podUID="f9252672-146b-4026-bfa0-1016170519a8" pod="openshift-must-gather-xht4p/must-gather-j9zlv" Jul 20 10:24:55.925152 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.925137 2564 scope.go:117] "RemoveContainer" containerID="35496340a18955475413af6f525aac1a4e0d3c12bef635b68a70db6ac30a92ad" Jul 20 10:24:55.936571 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.936552 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f9252672-146b-4026-bfa0-1016170519a8-must-gather-output\") pod \"f9252672-146b-4026-bfa0-1016170519a8\" (UID: \"f9252672-146b-4026-bfa0-1016170519a8\") " Jul 20 10:24:55.936676 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.936626 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz4ss\" (UniqueName: \"kubernetes.io/projected/f9252672-146b-4026-bfa0-1016170519a8-kube-api-access-wz4ss\") pod \"f9252672-146b-4026-bfa0-1016170519a8\" (UID: \"f9252672-146b-4026-bfa0-1016170519a8\") " Jul 20 10:24:55.937410 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.937385 2564 scope.go:117] "RemoveContainer" containerID="5b8ef65e6bce2b8b7e4338253e3c37f5cb24d740be157bf16da40e470d671aaa" Jul 20 10:24:55.937724 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:24:55.937706 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b8ef65e6bce2b8b7e4338253e3c37f5cb24d740be157bf16da40e470d671aaa\": container with ID starting with 5b8ef65e6bce2b8b7e4338253e3c37f5cb24d740be157bf16da40e470d671aaa not found: ID does not exist" containerID="5b8ef65e6bce2b8b7e4338253e3c37f5cb24d740be157bf16da40e470d671aaa" Jul 20 10:24:55.937804 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.937746 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9252672-146b-4026-bfa0-1016170519a8-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "f9252672-146b-4026-bfa0-1016170519a8" (UID: "f9252672-146b-4026-bfa0-1016170519a8"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:24:55.937804 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.937745 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8ef65e6bce2b8b7e4338253e3c37f5cb24d740be157bf16da40e470d671aaa"} err="failed to get container status \"5b8ef65e6bce2b8b7e4338253e3c37f5cb24d740be157bf16da40e470d671aaa\": rpc error: code = NotFound desc = could not find container \"5b8ef65e6bce2b8b7e4338253e3c37f5cb24d740be157bf16da40e470d671aaa\": container with ID starting with 5b8ef65e6bce2b8b7e4338253e3c37f5cb24d740be157bf16da40e470d671aaa not found: ID does not exist" Jul 20 10:24:55.937804 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.937791 2564 scope.go:117] "RemoveContainer" containerID="35496340a18955475413af6f525aac1a4e0d3c12bef635b68a70db6ac30a92ad" Jul 20 10:24:55.938105 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:24:55.938085 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35496340a18955475413af6f525aac1a4e0d3c12bef635b68a70db6ac30a92ad\": container with ID starting with 35496340a18955475413af6f525aac1a4e0d3c12bef635b68a70db6ac30a92ad not found: ID does not exist" containerID="35496340a18955475413af6f525aac1a4e0d3c12bef635b68a70db6ac30a92ad" Jul 20 10:24:55.938178 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.938110 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35496340a18955475413af6f525aac1a4e0d3c12bef635b68a70db6ac30a92ad"} err="failed to get container status \"35496340a18955475413af6f525aac1a4e0d3c12bef635b68a70db6ac30a92ad\": rpc error: code = NotFound desc = could not find container \"35496340a18955475413af6f525aac1a4e0d3c12bef635b68a70db6ac30a92ad\": container with ID starting with 35496340a18955475413af6f525aac1a4e0d3c12bef635b68a70db6ac30a92ad not found: ID does not exist" Jul 20 10:24:55.938917 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:55.938897 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9252672-146b-4026-bfa0-1016170519a8-kube-api-access-wz4ss" (OuterVolumeSpecName: "kube-api-access-wz4ss") pod "f9252672-146b-4026-bfa0-1016170519a8" (UID: "f9252672-146b-4026-bfa0-1016170519a8"). InnerVolumeSpecName "kube-api-access-wz4ss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:24:56.037418 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:56.037394 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz4ss\" (UniqueName: \"kubernetes.io/projected/f9252672-146b-4026-bfa0-1016170519a8-kube-api-access-wz4ss\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:24:56.037418 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:56.037416 2564 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f9252672-146b-4026-bfa0-1016170519a8-must-gather-output\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jul 20 10:24:56.228365 ip-10-0-128-168 kubenswrapper[2564]: E0720 10:24:56.228337 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-j9zlv\" is forbidden: User \"system:node:ip-10-0-128-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xht4p\": no relationship found between node 'ip-10-0-128-168.ec2.internal' and this object" podUID="f9252672-146b-4026-bfa0-1016170519a8" pod="openshift-must-gather-xht4p/must-gather-j9zlv" Jul 20 10:24:57.257022 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:57.256990 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9252672-146b-4026-bfa0-1016170519a8" path="/var/lib/kubelet/pods/f9252672-146b-4026-bfa0-1016170519a8/volumes" Jul 20 10:24:58.123529 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.123503 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce4457d7-2d51-4488-adf6-b525c885093f/alertmanager/0.log" Jul 20 10:24:58.146301 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.146277 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce4457d7-2d51-4488-adf6-b525c885093f/config-reloader/0.log" Jul 20 10:24:58.167368 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.167346 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce4457d7-2d51-4488-adf6-b525c885093f/kube-rbac-proxy-web/0.log" Jul 20 10:24:58.190274 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.190256 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce4457d7-2d51-4488-adf6-b525c885093f/kube-rbac-proxy/0.log" Jul 20 10:24:58.216922 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.216903 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce4457d7-2d51-4488-adf6-b525c885093f/kube-rbac-proxy-metric/0.log" Jul 20 10:24:58.240311 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.240290 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce4457d7-2d51-4488-adf6-b525c885093f/prom-label-proxy/0.log" Jul 20 10:24:58.270033 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.270014 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce4457d7-2d51-4488-adf6-b525c885093f/init-config-reloader/0.log" Jul 20 10:24:58.446299 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.446239 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5bd7d7c455-4dklj_2ac2e2bc-ca33-4e5d-a39b-a4671f6c0401/metrics-server/0.log" Jul 20 10:24:58.694263 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.694236 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z4ht2_fe6431eb-29ba-4303-84ef-94706c598358/node-exporter/0.log" Jul 20 10:24:58.719097 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.719032 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z4ht2_fe6431eb-29ba-4303-84ef-94706c598358/kube-rbac-proxy/0.log" Jul 20 10:24:58.743189 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.743166 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z4ht2_fe6431eb-29ba-4303-84ef-94706c598358/init-textfile/0.log" Jul 20 10:24:58.853158 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.853135 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9eb326d6-a010-42a3-9283-8cdea92a9619/prometheus/0.log" Jul 20 10:24:58.870333 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.870316 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9eb326d6-a010-42a3-9283-8cdea92a9619/config-reloader/0.log" Jul 20 10:24:58.891314 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.891295 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9eb326d6-a010-42a3-9283-8cdea92a9619/thanos-sidecar/0.log" Jul 20 10:24:58.912036 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.912019 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9eb326d6-a010-42a3-9283-8cdea92a9619/kube-rbac-proxy-web/0.log" Jul 20 10:24:58.932491 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.932472 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9eb326d6-a010-42a3-9283-8cdea92a9619/kube-rbac-proxy/0.log" Jul 20 10:24:58.951969 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.951949 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9eb326d6-a010-42a3-9283-8cdea92a9619/kube-rbac-proxy-thanos/0.log" Jul 20 10:24:58.975336 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:58.975290 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9eb326d6-a010-42a3-9283-8cdea92a9619/init-config-reloader/0.log" Jul 20 10:24:59.010414 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:59.010393 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-sgz6c_1362197e-4b76-4a16-8765-f9def7825192/prometheus-operator/0.log" Jul 20 10:24:59.030592 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:59.030574 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-sgz6c_1362197e-4b76-4a16-8765-f9def7825192/kube-rbac-proxy/0.log" Jul 20 10:24:59.054511 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:24:59.054489 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-pmd55_44078841-2364-40da-ac2a-531fedca748f/prometheus-operator-admission-webhook/0.log" Jul 20 10:25:00.576554 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:00.576477 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-r7w2d_a6862fd4-abd9-49b5-a0a9-27585101165d/networking-console-plugin/0.log" Jul 20 10:25:01.046219 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:01.046190 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/1.log" Jul 20 10:25:01.055020 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:01.054987 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kbkhp_9cdea504-c1e9-4868-affe-0810dbd583f2/console-operator/2.log" Jul 20 10:25:02.401553 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.401526 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp"] Jul 20 10:25:02.401896 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.401830 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9252672-146b-4026-bfa0-1016170519a8" containerName="copy" Jul 20 10:25:02.401896 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.401840 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9252672-146b-4026-bfa0-1016170519a8" containerName="copy" Jul 20 10:25:02.401896 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.401853 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9252672-146b-4026-bfa0-1016170519a8" containerName="gather" Jul 20 10:25:02.401896 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.401858 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9252672-146b-4026-bfa0-1016170519a8" containerName="gather" Jul 20 10:25:02.402022 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.401906 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9252672-146b-4026-bfa0-1016170519a8" containerName="copy" Jul 20 10:25:02.402022 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.401915 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9252672-146b-4026-bfa0-1016170519a8" containerName="gather" Jul 20 10:25:02.405782 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.405758 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.408007 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.407987 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-srqvl\"/\"openshift-service-ca.crt\"" Jul 20 10:25:02.408408 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.408390 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-srqvl\"/\"default-dockercfg-wnb8s\"" Jul 20 10:25:02.408658 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.408641 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-srqvl\"/\"kube-root-ca.crt\"" Jul 20 10:25:02.414900 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.414877 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp"] Jul 20 10:25:02.484859 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.484834 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b69b8468-df05-43f9-be4c-42cfed7f2a45-proc\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.484976 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.484867 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b69b8468-df05-43f9-be4c-42cfed7f2a45-sys\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.484976 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.484891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b69b8468-df05-43f9-be4c-42cfed7f2a45-podres\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.484976 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.484918 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kzfs\" (UniqueName: \"kubernetes.io/projected/b69b8468-df05-43f9-be4c-42cfed7f2a45-kube-api-access-5kzfs\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.485095 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.484989 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b69b8468-df05-43f9-be4c-42cfed7f2a45-lib-modules\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.586234 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.586208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kzfs\" (UniqueName: \"kubernetes.io/projected/b69b8468-df05-43f9-be4c-42cfed7f2a45-kube-api-access-5kzfs\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.586361 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.586278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b69b8468-df05-43f9-be4c-42cfed7f2a45-lib-modules\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.586361 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.586321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b69b8468-df05-43f9-be4c-42cfed7f2a45-proc\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.586361 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.586350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b69b8468-df05-43f9-be4c-42cfed7f2a45-sys\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.586586 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.586383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b69b8468-df05-43f9-be4c-42cfed7f2a45-podres\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.586586 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.586400 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b69b8468-df05-43f9-be4c-42cfed7f2a45-proc\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.586586 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.586472 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b69b8468-df05-43f9-be4c-42cfed7f2a45-lib-modules\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.586586 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.586483 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b69b8468-df05-43f9-be4c-42cfed7f2a45-sys\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.586586 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.586534 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b69b8468-df05-43f9-be4c-42cfed7f2a45-podres\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.594042 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.594023 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kzfs\" (UniqueName: \"kubernetes.io/projected/b69b8468-df05-43f9-be4c-42cfed7f2a45-kube-api-access-5kzfs\") pod \"perf-node-gather-daemonset-qlpnp\" (UID: \"b69b8468-df05-43f9-be4c-42cfed7f2a45\") " pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.717461 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.717386 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.842058 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.842013 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp"] Jul 20 10:25:02.844795 ip-10-0-128-168 kubenswrapper[2564]: W0720 10:25:02.844765 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb69b8468_df05_43f9_be4c_42cfed7f2a45.slice/crio-446fe785e146cdf008ab537c7696af65cdf13a5ebec87344a6fbae0da79333da WatchSource:0}: Error finding container 446fe785e146cdf008ab537c7696af65cdf13a5ebec87344a6fbae0da79333da: Status 404 returned error can't find the container with id 446fe785e146cdf008ab537c7696af65cdf13a5ebec87344a6fbae0da79333da Jul 20 10:25:02.938964 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.938935 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8d6l7_480a8435-e56c-4ef7-9fe8-2e561760616a/dns/0.log" Jul 20 10:25:02.947489 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.947467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" event={"ID":"b69b8468-df05-43f9-be4c-42cfed7f2a45","Type":"ContainerStarted","Data":"6a88fc5fe5f41d707101997d23cf9cabe8e60ddff1304f3d1e5c362033c10c88"} Jul 20 10:25:02.947598 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.947523 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" event={"ID":"b69b8468-df05-43f9-be4c-42cfed7f2a45","Type":"ContainerStarted","Data":"446fe785e146cdf008ab537c7696af65cdf13a5ebec87344a6fbae0da79333da"} Jul 20 10:25:02.947669 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.947649 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:02.960812 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.960790 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8d6l7_480a8435-e56c-4ef7-9fe8-2e561760616a/kube-rbac-proxy/0.log" Jul 20 10:25:02.962097 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:02.962061 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" podStartSLOduration=0.962045878 podStartE2EDuration="962.045878ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 10:25:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:25:02.961693316 +0000 UTC m=+1668.220097993" watchObservedRunningTime="2026-07-20 10:25:02.962045878 +0000 UTC m=+1668.220450550" Jul 20 10:25:03.073388 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:03.073312 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-656q7_65e05599-9f05-4924-8d90-d0c4a7a7f4aa/dns-node-resolver/0.log" Jul 20 10:25:03.651216 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:03.651191 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vmtp7_afa7dced-205f-4733-a059-fbd59fb79687/node-ca/0.log" Jul 20 10:25:04.692041 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:04.692009 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7c6jg_f47dca99-e127-4cca-8468-cdfeb4b56539/serve-healthcheck-canary/0.log" Jul 20 10:25:05.088926 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:05.088842 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-9f4gs_0509b165-52b1-452f-9d81-993c6ebe528e/insights-operator/0.log" Jul 20 10:25:05.089423 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:05.089401 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-9f4gs_0509b165-52b1-452f-9d81-993c6ebe528e/insights-operator/1.log" Jul 20 10:25:05.176073 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:05.176046 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gzrt4_f683429f-cd6a-450d-90ad-a34afdd67739/kube-rbac-proxy/0.log" Jul 20 10:25:05.201480 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:05.201449 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gzrt4_f683429f-cd6a-450d-90ad-a34afdd67739/exporter/0.log" Jul 20 10:25:05.225315 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:05.225293 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gzrt4_f683429f-cd6a-450d-90ad-a34afdd67739/extractor/0.log" Jul 20 10:25:07.749007 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:07.748984 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-zhffs_358c15a0-cba2-4a84-806d-c75057dbd95b/s3-init/0.log" Jul 20 10:25:07.780423 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:07.780394 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-zhffs_358c15a0-cba2-4a84-806d-c75057dbd95b/download-hf-model/0.log" Jul 20 10:25:08.961927 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:08.961902 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-srqvl/perf-node-gather-daemonset-qlpnp" Jul 20 10:25:12.354632 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:12.354600 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-zb7t8_105b6b48-12fc-4221-901d-59b4fedcc6c0/kube-storage-version-migrator-operator/1.log" Jul 20 10:25:12.356272 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:12.356249 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-zb7t8_105b6b48-12fc-4221-901d-59b4fedcc6c0/kube-storage-version-migrator-operator/0.log" Jul 20 10:25:13.703643 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:13.703618 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtxmk_89ab4d5e-0f3e-48ee-83ff-5d5d940a8570/kube-multus-additional-cni-plugins/0.log" Jul 20 10:25:13.727880 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:13.727858 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtxmk_89ab4d5e-0f3e-48ee-83ff-5d5d940a8570/egress-router-binary-copy/0.log" Jul 20 10:25:13.746605 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:13.746585 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtxmk_89ab4d5e-0f3e-48ee-83ff-5d5d940a8570/cni-plugins/0.log" Jul 20 10:25:13.765911 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:13.765886 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtxmk_89ab4d5e-0f3e-48ee-83ff-5d5d940a8570/bond-cni-plugin/0.log" Jul 20 10:25:13.785675 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:13.785612 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtxmk_89ab4d5e-0f3e-48ee-83ff-5d5d940a8570/routeoverride-cni/0.log" Jul 20 10:25:13.805476 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:13.805456 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtxmk_89ab4d5e-0f3e-48ee-83ff-5d5d940a8570/whereabouts-cni-bincopy/0.log" Jul 20 10:25:13.830727 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:13.830706 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtxmk_89ab4d5e-0f3e-48ee-83ff-5d5d940a8570/whereabouts-cni/0.log" Jul 20 10:25:13.897383 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:13.897355 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lrjcf_1aaa469c-5cfc-41b8-b757-c2683a318436/kube-multus/0.log" Jul 20 10:25:13.961206 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:13.961175 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mk7cq_e31e814a-2c84-4b09-a4f3-06fa6c649cfb/network-metrics-daemon/0.log" Jul 20 10:25:13.978635 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:13.978612 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mk7cq_e31e814a-2c84-4b09-a4f3-06fa6c649cfb/kube-rbac-proxy/0.log" Jul 20 10:25:14.736816 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:14.736784 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65jsj_69bf8322-6b6f-40e4-bf99-4b353ee2b2f1/ovn-controller/0.log" Jul 20 10:25:14.753142 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:14.753117 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65jsj_69bf8322-6b6f-40e4-bf99-4b353ee2b2f1/ovn-acl-logging/0.log" Jul 20 10:25:14.776066 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:14.776044 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65jsj_69bf8322-6b6f-40e4-bf99-4b353ee2b2f1/kube-rbac-proxy-node/0.log" Jul 20 10:25:14.795365 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:14.795339 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65jsj_69bf8322-6b6f-40e4-bf99-4b353ee2b2f1/kube-rbac-proxy-ovn-metrics/0.log" Jul 20 10:25:14.811553 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:14.811529 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65jsj_69bf8322-6b6f-40e4-bf99-4b353ee2b2f1/northd/0.log" Jul 20 10:25:14.830384 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:14.830365 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65jsj_69bf8322-6b6f-40e4-bf99-4b353ee2b2f1/nbdb/0.log" Jul 20 10:25:14.850864 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:14.850840 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65jsj_69bf8322-6b6f-40e4-bf99-4b353ee2b2f1/sbdb/0.log" Jul 20 10:25:14.904923 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:14.904900 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65jsj_69bf8322-6b6f-40e4-bf99-4b353ee2b2f1/ovnkube-controller/0.log" Jul 20 10:25:16.268688 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:16.268656 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7bc5b6bf85-2lkwf_bbc4e206-0700-45d8-b36b-3ac890116e18/check-endpoints/0.log" Jul 20 10:25:16.288646 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:16.288615 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6mxr8_aa8e2e5f-7dd0-464d-8077-41a497565322/network-check-target-container/0.log" Jul 20 10:25:17.222680 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:17.222645 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-cpdv4_9e06f763-f83a-4f6f-82c5-35f468e3ee31/iptables-alerter/0.log" Jul 20 10:25:17.927496 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:17.927465 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-dnj6m_bda40917-2614-429f-8754-ad4f8233f50c/tuned/0.log" Jul 20 10:25:19.669659 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:19.669627 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-r9wl5_1b0cfbc3-2103-436c-b4a8-459d7525cf72/cluster-samples-operator/0.log" Jul 20 10:25:19.685767 ip-10-0-128-168 kubenswrapper[2564]: I0720 10:25:19.685738 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-r9wl5_1b0cfbc3-2103-436c-b4a8-459d7525cf72/cluster-samples-operator-watch/0.log"