Jul 02 13:13:06.937757 ip-10-0-133-111 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 13:13:06.937769 ip-10-0-133-111 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 13:13:06.937777 ip-10-0-133-111 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 13:13:06.938018 ip-10-0-133-111 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 13:13:17.045881 ip-10-0-133-111 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 13:13:17.045906 ip-10-0-133-111 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 84802bf32ed649e58c6add124b5d5574 -- Jul 02 13:15:22.991160 ip-10-0-133-111 systemd[1]: Starting Kubernetes Kubelet... Jul 02 13:15:23.395331 ip-10-0-133-111 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 13:15:23.395331 ip-10-0-133-111 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 13:15:23.395331 ip-10-0-133-111 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 13:15:23.395331 ip-10-0-133-111 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 13:15:23.395331 ip-10-0-133-111 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 13:15:23.396026 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.395345 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 13:15:23.401168 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401145 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:15:23.401168 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401167 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:15:23.401168 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401171 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401174 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401178 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401181 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401184 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401187 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401190 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401194 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401199 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401202 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401205 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401207 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401210 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401213 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401216 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401218 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401221 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401224 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401227 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:15:23.401275 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401229 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401232 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401235 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401238 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401240 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401243 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401246 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401248 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401251 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401253 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401256 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401259 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401261 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401263 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401266 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401271 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401276 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401279 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401282 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:15:23.401729 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401285 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401288 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401291 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401294 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401296 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401299 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401302 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401304 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401307 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401310 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401313 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401315 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401318 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401321 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401324 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401327 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401329 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401332 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401334 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401337 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:15:23.402195 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401339 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401342 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401345 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401347 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401350 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401352 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401355 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401357 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401361 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401364 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401367 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401370 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401372 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401375 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401377 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401380 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401383 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401386 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401389 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401391 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:15:23.402687 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401394 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401396 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401399 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401401 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401404 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401406 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401409 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401412 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401415 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401417 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401419 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401423 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401425 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401429 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401432 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401434 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401436 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401439 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.401443 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402221 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:15:23.403178 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402230 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402233 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402237 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402240 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402243 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402246 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402248 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402251 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402253 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402256 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402259 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402262 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402264 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402267 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402270 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402272 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402275 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402277 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402280 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402282 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:15:23.403662 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402285 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402288 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402290 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402293 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402295 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402298 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402300 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402303 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402305 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402308 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402312 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402316 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402320 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402324 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402328 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402331 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402334 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402337 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402340 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:15:23.404173 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402343 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402345 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402348 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402350 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402353 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402355 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402358 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402361 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402363 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402365 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402368 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402371 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402374 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402376 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402379 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402383 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402387 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402389 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402392 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:15:23.404665 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402395 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402397 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402400 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402403 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402405 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402408 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402412 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402414 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402417 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402420 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402423 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402426 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402429 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402433 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402435 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402438 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402440 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402443 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402445 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402448 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:15:23.405158 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402450 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402453 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402456 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402458 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402461 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402463 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402465 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402468 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402471 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402473 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402476 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402479 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402481 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402484 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402486 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402489 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402491 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402494 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402497 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402501 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:15:23.405637 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402931 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402937 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402939 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402942 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402947 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402949 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402952 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402955 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402958 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402960 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402963 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402966 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402968 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402971 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402973 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402976 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402979 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402981 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402984 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402986 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:15:23.406133 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402989 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402992 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402994 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.402998 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403002 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403005 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403008 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403011 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403014 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403017 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403024 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403027 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403030 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403033 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403035 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403038 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403042 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403045 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403047 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:15:23.406646 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403050 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403052 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403055 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403058 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403060 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403063 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403065 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403068 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403070 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403073 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403075 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403078 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403080 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403083 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403085 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403088 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403090 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403093 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403095 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403098 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:15:23.407125 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403100 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403103 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403105 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403110 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403113 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403116 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403118 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403121 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403123 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403126 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403128 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403132 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403135 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403137 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403141 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403145 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403148 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403150 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403153 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:15:23.407605 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403156 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403159 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403162 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403165 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403167 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403170 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403173 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403175 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403178 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403181 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403184 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403187 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403189 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403192 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403195 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403197 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403201 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403204 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403206 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403210 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:15:23.408115 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403213 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403294 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403302 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403311 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403316 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403321 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403325 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403329 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403334 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403337 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403340 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403344 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403347 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403350 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403353 2561 flags.go:64] FLAG: --cgroup-root="" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403356 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403359 2561 flags.go:64] FLAG: --client-ca-file="" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403362 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403365 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403369 2561 flags.go:64] FLAG: --cluster-domain="" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403372 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403375 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403378 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403382 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 13:15:23.408632 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403386 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403389 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403392 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403396 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403400 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403403 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403406 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403409 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403412 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403417 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403420 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403423 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403426 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403430 2561 flags.go:64] FLAG: --enable-server="true" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403433 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403438 2561 flags.go:64] FLAG: --event-burst="100" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403442 2561 flags.go:64] FLAG: --event-qps="50" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403444 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403448 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403451 2561 flags.go:64] FLAG: --eviction-hard="" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403455 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403457 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403460 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403463 2561 flags.go:64] FLAG: --eviction-soft="" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403466 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 13:15:23.409260 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403469 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403472 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403475 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403478 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403482 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403484 2561 flags.go:64] FLAG: --feature-gates="" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403488 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403491 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403494 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403497 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403500 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403503 2561 flags.go:64] FLAG: --help="false" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403506 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403509 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403512 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403515 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403519 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403523 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403526 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403529 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403532 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403535 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403539 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403542 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 13:15:23.409932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403545 2561 flags.go:64] FLAG: --kube-reserved="" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403548 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403550 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403553 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403556 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403560 2561 flags.go:64] FLAG: --lock-file="" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403563 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403566 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403569 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403574 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403577 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403580 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403583 2561 flags.go:64] FLAG: --logging-format="text" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403586 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403589 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403591 2561 flags.go:64] FLAG: --manifest-url="" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403594 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403598 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403601 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403606 2561 flags.go:64] FLAG: --max-pods="110" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403609 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403612 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403615 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403618 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403621 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 13:15:23.410536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403624 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403627 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403634 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403637 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403640 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403643 2561 flags.go:64] FLAG: --pod-cidr="" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403646 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403652 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403655 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403658 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403661 2561 flags.go:64] FLAG: --port="10250" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403664 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403667 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-090b2b510a2afc218" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403671 2561 flags.go:64] FLAG: --qos-reserved="" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403674 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403678 2561 flags.go:64] FLAG: --register-node="true" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403681 2561 flags.go:64] FLAG: --register-with-taints="" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403685 2561 flags.go:64] FLAG: --registry-burst="10" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403688 2561 flags.go:64] FLAG: --registry-qps="5" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403691 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403693 2561 flags.go:64] FLAG: --reserved-memory="" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403697 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403700 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403703 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403707 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 13:15:23.411154 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403709 2561 flags.go:64] FLAG: --runonce="false" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403712 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403715 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403718 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403721 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403724 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403727 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403730 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403733 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403736 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403739 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403742 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403744 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403747 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403751 2561 flags.go:64] FLAG: --system-cgroups="" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403754 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403759 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403762 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403765 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403769 2561 flags.go:64] FLAG: --tls-min-version="" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403772 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403774 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403779 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403782 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403785 2561 flags.go:64] FLAG: --v="2" Jul 02 13:15:23.411802 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403789 2561 flags.go:64] FLAG: --version="false" Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403793 2561 flags.go:64] FLAG: --vmodule="" Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403796 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.403800 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403956 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403961 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403964 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403967 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403970 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403975 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403979 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403982 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403985 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403990 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403993 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403996 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.403998 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404001 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404004 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404007 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:15:23.412445 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404009 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404013 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404018 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404021 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404024 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404027 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404030 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404033 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404035 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404040 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404043 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404046 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404048 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404051 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404054 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404056 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404059 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404061 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404064 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404067 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:15:23.413083 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404070 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404072 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404075 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404077 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404080 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404084 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404087 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404089 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404092 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404095 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404098 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404100 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404103 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404105 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404108 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404111 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404114 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404116 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404119 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404121 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:15:23.413568 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404124 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404129 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404131 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404134 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404137 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404139 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404142 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404144 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404147 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404149 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404152 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404155 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404158 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404161 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404163 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404166 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404169 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404172 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404175 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404178 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:15:23.414070 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404181 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404184 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404187 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404189 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404192 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404194 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404197 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404199 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404202 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404205 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404207 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404210 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404213 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404218 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404222 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404232 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404235 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404238 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404241 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:15:23.414576 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404244 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:15:23.415056 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404246 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:15:23.415056 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404249 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:15:23.415056 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.404252 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:15:23.415056 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.405775 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 13:15:23.415056 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.413181 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 13:15:23.415056 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.413202 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 13:15:23.415056 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.414019 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 13:15:23.415056 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.414027 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 13:15:23.415056 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414105 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:15:23.415056 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414112 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:15:23.415056 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414115 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:15:23.415056 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414118 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:15:23.415056 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414121 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:15:23.415056 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414123 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414127 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414130 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414132 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414135 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414138 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414140 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414150 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414153 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414157 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414159 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414162 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414164 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414167 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414170 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414172 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414175 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414177 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414180 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414183 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:15:23.415423 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414185 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414188 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414190 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414193 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414196 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414199 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414202 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414207 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414211 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414214 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414217 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414220 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414222 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414225 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414229 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414232 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414235 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414239 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414241 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:15:23.416019 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414244 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414253 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414256 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414258 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414261 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414264 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414266 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414269 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414272 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414275 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414277 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414280 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414283 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414285 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414288 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414290 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414300 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414304 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414307 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414310 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:15:23.416613 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414312 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414316 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414320 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414323 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414326 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414328 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414331 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414333 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414336 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414338 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414341 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414344 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414346 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414349 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414357 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414360 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414363 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414365 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414368 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414370 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:15:23.417577 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414373 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414375 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414377 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414380 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414383 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414385 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414388 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414390 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414393 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414397 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414400 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414403 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414406 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414408 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414411 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:15:23.418110 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.414416 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414587 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414593 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414596 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414599 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414601 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414604 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414606 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414609 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414611 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414614 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414618 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414627 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414629 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414633 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414635 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414638 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414640 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414643 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414645 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:15:23.418493 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414648 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414651 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414653 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414656 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414658 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414661 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414664 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414667 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414669 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414672 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414674 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414677 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414680 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414682 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414685 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414687 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414690 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414692 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414695 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414697 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:15:23.418988 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414699 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414702 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414705 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414707 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414710 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414718 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414721 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414723 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414726 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414730 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414734 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414736 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414740 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414742 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414745 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414748 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414750 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414753 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414756 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:15:23.419498 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414759 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414762 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414765 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414767 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414770 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414772 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414775 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414778 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414780 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414783 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414785 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414788 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414790 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414793 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414795 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414798 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414800 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414803 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414818 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:15:23.419981 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414828 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414835 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414838 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414841 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414843 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414846 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414849 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414852 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414855 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414857 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414860 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414863 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414866 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414869 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414871 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414874 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414876 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414879 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414882 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414884 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:15:23.420468 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414887 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:15:23.420992 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:23.414889 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:15:23.420992 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.414895 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 13:15:23.420992 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.415036 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 13:15:23.420992 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.419490 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 13:15:23.420992 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.420953 2561 server.go:1019] "Starting client certificate rotation" Jul 02 13:15:23.421134 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.421052 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 13:15:23.421134 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.421098 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 13:15:23.424047 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.424030 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 13:15:23.426131 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.426110 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 13:15:23.432617 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.432599 2561 log.go:25] "Validated CRI v1 runtime API" Jul 02 13:15:23.437418 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.437397 2561 log.go:25] "Validated CRI v1 image API" Jul 02 13:15:23.439560 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.439545 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 13:15:23.441931 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.441898 2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 87be30fe-45bc-4956-ac3e-9bea7e20749b:/dev/nvme0n1p3 917965f6-c771-47f2-918c-5c9703581ccf:/dev/nvme0n1p4] Jul 02 13:15:23.442026 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.441927 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 13:15:23.448543 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.448411 2561 manager.go:216] Machine: {Timestamp:2026-07-02 13:15:23.44708108 +0000 UTC m=+0.337391119 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096401 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22071d0e0555ff4f949b1e8be465f8 SystemUUID:ec22071d-0e05-55ff-4f94-9b1e8be465f8 BootID:84802bf3-2ed6-49e5-8c6a-dd124b5d5574 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:12:a0:ef:c6:51 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:12:a0:ef:c6:51 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:77:0f:59:3a:53 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 13:15:23.448543 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.448528 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 13:15:23.448700 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.448622 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 13:15:23.448982 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.448965 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 13:15:23.453001 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.452971 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 13:15:23.453176 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.453013 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-111.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 13:15:23.453824 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.453800 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 13:15:23.453824 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.453825 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 13:15:23.453889 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.453833 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 13:15:23.454445 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.454431 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 13:15:23.455269 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.455255 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 13:15:23.458116 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.458098 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 02 13:15:23.458258 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.458248 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 13:15:23.458325 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.458317 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 02 13:15:23.458364 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.458333 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 13:15:23.458364 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.458350 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 13:15:23.458364 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.458359 2561 kubelet.go:398] "Adding apiserver pod source" Jul 02 13:15:23.458448 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.458385 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 13:15:23.458822 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.458794 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 13:15:23.458975 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.458830 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 13:15:23.462105 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.462061 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 13:15:23.464273 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.464253 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 13:15:23.464366 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.464293 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 13:15:23.464996 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.464981 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 13:15:23.465067 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.465001 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 13:15:23.465067 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.465011 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 13:15:23.465067 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.465018 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 13:15:23.465067 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.465030 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 13:15:23.465067 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.465039 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 13:15:23.465253 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.465243 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 13:15:23.465315 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.465256 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 13:15:23.465315 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.465268 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 13:15:23.465315 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.465277 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 13:15:23.465315 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.465290 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 13:15:23.465315 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.465303 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 13:15:23.465967 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.465956 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 13:15:23.466027 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.465969 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 13:15:23.467321 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.467291 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 13:15:23.467398 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.467300 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-111.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 13:15:23.469568 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.469553 2561 server.go:1268] "Started kubelet" Jul 02 13:15:23.469663 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.469634 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 13:15:23.469721 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.469631 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 13:15:23.469755 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.469718 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 13:15:23.470527 ip-10-0-133-111 systemd[1]: Started Kubernetes Kubelet. Jul 02 13:15:23.472647 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.472606 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 02 13:15:23.473989 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.473970 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 13:15:23.474947 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.474928 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 13:15:23.478791 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.478770 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 13:15:23.478791 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.478780 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 13:15:23.478958 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.478862 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-111.ec2.internal\" not found" Jul 02 13:15:23.479385 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.479301 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 13:15:23.479479 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.479365 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 13:15:23.479479 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.479459 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 13:15:23.479594 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.479581 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 02 13:15:23.479623 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.479595 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 02 13:15:23.479663 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.479628 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-111.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 13:15:23.480205 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.480187 2561 factory.go:153] Registering CRI-O factory Jul 02 13:15:23.480205 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.480206 2561 factory.go:223] Registration of the crio container factory successfully Jul 02 13:15:23.480360 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.480266 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 13:15:23.480360 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.480276 2561 factory.go:55] Registering systemd factory Jul 02 13:15:23.480360 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.480284 2561 factory.go:223] Registration of the systemd container factory successfully Jul 02 13:15:23.480360 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.479364 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-111.ec2.internal.18be7b58b896a89d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-111.ec2.internal,UID:ip-10-0-133-111.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-111.ec2.internal,},FirstTimestamp:2026-07-02 13:15:23.469514909 +0000 UTC m=+0.359824949,LastTimestamp:2026-07-02 13:15:23.469514909 +0000 UTC m=+0.359824949,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-111.ec2.internal,}" Jul 02 13:15:23.480360 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.480304 2561 factory.go:103] Registering Raw factory Jul 02 13:15:23.480360 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.480320 2561 manager.go:1196] Started watching for new ooms in manager Jul 02 13:15:23.481794 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.480960 2561 manager.go:349] Starting recovery of all containers Jul 02 13:15:23.482614 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.482562 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ccxwc" Jul 02 13:15:23.483944 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.483915 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 13:15:23.484032 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.483960 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-111.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 13:15:23.488471 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.488442 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ccxwc" Jul 02 13:15:23.494011 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.493931 2561 manager.go:354] Recovery completed Jul 02 13:15:23.498426 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.498410 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:15:23.500636 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.500611 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:15:23.500715 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.500644 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:15:23.500715 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.500656 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:15:23.501238 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.501224 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 13:15:23.501238 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.501237 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 13:15:23.501238 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.501246 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:15:23.501366 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.501258 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 02 13:15:23.502056 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.502039 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:15:23.502103 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.502070 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:15:23.502103 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.502081 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:15:23.502305 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.502292 2561 policy_none.go:49] "None policy: Start" Jul 02 13:15:23.502340 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.502309 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 13:15:23.502340 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.502320 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 13:15:23.503347 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.503337 2561 policy_none.go:47] "Start" Jul 02 13:15:23.504938 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.504855 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-111.ec2.internal.18be7b58ba716d37 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-111.ec2.internal,UID:ip-10-0-133-111.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-111.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-111.ec2.internal,},FirstTimestamp:2026-07-02 13:15:23.500629303 +0000 UTC m=+0.390939342,LastTimestamp:2026-07-02 13:15:23.500629303 +0000 UTC m=+0.390939342,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-111.ec2.internal,}" Jul 02 13:15:23.538574 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.538555 2561 manager.go:337] "Starting Device Plugin manager" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.538603 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.538615 2561 server.go:87] "Starting device plugin registration server" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.538893 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.538904 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.538988 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.539076 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.539082 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.539612 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.539657 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-111.ec2.internal\" not found" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.549648 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.550936 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.550973 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.550994 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.551031 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 13:15:23.554372 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.552614 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:15:23.639911 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.639864 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:15:23.640883 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.640860 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:15:23.641009 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.640899 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:15:23.641009 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.640910 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:15:23.641009 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.640936 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.649404 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.649332 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.649404 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.649362 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-111.ec2.internal\": node \"ip-10-0-133-111.ec2.internal\" not found" Jul 02 13:15:23.651868 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.651847 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-111.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal"] Jul 02 13:15:23.651923 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.651912 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:15:23.652844 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.652822 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:15:23.652954 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.652861 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:15:23.652954 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.652875 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:15:23.654283 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.654264 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:15:23.654383 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.654352 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.654383 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.654380 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:15:23.655103 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.655085 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:15:23.655175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.655117 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:15:23.655175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.655129 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:15:23.655175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.655087 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:15:23.655265 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.655193 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:15:23.655265 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.655203 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:15:23.656390 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.656374 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.656447 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.656402 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:15:23.657127 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.657111 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:15:23.657196 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.657140 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:15:23.657196 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.657150 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:15:23.664318 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.664296 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-111.ec2.internal\" not found" Jul 02 13:15:23.680819 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.680775 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0af90d6e33273b8a76167f3f487fd1b0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-111.ec2.internal\" (UID: \"0af90d6e33273b8a76167f3f487fd1b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.680937 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.680821 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e18c5276c3f8418c95c7a9d6975e4111-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal\" (UID: \"e18c5276c3f8418c95c7a9d6975e4111\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.680937 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.680841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e18c5276c3f8418c95c7a9d6975e4111-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal\" (UID: \"e18c5276c3f8418c95c7a9d6975e4111\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.682746 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.682721 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-111.ec2.internal\" not found" node="ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.687288 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.687268 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-111.ec2.internal\" not found" node="ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.764568 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.764537 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-111.ec2.internal\" not found" Jul 02 13:15:23.781972 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.781946 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0af90d6e33273b8a76167f3f487fd1b0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-111.ec2.internal\" (UID: \"0af90d6e33273b8a76167f3f487fd1b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.782062 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.781976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e18c5276c3f8418c95c7a9d6975e4111-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal\" (UID: \"e18c5276c3f8418c95c7a9d6975e4111\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.782062 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.781993 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e18c5276c3f8418c95c7a9d6975e4111-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal\" (UID: \"e18c5276c3f8418c95c7a9d6975e4111\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.782062 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.782046 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e18c5276c3f8418c95c7a9d6975e4111-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal\" (UID: \"e18c5276c3f8418c95c7a9d6975e4111\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.782159 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.782062 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0af90d6e33273b8a76167f3f487fd1b0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-111.ec2.internal\" (UID: \"0af90d6e33273b8a76167f3f487fd1b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.782159 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.782114 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e18c5276c3f8418c95c7a9d6975e4111-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal\" (UID: \"e18c5276c3f8418c95c7a9d6975e4111\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.865172 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.865137 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-111.ec2.internal\" not found" Jul 02 13:15:23.966075 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:23.966006 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-111.ec2.internal\" not found" Jul 02 13:15:23.986622 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.986596 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-111.ec2.internal" Jul 02 13:15:23.990770 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:23.990748 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal" Jul 02 13:15:24.066899 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:24.066847 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-111.ec2.internal\" not found" Jul 02 13:15:24.167416 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:24.167371 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-111.ec2.internal\" not found" Jul 02 13:15:24.267998 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:24.267911 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-111.ec2.internal\" not found" Jul 02 13:15:24.368624 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:24.368591 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-111.ec2.internal\" not found" Jul 02 13:15:24.374816 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:24.374785 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:15:24.420891 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:24.420856 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 13:15:24.421296 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:24.421030 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 13:15:24.421296 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:24.421049 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 13:15:24.469395 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:24.469358 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-111.ec2.internal\" not found" Jul 02 13:15:24.495175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:24.495140 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 13:10:24 +0000 UTC" deadline="2028-02-03 11:29:50.052933139 +0000 UTC" Jul 02 13:15:24.495175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:24.495170 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13942h14m25.557765808s" Jul 02 13:15:24.570578 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:24.570492 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-111.ec2.internal\" not found" Jul 02 13:15:24.580953 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:24.580929 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:15:24.679591 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:24.679401 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal" Jul 02 13:15:24.697535 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:24.697508 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 13:15:24.698519 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:24.698500 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-111.ec2.internal" Jul 02 13:15:24.707511 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:24.707486 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 13:15:24.759012 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:24.758974 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode18c5276c3f8418c95c7a9d6975e4111.slice/crio-71a825a7ccdec22b5a64dfa19fca79bedeea0cfd63313dc59fd04c2c3b87895d WatchSource:0}: Error finding container 71a825a7ccdec22b5a64dfa19fca79bedeea0cfd63313dc59fd04c2c3b87895d: Status 404 returned error can't find the container with id 71a825a7ccdec22b5a64dfa19fca79bedeea0cfd63313dc59fd04c2c3b87895d Jul 02 13:15:24.759217 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:24.759197 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af90d6e33273b8a76167f3f487fd1b0.slice/crio-0886c5b4e8e92cd97dbea4e5a9ba9bcc14a2e040263cdf0612ec0698ce9751fe WatchSource:0}: Error finding container 0886c5b4e8e92cd97dbea4e5a9ba9bcc14a2e040263cdf0612ec0698ce9751fe: Status 404 returned error can't find the container with id 0886c5b4e8e92cd97dbea4e5a9ba9bcc14a2e040263cdf0612ec0698ce9751fe Jul 02 13:15:24.764136 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:24.764119 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 13:15:24.966456 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:24.966420 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:15:25.461792 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.461737 2561 apiserver.go:52] "Watching apiserver" Jul 02 13:15:25.472255 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.472216 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 13:15:25.472641 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.472617 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-hpn86","openshift-network-operator/iptables-alerter-klrj5","kube-system/konnectivity-agent-crfrg","kube-system/kube-apiserver-proxy-ip-10-0-133-111.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5","openshift-cluster-node-tuning-operator/tuned-xw4f6","openshift-image-registry/node-ca-j8qj5","openshift-multus/network-metrics-daemon-dqx8f","openshift-network-diagnostics/network-check-target-pnkz8","openshift-ovn-kubernetes/ovnkube-node-4p5pk","kube-system/global-pull-secret-syncer-n4dh5","openshift-dns/node-resolver-dxl9g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal","openshift-multus/multus-8dlht"] Jul 02 13:15:25.475412 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.475389 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.476625 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.476594 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:25.476761 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:25.476672 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:25.477771 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.477745 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-crfrg" Jul 02 13:15:25.478306 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.478286 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 13:15:25.478624 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.478606 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 13:15:25.478987 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.478975 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.479685 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.479662 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 13:15:25.480060 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.480037 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 13:15:25.480165 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.480075 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 13:15:25.480224 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.480204 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4hbxl\"" Jul 02 13:15:25.480313 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.480296 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.480454 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.480423 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 13:15:25.480538 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.480519 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 13:15:25.480712 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.480694 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 13:15:25.481806 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.481427 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.481806 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.481535 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 13:15:25.481806 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.481565 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 13:15:25.481806 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.481586 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 13:15:25.481806 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.481639 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-prjn6\"" Jul 02 13:15:25.481806 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.481754 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 13:15:25.481806 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.481814 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pptw4\"" Jul 02 13:15:25.482227 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.481975 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 13:15:25.482819 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.482797 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:25.482942 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:25.482881 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:25.483227 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.483133 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 13:15:25.483227 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.483153 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zwn2d\"" Jul 02 13:15:25.483353 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.483295 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 13:15:25.483490 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.483472 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 13:15:25.484133 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.484117 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:15:25.484404 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.484384 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 13:15:25.484404 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.484393 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:25.484535 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.484432 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ms5t4\"" Jul 02 13:15:25.484535 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:25.484456 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:25.485651 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.485635 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-klrj5" Jul 02 13:15:25.486972 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.486954 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.487869 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.487852 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 13:15:25.488238 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.488218 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wrdzw\"" Jul 02 13:15:25.488330 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.488295 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j8qj5" Jul 02 13:15:25.488388 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.488360 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:15:25.488638 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.488621 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 13:15:25.489095 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.489079 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 13:15:25.489283 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.489270 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 13:15:25.489543 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.489527 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dxl9g" Jul 02 13:15:25.489631 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.489615 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4882l\"" Jul 02 13:15:25.490908 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.490885 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 13:15:25.491162 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.491143 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p9fwg\"" Jul 02 13:15:25.491269 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.491178 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 13:15:25.491269 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.491223 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 13:15:25.492179 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.492155 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 13:15:25.492624 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.492567 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-kubelet\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.492706 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.492665 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-node-log\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.492769 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.492710 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c-konnectivity-ca\") pod \"konnectivity-agent-crfrg\" (UID: \"5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c\") " pod="kube-system/konnectivity-agent-crfrg" Jul 02 13:15:25.492769 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.492749 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-var-lib-cni-multus\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.492908 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.492782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-run-multus-certs\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.492908 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.492816 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a1ec351-fa5c-4063-805b-df1e9c6cc243-kubelet-config\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:25.493015 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.492956 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 13:15:25.493015 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493000 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a1ec351-fa5c-4063-805b-df1e9c6cc243-dbus\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:25.493124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493044 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-krghf\"" Jul 02 13:15:25.493176 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493046 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-os-release\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.493232 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493188 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-device-dir\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.493284 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493242 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-systemd-units\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.493284 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493273 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-cni-bin\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.493386 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493311 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.493515 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493495 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-system-cni-dir\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.493574 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493532 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-run-k8s-cni-cncf-io\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.493626 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493567 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9gpp\" (UniqueName: \"kubernetes.io/projected/9082e027-f992-4698-8370-a11ad9c4467d-kube-api-access-n9gpp\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.493774 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493748 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-socket-dir\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.493844 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493798 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2ddf1fc-da82-425b-9781-890ab6e30d11-ovn-node-metrics-cert\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.493844 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493831 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wctd5\" (UniqueName: \"kubernetes.io/projected/b2ddf1fc-da82-425b-9781-890ab6e30d11-kube-api-access-wctd5\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.493972 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493868 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:25.494029 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.493999 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-multus-cni-dir\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.494082 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494050 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-hostroot\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.494138 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494091 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-run-systemd\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.494138 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494132 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-run-ovn\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.494235 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494168 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2ddf1fc-da82-425b-9781-890ab6e30d11-env-overrides\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.494235 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2ddf1fc-da82-425b-9781-890ab6e30d11-ovnkube-script-lib\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.494320 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-multus-socket-dir-parent\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.494320 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494279 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-multus-conf-dir\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.494320 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494308 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9082e027-f992-4698-8370-a11ad9c4467d-multus-daemon-config\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.494456 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494338 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.494456 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-registration-dir\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.494456 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494423 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-sys-fs\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.494599 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494454 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-log-socket\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.494599 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-cni-netd\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.494599 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9082e027-f992-4698-8370-a11ad9c4467d-cni-binary-copy\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.494599 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494539 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-run-netns\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.494784 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494640 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-var-lib-cni-bin\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.494784 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494674 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-etc-selinux\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.494784 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494729 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-run-netns\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.494784 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494763 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-etc-openvswitch\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.494994 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494794 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-run-openvswitch\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.494994 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494827 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-run-ovn-kubernetes\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.494994 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494931 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 13:15:25.494994 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.494939 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-cnibin\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.495184 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.495015 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8m2t\" (UniqueName: \"kubernetes.io/projected/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-kube-api-access-d8m2t\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.495184 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.495058 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-slash\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.495184 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.495107 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-var-lib-openvswitch\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.495331 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.495151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2ddf1fc-da82-425b-9781-890ab6e30d11-ovnkube-config\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.495331 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.495323 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c-agent-certs\") pod \"konnectivity-agent-crfrg\" (UID: \"5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c\") " pod="kube-system/konnectivity-agent-crfrg" Jul 02 13:15:25.495443 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.495360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-var-lib-kubelet\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.495443 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.495390 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-etc-kubernetes\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.526604 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.526579 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7kkck" Jul 02 13:15:25.536199 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.536176 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7kkck" Jul 02 13:15:25.555522 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.555459 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal" event={"ID":"e18c5276c3f8418c95c7a9d6975e4111","Type":"ContainerStarted","Data":"71a825a7ccdec22b5a64dfa19fca79bedeea0cfd63313dc59fd04c2c3b87895d"} Jul 02 13:15:25.556531 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.556506 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-111.ec2.internal" event={"ID":"0af90d6e33273b8a76167f3f487fd1b0","Type":"ContainerStarted","Data":"0886c5b4e8e92cd97dbea4e5a9ba9bcc14a2e040263cdf0612ec0698ce9751fe"} Jul 02 13:15:25.581089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.581057 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 13:15:25.596503 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596464 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-run-ovn\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.596503 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596505 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs\") pod \"network-metrics-daemon-dqx8f\" (UID: \"2f1aa242-11f4-4207-86f5-739e590470b1\") " pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:25.596757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596525 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-modprobe-d\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.596757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-kubernetes\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.596757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596562 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/927b0641-f215-415b-854d-98668f379177-iptables-alerter-script\") pod \"iptables-alerter-klrj5\" (UID: \"927b0641-f215-415b-854d-98668f379177\") " pod="openshift-network-operator/iptables-alerter-klrj5" Jul 02 13:15:25.596757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596588 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0d8869e-bf53-419d-a309-080a540fc557-cnibin\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.596757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596598 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-run-ovn\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.596757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-multus-socket-dir-parent\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.596757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596641 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9082e027-f992-4698-8370-a11ad9c4467d-multus-daemon-config\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.596757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.596757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596676 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-registration-dir\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.596757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596719 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-log-socket\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.596757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596741 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.596757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596745 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9082e027-f992-4698-8370-a11ad9c4467d-cni-binary-copy\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596763 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-registration-dir\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596767 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-multus-socket-dir-parent\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596790 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-run-netns\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596809 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-etc-selinux\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-run-netns\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596858 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-run-netns\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596811 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-log-socket\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596894 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-etc-openvswitch\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596923 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-run-ovn-kubernetes\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596941 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-etc-openvswitch\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596888 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-run-netns\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596954 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0d8869e-bf53-419d-a309-080a540fc557-cni-binary-copy\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596966 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-etc-selinux\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.596996 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8m2t\" (UniqueName: \"kubernetes.io/projected/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-kube-api-access-d8m2t\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597023 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-run-ovn-kubernetes\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597026 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c-agent-certs\") pod \"konnectivity-agent-crfrg\" (UID: \"5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c\") " pod="kube-system/konnectivity-agent-crfrg" Jul 02 13:15:25.597411 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597074 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-var-lib-kubelet\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597099 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/927b0641-f215-415b-854d-98668f379177-host-slash\") pod \"iptables-alerter-klrj5\" (UID: \"927b0641-f215-415b-854d-98668f379177\") " pod="openshift-network-operator/iptables-alerter-klrj5" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597126 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0d8869e-bf53-419d-a309-080a540fc557-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597167 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-etc-kubernetes\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597196 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-kubelet\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597235 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-kubelet\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-node-log\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597279 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9082e027-f992-4698-8370-a11ad9c4467d-multus-daemon-config\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597294 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bdc1df0-73e3-4547-896b-304714d02833-hosts-file\") pod \"node-resolver-dxl9g\" (UID: \"2bdc1df0-73e3-4547-896b-304714d02833\") " pod="openshift-dns/node-resolver-dxl9g" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597279 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-etc-kubernetes\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597297 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9082e027-f992-4698-8370-a11ad9c4467d-cni-binary-copy\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597321 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-node-log\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597358 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bdc1df0-73e3-4547-896b-304714d02833-tmp-dir\") pod \"node-resolver-dxl9g\" (UID: \"2bdc1df0-73e3-4547-896b-304714d02833\") " pod="openshift-dns/node-resolver-dxl9g" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-host\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597413 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-var-lib-cni-multus\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597410 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjkwc\" (UniqueName: \"kubernetes.io/projected/613767fc-09e6-4b4a-b525-0fff8120e7d7-kube-api-access-hjkwc\") pod \"node-ca-j8qj5\" (UID: \"613767fc-09e6-4b4a-b525-0fff8120e7d7\") " pod="openshift-image-registry/node-ca-j8qj5" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597458 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-sysctl-conf\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.598175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597492 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-run\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597516 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c648e181-461c-41a6-9dec-618c0fa65db4-tmp\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597519 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-var-lib-cni-multus\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c795w\" (UniqueName: \"kubernetes.io/projected/e0d8869e-bf53-419d-a309-080a540fc557-kube-api-access-c795w\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-systemd-units\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597585 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9chhf\" (UniqueName: \"kubernetes.io/projected/2f1aa242-11f4-4207-86f5-739e590470b1-kube-api-access-9chhf\") pod \"network-metrics-daemon-dqx8f\" (UID: \"2f1aa242-11f4-4207-86f5-739e590470b1\") " pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-system-cni-dir\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597617 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-systemd-units\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-run-k8s-cni-cncf-io\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597667 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-run-k8s-cni-cncf-io\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597674 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2ddf1fc-da82-425b-9781-890ab6e30d11-ovn-node-metrics-cert\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597701 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597717 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-system-cni-dir\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85hgg\" (UniqueName: \"kubernetes.io/projected/c648e181-461c-41a6-9dec-618c0fa65db4-kube-api-access-85hgg\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597753 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qlhk\" (UniqueName: \"kubernetes.io/projected/927b0641-f215-415b-854d-98668f379177-kube-api-access-4qlhk\") pod \"iptables-alerter-klrj5\" (UID: \"927b0641-f215-415b-854d-98668f379177\") " pod="openshift-network-operator/iptables-alerter-klrj5" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597774 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0d8869e-bf53-419d-a309-080a540fc557-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597790 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-hostroot\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.599004 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:25.597797 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-run-systemd\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597844 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2ddf1fc-da82-425b-9781-890ab6e30d11-env-overrides\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:25.597881 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret podName:8a1ec351-fa5c-4063-805b-df1e9c6cc243 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:26.097863023 +0000 UTC m=+2.988173093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret") pod "global-pull-secret-syncer-n4dh5" (UID: "8a1ec351-fa5c-4063-805b-df1e9c6cc243") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597884 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-run-systemd\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597896 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2ddf1fc-da82-425b-9781-890ab6e30d11-ovnkube-script-lib\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597949 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0d8869e-bf53-419d-a309-080a540fc557-system-cni-dir\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.597982 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-multus-conf-dir\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598006 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-sys-fs\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598028 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-cni-netd\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598056 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/613767fc-09e6-4b4a-b525-0fff8120e7d7-serviceca\") pod \"node-ca-j8qj5\" (UID: \"613767fc-09e6-4b4a-b525-0fff8120e7d7\") " pod="openshift-image-registry/node-ca-j8qj5" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598051 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-multus-conf-dir\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598076 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-sys\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-var-lib-cni-bin\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598122 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-sys-fs\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598139 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-cni-netd\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-run-openvswitch\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.599830 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598183 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-var-lib-cni-bin\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598191 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-run-openvswitch\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598199 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2ddf1fc-da82-425b-9781-890ab6e30d11-ovnkube-config\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598229 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c648e181-461c-41a6-9dec-618c0fa65db4-etc-tuned\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-cnibin\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598316 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2ddf1fc-da82-425b-9781-890ab6e30d11-env-overrides\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-slash\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598368 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-cnibin\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598406 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-slash\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598411 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-var-lib-openvswitch\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598373 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-var-lib-openvswitch\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/613767fc-09e6-4b4a-b525-0fff8120e7d7-host\") pod \"node-ca-j8qj5\" (UID: \"613767fc-09e6-4b4a-b525-0fff8120e7d7\") " pod="openshift-image-registry/node-ca-j8qj5" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598519 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-var-lib-kubelet\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598447 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-hostroot\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598550 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c-konnectivity-ca\") pod \"konnectivity-agent-crfrg\" (UID: \"5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c\") " pod="kube-system/konnectivity-agent-crfrg" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598550 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2ddf1fc-da82-425b-9781-890ab6e30d11-ovnkube-script-lib\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598576 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-sysconfig\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598621 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-var-lib-kubelet\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.600767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598634 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0d8869e-bf53-419d-a309-080a540fc557-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-run-multus-certs\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a1ec351-fa5c-4063-805b-df1e9c6cc243-kubelet-config\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598704 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-host-run-multus-certs\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598668 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2ddf1fc-da82-425b-9781-890ab6e30d11-ovnkube-config\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598725 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a1ec351-fa5c-4063-805b-df1e9c6cc243-dbus\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598766 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-systemd\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598797 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0d8869e-bf53-419d-a309-080a540fc557-os-release\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598851 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a1ec351-fa5c-4063-805b-df1e9c6cc243-kubelet-config\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598854 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-os-release\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-device-dir\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598922 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-cni-bin\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598944 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a1ec351-fa5c-4063-805b-df1e9c6cc243-dbus\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598953 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598975 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-os-release\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.598984 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsrkn\" (UniqueName: \"kubernetes.io/projected/2bdc1df0-73e3-4547-896b-304714d02833-kube-api-access-lsrkn\") pod \"node-resolver-dxl9g\" (UID: \"2bdc1df0-73e3-4547-896b-304714d02833\") " pod="openshift-dns/node-resolver-dxl9g" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.599012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-lib-modules\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.601521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.599016 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-cni-bin\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.602061 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.599046 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9gpp\" (UniqueName: \"kubernetes.io/projected/9082e027-f992-4698-8370-a11ad9c4467d-kube-api-access-n9gpp\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.602061 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.599034 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-device-dir\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.602061 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.599065 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2ddf1fc-da82-425b-9781-890ab6e30d11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.602061 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.599077 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-socket-dir\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.602061 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.599083 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c-konnectivity-ca\") pod \"konnectivity-agent-crfrg\" (UID: \"5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c\") " pod="kube-system/konnectivity-agent-crfrg" Jul 02 13:15:25.602061 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.599103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wctd5\" (UniqueName: \"kubernetes.io/projected/b2ddf1fc-da82-425b-9781-890ab6e30d11-kube-api-access-wctd5\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.602061 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.599133 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hq9c\" (UniqueName: \"kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c\") pod \"network-check-target-pnkz8\" (UID: \"d10166f9-2429-430f-9afa-92cda8651df9\") " pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:25.602061 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.599159 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-sysctl-d\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.602061 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.599185 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-multus-cni-dir\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.602061 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.599187 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-socket-dir\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.602061 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.599282 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9082e027-f992-4698-8370-a11ad9c4467d-multus-cni-dir\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.602061 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.601491 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2ddf1fc-da82-425b-9781-890ab6e30d11-ovn-node-metrics-cert\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.602061 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.601502 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c-agent-certs\") pod \"konnectivity-agent-crfrg\" (UID: \"5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c\") " pod="kube-system/konnectivity-agent-crfrg" Jul 02 13:15:25.606983 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.606960 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8m2t\" (UniqueName: \"kubernetes.io/projected/d132de26-0eb0-47ac-8ff6-e7855d3f2c68-kube-api-access-d8m2t\") pod \"aws-ebs-csi-driver-node-tq9l5\" (UID: \"d132de26-0eb0-47ac-8ff6-e7855d3f2c68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.608727 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.608702 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9gpp\" (UniqueName: \"kubernetes.io/projected/9082e027-f992-4698-8370-a11ad9c4467d-kube-api-access-n9gpp\") pod \"multus-8dlht\" (UID: \"9082e027-f992-4698-8370-a11ad9c4467d\") " pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.609108 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.609089 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wctd5\" (UniqueName: \"kubernetes.io/projected/b2ddf1fc-da82-425b-9781-890ab6e30d11-kube-api-access-wctd5\") pod \"ovnkube-node-4p5pk\" (UID: \"b2ddf1fc-da82-425b-9781-890ab6e30d11\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.700255 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c648e181-461c-41a6-9dec-618c0fa65db4-etc-tuned\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.700255 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/613767fc-09e6-4b4a-b525-0fff8120e7d7-host\") pod \"node-ca-j8qj5\" (UID: \"613767fc-09e6-4b4a-b525-0fff8120e7d7\") " pod="openshift-image-registry/node-ca-j8qj5" Jul 02 13:15:25.700517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700281 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-sysconfig\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.700517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700299 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0d8869e-bf53-419d-a309-080a540fc557-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.700517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700318 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-systemd\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.700517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0d8869e-bf53-419d-a309-080a540fc557-os-release\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.700517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700362 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/613767fc-09e6-4b4a-b525-0fff8120e7d7-host\") pod \"node-ca-j8qj5\" (UID: \"613767fc-09e6-4b4a-b525-0fff8120e7d7\") " pod="openshift-image-registry/node-ca-j8qj5" Jul 02 13:15:25.700517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsrkn\" (UniqueName: \"kubernetes.io/projected/2bdc1df0-73e3-4547-896b-304714d02833-kube-api-access-lsrkn\") pod \"node-resolver-dxl9g\" (UID: \"2bdc1df0-73e3-4547-896b-304714d02833\") " pod="openshift-dns/node-resolver-dxl9g" Jul 02 13:15:25.700517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700397 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-sysconfig\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.700517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-lib-modules\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.700517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700427 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-systemd\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.700517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700459 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hq9c\" (UniqueName: \"kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c\") pod \"network-check-target-pnkz8\" (UID: \"d10166f9-2429-430f-9afa-92cda8651df9\") " pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:25.700517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700469 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0d8869e-bf53-419d-a309-080a540fc557-os-release\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.700517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700486 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-sysctl-d\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.700517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs\") pod \"network-metrics-daemon-dqx8f\" (UID: \"2f1aa242-11f4-4207-86f5-739e590470b1\") " pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:25.700517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700523 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-lib-modules\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-modprobe-d\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700584 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-kubernetes\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700643 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-sysctl-d\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:25.700662 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700669 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-modprobe-d\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700693 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/927b0641-f215-415b-854d-98668f379177-iptables-alerter-script\") pod \"iptables-alerter-klrj5\" (UID: \"927b0641-f215-415b-854d-98668f379177\") " pod="openshift-network-operator/iptables-alerter-klrj5" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0d8869e-bf53-419d-a309-080a540fc557-cnibin\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700730 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-kubernetes\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:25.700741 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs podName:2f1aa242-11f4-4207-86f5-739e590470b1 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:26.20072032 +0000 UTC m=+3.091030353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs") pod "network-metrics-daemon-dqx8f" (UID: "2f1aa242-11f4-4207-86f5-739e590470b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700770 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0d8869e-bf53-419d-a309-080a540fc557-cnibin\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700784 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0d8869e-bf53-419d-a309-080a540fc557-cni-binary-copy\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700813 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-var-lib-kubelet\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700885 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-var-lib-kubelet\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700881 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/927b0641-f215-415b-854d-98668f379177-host-slash\") pod \"iptables-alerter-klrj5\" (UID: \"927b0641-f215-415b-854d-98668f379177\") " pod="openshift-network-operator/iptables-alerter-klrj5" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0d8869e-bf53-419d-a309-080a540fc557-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700928 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/927b0641-f215-415b-854d-98668f379177-host-slash\") pod \"iptables-alerter-klrj5\" (UID: \"927b0641-f215-415b-854d-98668f379177\") " pod="openshift-network-operator/iptables-alerter-klrj5" Jul 02 13:15:25.701210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700961 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bdc1df0-73e3-4547-896b-304714d02833-hosts-file\") pod \"node-resolver-dxl9g\" (UID: \"2bdc1df0-73e3-4547-896b-304714d02833\") " pod="openshift-dns/node-resolver-dxl9g" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.700986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bdc1df0-73e3-4547-896b-304714d02833-tmp-dir\") pod \"node-resolver-dxl9g\" (UID: \"2bdc1df0-73e3-4547-896b-304714d02833\") " pod="openshift-dns/node-resolver-dxl9g" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-host\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701037 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjkwc\" (UniqueName: \"kubernetes.io/projected/613767fc-09e6-4b4a-b525-0fff8120e7d7-kube-api-access-hjkwc\") pod \"node-ca-j8qj5\" (UID: \"613767fc-09e6-4b4a-b525-0fff8120e7d7\") " pod="openshift-image-registry/node-ca-j8qj5" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-sysctl-conf\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701065 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bdc1df0-73e3-4547-896b-304714d02833-hosts-file\") pod \"node-resolver-dxl9g\" (UID: \"2bdc1df0-73e3-4547-896b-304714d02833\") " pod="openshift-dns/node-resolver-dxl9g" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701082 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-run\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701081 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0d8869e-bf53-419d-a309-080a540fc557-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c648e181-461c-41a6-9dec-618c0fa65db4-tmp\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701124 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-host\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701133 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c795w\" (UniqueName: \"kubernetes.io/projected/e0d8869e-bf53-419d-a309-080a540fc557-kube-api-access-c795w\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701164 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9chhf\" (UniqueName: \"kubernetes.io/projected/2f1aa242-11f4-4207-86f5-739e590470b1-kube-api-access-9chhf\") pod \"network-metrics-daemon-dqx8f\" (UID: \"2f1aa242-11f4-4207-86f5-739e590470b1\") " pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701209 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85hgg\" (UniqueName: \"kubernetes.io/projected/c648e181-461c-41a6-9dec-618c0fa65db4-kube-api-access-85hgg\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701234 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qlhk\" (UniqueName: \"kubernetes.io/projected/927b0641-f215-415b-854d-98668f379177-kube-api-access-4qlhk\") pod \"iptables-alerter-klrj5\" (UID: \"927b0641-f215-415b-854d-98668f379177\") " pod="openshift-network-operator/iptables-alerter-klrj5" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701242 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-etc-sysctl-conf\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701261 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0d8869e-bf53-419d-a309-080a540fc557-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0d8869e-bf53-419d-a309-080a540fc557-system-cni-dir\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.702124 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701323 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/613767fc-09e6-4b4a-b525-0fff8120e7d7-serviceca\") pod \"node-ca-j8qj5\" (UID: \"613767fc-09e6-4b4a-b525-0fff8120e7d7\") " pod="openshift-image-registry/node-ca-j8qj5" Jul 02 13:15:25.702639 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701349 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bdc1df0-73e3-4547-896b-304714d02833-tmp-dir\") pod \"node-resolver-dxl9g\" (UID: \"2bdc1df0-73e3-4547-896b-304714d02833\") " pod="openshift-dns/node-resolver-dxl9g" Jul 02 13:15:25.702639 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701357 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/927b0641-f215-415b-854d-98668f379177-iptables-alerter-script\") pod \"iptables-alerter-klrj5\" (UID: \"927b0641-f215-415b-854d-98668f379177\") " pod="openshift-network-operator/iptables-alerter-klrj5" Jul 02 13:15:25.702639 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701353 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-sys\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.702639 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-sys\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.702639 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701498 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0d8869e-bf53-419d-a309-080a540fc557-cni-binary-copy\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.702639 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701081 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0d8869e-bf53-419d-a309-080a540fc557-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.702639 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701506 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c648e181-461c-41a6-9dec-618c0fa65db4-run\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.702639 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701586 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0d8869e-bf53-419d-a309-080a540fc557-system-cni-dir\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.702639 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.701978 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/613767fc-09e6-4b4a-b525-0fff8120e7d7-serviceca\") pod \"node-ca-j8qj5\" (UID: \"613767fc-09e6-4b4a-b525-0fff8120e7d7\") " pod="openshift-image-registry/node-ca-j8qj5" Jul 02 13:15:25.702639 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.702010 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0d8869e-bf53-419d-a309-080a540fc557-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.703064 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.702954 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c648e181-461c-41a6-9dec-618c0fa65db4-etc-tuned\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.703492 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.703474 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c648e181-461c-41a6-9dec-618c0fa65db4-tmp\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.713601 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:25.713532 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:15:25.713601 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:25.713553 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:15:25.713601 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:25.713565 2561 projected.go:196] Error preparing data for projected volume kube-api-access-9hq9c for pod openshift-network-diagnostics/network-check-target-pnkz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:15:25.713843 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:25.713632 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c podName:d10166f9-2429-430f-9afa-92cda8651df9 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:26.2136163 +0000 UTC m=+3.103926327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9hq9c" (UniqueName: "kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c") pod "network-check-target-pnkz8" (UID: "d10166f9-2429-430f-9afa-92cda8651df9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:15:25.714430 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.714395 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsrkn\" (UniqueName: \"kubernetes.io/projected/2bdc1df0-73e3-4547-896b-304714d02833-kube-api-access-lsrkn\") pod \"node-resolver-dxl9g\" (UID: \"2bdc1df0-73e3-4547-896b-304714d02833\") " pod="openshift-dns/node-resolver-dxl9g" Jul 02 13:15:25.716351 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.716321 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qlhk\" (UniqueName: \"kubernetes.io/projected/927b0641-f215-415b-854d-98668f379177-kube-api-access-4qlhk\") pod \"iptables-alerter-klrj5\" (UID: \"927b0641-f215-415b-854d-98668f379177\") " pod="openshift-network-operator/iptables-alerter-klrj5" Jul 02 13:15:25.716671 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.716650 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjkwc\" (UniqueName: \"kubernetes.io/projected/613767fc-09e6-4b4a-b525-0fff8120e7d7-kube-api-access-hjkwc\") pod \"node-ca-j8qj5\" (UID: \"613767fc-09e6-4b4a-b525-0fff8120e7d7\") " pod="openshift-image-registry/node-ca-j8qj5" Jul 02 13:15:25.716743 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.716652 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9chhf\" (UniqueName: \"kubernetes.io/projected/2f1aa242-11f4-4207-86f5-739e590470b1-kube-api-access-9chhf\") pod \"network-metrics-daemon-dqx8f\" (UID: \"2f1aa242-11f4-4207-86f5-739e590470b1\") " pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:25.717095 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.717079 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85hgg\" (UniqueName: \"kubernetes.io/projected/c648e181-461c-41a6-9dec-618c0fa65db4-kube-api-access-85hgg\") pod \"tuned-xw4f6\" (UID: \"c648e181-461c-41a6-9dec-618c0fa65db4\") " pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.717528 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.717507 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c795w\" (UniqueName: \"kubernetes.io/projected/e0d8869e-bf53-419d-a309-080a540fc557-kube-api-access-c795w\") pod \"multus-additional-cni-plugins-hpn86\" (UID: \"e0d8869e-bf53-419d-a309-080a540fc557\") " pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.786535 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.786502 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:25.795190 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.795164 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-crfrg" Jul 02 13:15:25.795823 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:25.795783 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ddf1fc_da82_425b_9781_890ab6e30d11.slice/crio-a2822beaabb623b20a114d4dc5fefa421098e61e572b7624c1b0c6c340016fff WatchSource:0}: Error finding container a2822beaabb623b20a114d4dc5fefa421098e61e572b7624c1b0c6c340016fff: Status 404 returned error can't find the container with id a2822beaabb623b20a114d4dc5fefa421098e61e572b7624c1b0c6c340016fff Jul 02 13:15:25.802770 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.802717 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8dlht" Jul 02 13:15:25.803197 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:25.803173 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6a8fbd_dddf_4cbd_bdb9_5106debe7e1c.slice/crio-59b7c60410c0512161bfce3f2f89bf9cd660e802636dcefdcce47c36adf0a36f WatchSource:0}: Error finding container 59b7c60410c0512161bfce3f2f89bf9cd660e802636dcefdcce47c36adf0a36f: Status 404 returned error can't find the container with id 59b7c60410c0512161bfce3f2f89bf9cd660e802636dcefdcce47c36adf0a36f Jul 02 13:15:25.807788 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.807766 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" Jul 02 13:15:25.813281 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:25.813248 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9082e027_f992_4698_8370_a11ad9c4467d.slice/crio-26a8e984a9466051a5f7f169cf198a953d0006a0411dce1abbf787ebe81f5747 WatchSource:0}: Error finding container 26a8e984a9466051a5f7f169cf198a953d0006a0411dce1abbf787ebe81f5747: Status 404 returned error can't find the container with id 26a8e984a9466051a5f7f169cf198a953d0006a0411dce1abbf787ebe81f5747 Jul 02 13:15:25.813904 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.813882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" Jul 02 13:15:25.816380 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:25.816352 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd132de26_0eb0_47ac_8ff6_e7855d3f2c68.slice/crio-6ec2547232aee1ada946eb970991cc282297bf296df0b220bc0bc0eea238e4f9 WatchSource:0}: Error finding container 6ec2547232aee1ada946eb970991cc282297bf296df0b220bc0bc0eea238e4f9: Status 404 returned error can't find the container with id 6ec2547232aee1ada946eb970991cc282297bf296df0b220bc0bc0eea238e4f9 Jul 02 13:15:25.821352 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.821332 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-klrj5" Jul 02 13:15:25.821705 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:25.821672 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc648e181_461c_41a6_9dec_618c0fa65db4.slice/crio-2fa1f13c9451e4e73739c51fdf9c834515026b82307582c1d7a3cbd485292235 WatchSource:0}: Error finding container 2fa1f13c9451e4e73739c51fdf9c834515026b82307582c1d7a3cbd485292235: Status 404 returned error can't find the container with id 2fa1f13c9451e4e73739c51fdf9c834515026b82307582c1d7a3cbd485292235 Jul 02 13:15:25.827679 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.827652 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hpn86" Jul 02 13:15:25.829259 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:25.829230 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927b0641_f215_415b_854d_98668f379177.slice/crio-deec025093b2b6035a6702bb7413210bacc871cdc9c6c3804faa883c436f0af5 WatchSource:0}: Error finding container deec025093b2b6035a6702bb7413210bacc871cdc9c6c3804faa883c436f0af5: Status 404 returned error can't find the container with id deec025093b2b6035a6702bb7413210bacc871cdc9c6c3804faa883c436f0af5 Jul 02 13:15:25.833538 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.833519 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j8qj5" Jul 02 13:15:25.835454 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:25.835426 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d8869e_bf53_419d_a309_080a540fc557.slice/crio-7fd5e6792cc054c2936382d79d88a44de161241fc198529d3885ab75ebb3c8d1 WatchSource:0}: Error finding container 7fd5e6792cc054c2936382d79d88a44de161241fc198529d3885ab75ebb3c8d1: Status 404 returned error can't find the container with id 7fd5e6792cc054c2936382d79d88a44de161241fc198529d3885ab75ebb3c8d1 Jul 02 13:15:25.838499 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.838478 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dxl9g" Jul 02 13:15:25.840837 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:25.840819 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:15:25.842163 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:25.842141 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod613767fc_09e6_4b4a_b525_0fff8120e7d7.slice/crio-afe4e905af24451802f471cb9ce839287fcbbf570566adb40be92f6ce3995e53 WatchSource:0}: Error finding container afe4e905af24451802f471cb9ce839287fcbbf570566adb40be92f6ce3995e53: Status 404 returned error can't find the container with id afe4e905af24451802f471cb9ce839287fcbbf570566adb40be92f6ce3995e53 Jul 02 13:15:25.847216 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:15:25.847194 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bdc1df0_73e3_4547_896b_304714d02833.slice/crio-e7fa60eb646938880525be027cc88531d10ec6d6f03a277e5189ed506b6134fb WatchSource:0}: Error finding container e7fa60eb646938880525be027cc88531d10ec6d6f03a277e5189ed506b6134fb: Status 404 returned error can't find the container with id e7fa60eb646938880525be027cc88531d10ec6d6f03a277e5189ed506b6134fb Jul 02 13:15:26.104064 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.103977 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:26.104235 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:26.104099 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:15:26.104235 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:26.104164 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret podName:8a1ec351-fa5c-4063-805b-df1e9c6cc243 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:27.10414499 +0000 UTC m=+3.994455021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret") pod "global-pull-secret-syncer-n4dh5" (UID: "8a1ec351-fa5c-4063-805b-df1e9c6cc243") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:15:26.205113 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.205083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs\") pod \"network-metrics-daemon-dqx8f\" (UID: \"2f1aa242-11f4-4207-86f5-739e590470b1\") " pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:26.205273 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:26.205219 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:15:26.205309 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:26.205277 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs podName:2f1aa242-11f4-4207-86f5-739e590470b1 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:27.205261149 +0000 UTC m=+4.095571178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs") pod "network-metrics-daemon-dqx8f" (UID: "2f1aa242-11f4-4207-86f5-739e590470b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:15:26.306182 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.306139 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hq9c\" (UniqueName: \"kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c\") pod \"network-check-target-pnkz8\" (UID: \"d10166f9-2429-430f-9afa-92cda8651df9\") " pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:26.306376 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:26.306315 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:15:26.306376 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:26.306370 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:15:26.306487 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:26.306387 2561 projected.go:196] Error preparing data for projected volume kube-api-access-9hq9c for pod openshift-network-diagnostics/network-check-target-pnkz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:15:26.306487 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:26.306457 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c podName:d10166f9-2429-430f-9afa-92cda8651df9 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:27.306436658 +0000 UTC m=+4.196746701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hq9c" (UniqueName: "kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c") pod "network-check-target-pnkz8" (UID: "d10166f9-2429-430f-9afa-92cda8651df9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:15:26.509756 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.509660 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:15:26.538542 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.538494 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 13:10:26 +0000 UTC" deadline="2028-01-26 14:35:38.087231365 +0000 UTC" Jul 02 13:15:26.538542 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.538540 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13753h20m11.548696385s" Jul 02 13:15:26.564989 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.564946 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpn86" event={"ID":"e0d8869e-bf53-419d-a309-080a540fc557","Type":"ContainerStarted","Data":"7fd5e6792cc054c2936382d79d88a44de161241fc198529d3885ab75ebb3c8d1"} Jul 02 13:15:26.567081 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.566977 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-klrj5" event={"ID":"927b0641-f215-415b-854d-98668f379177","Type":"ContainerStarted","Data":"deec025093b2b6035a6702bb7413210bacc871cdc9c6c3804faa883c436f0af5"} Jul 02 13:15:26.573864 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.573814 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" event={"ID":"d132de26-0eb0-47ac-8ff6-e7855d3f2c68","Type":"ContainerStarted","Data":"6ec2547232aee1ada946eb970991cc282297bf296df0b220bc0bc0eea238e4f9"} Jul 02 13:15:26.582476 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.582436 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-crfrg" event={"ID":"5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c","Type":"ContainerStarted","Data":"59b7c60410c0512161bfce3f2f89bf9cd660e802636dcefdcce47c36adf0a36f"} Jul 02 13:15:26.586661 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.586620 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j8qj5" event={"ID":"613767fc-09e6-4b4a-b525-0fff8120e7d7","Type":"ContainerStarted","Data":"afe4e905af24451802f471cb9ce839287fcbbf570566adb40be92f6ce3995e53"} Jul 02 13:15:26.589931 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.589878 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" event={"ID":"c648e181-461c-41a6-9dec-618c0fa65db4","Type":"ContainerStarted","Data":"2fa1f13c9451e4e73739c51fdf9c834515026b82307582c1d7a3cbd485292235"} Jul 02 13:15:26.592607 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.592551 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8dlht" event={"ID":"9082e027-f992-4698-8370-a11ad9c4467d","Type":"ContainerStarted","Data":"26a8e984a9466051a5f7f169cf198a953d0006a0411dce1abbf787ebe81f5747"} Jul 02 13:15:26.596039 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.596005 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" event={"ID":"b2ddf1fc-da82-425b-9781-890ab6e30d11","Type":"ContainerStarted","Data":"a2822beaabb623b20a114d4dc5fefa421098e61e572b7624c1b0c6c340016fff"} Jul 02 13:15:26.601285 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:26.601253 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dxl9g" event={"ID":"2bdc1df0-73e3-4547-896b-304714d02833","Type":"ContainerStarted","Data":"e7fa60eb646938880525be027cc88531d10ec6d6f03a277e5189ed506b6134fb"} Jul 02 13:15:27.114125 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:27.113950 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:27.114125 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:27.114110 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:15:27.114393 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:27.114182 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret podName:8a1ec351-fa5c-4063-805b-df1e9c6cc243 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:29.114160234 +0000 UTC m=+6.004470268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret") pod "global-pull-secret-syncer-n4dh5" (UID: "8a1ec351-fa5c-4063-805b-df1e9c6cc243") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:15:27.215699 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:27.215599 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs\") pod \"network-metrics-daemon-dqx8f\" (UID: \"2f1aa242-11f4-4207-86f5-739e590470b1\") " pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:27.215916 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:27.215813 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:15:27.216028 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:27.215965 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs podName:2f1aa242-11f4-4207-86f5-739e590470b1 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:29.215862139 +0000 UTC m=+6.106172169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs") pod "network-metrics-daemon-dqx8f" (UID: "2f1aa242-11f4-4207-86f5-739e590470b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:15:27.316433 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:27.316391 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hq9c\" (UniqueName: \"kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c\") pod \"network-check-target-pnkz8\" (UID: \"d10166f9-2429-430f-9afa-92cda8651df9\") " pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:27.316651 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:27.316634 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:15:27.316722 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:27.316660 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:15:27.316722 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:27.316674 2561 projected.go:196] Error preparing data for projected volume kube-api-access-9hq9c for pod openshift-network-diagnostics/network-check-target-pnkz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:15:27.316838 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:27.316736 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c podName:d10166f9-2429-430f-9afa-92cda8651df9 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:29.316716904 +0000 UTC m=+6.207026948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hq9c" (UniqueName: "kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c") pod "network-check-target-pnkz8" (UID: "d10166f9-2429-430f-9afa-92cda8651df9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:15:27.539609 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:27.539477 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 13:10:26 +0000 UTC" deadline="2028-04-08 15:01:07.589949928 +0000 UTC" Jul 02 13:15:27.539609 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:27.539553 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15505h45m40.050401811s" Jul 02 13:15:27.554087 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:27.554048 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:27.554295 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:27.554193 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:27.554664 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:27.554639 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:27.554773 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:27.554751 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:27.556027 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:27.555859 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:27.556027 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:27.555999 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:29.132346 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:29.132288 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:29.132955 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:29.132515 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:15:29.132955 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:29.132591 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret podName:8a1ec351-fa5c-4063-805b-df1e9c6cc243 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:33.132568419 +0000 UTC m=+10.022878471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret") pod "global-pull-secret-syncer-n4dh5" (UID: "8a1ec351-fa5c-4063-805b-df1e9c6cc243") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:15:29.233593 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:29.233544 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs\") pod \"network-metrics-daemon-dqx8f\" (UID: \"2f1aa242-11f4-4207-86f5-739e590470b1\") " pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:29.233865 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:29.233783 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:15:29.233936 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:29.233874 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs podName:2f1aa242-11f4-4207-86f5-739e590470b1 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:33.233831776 +0000 UTC m=+10.124141810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs") pod "network-metrics-daemon-dqx8f" (UID: "2f1aa242-11f4-4207-86f5-739e590470b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:15:29.334497 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:29.334447 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hq9c\" (UniqueName: \"kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c\") pod \"network-check-target-pnkz8\" (UID: \"d10166f9-2429-430f-9afa-92cda8651df9\") " pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:29.334711 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:29.334643 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:15:29.334711 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:29.334664 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:15:29.334711 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:29.334678 2561 projected.go:196] Error preparing data for projected volume kube-api-access-9hq9c for pod openshift-network-diagnostics/network-check-target-pnkz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:15:29.334957 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:29.334740 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c podName:d10166f9-2429-430f-9afa-92cda8651df9 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:33.334720532 +0000 UTC m=+10.225030566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hq9c" (UniqueName: "kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c") pod "network-check-target-pnkz8" (UID: "d10166f9-2429-430f-9afa-92cda8651df9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:15:29.552748 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:29.551980 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:29.552748 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:29.552130 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:29.552748 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:29.552530 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:29.552748 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:29.552625 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:29.553397 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:29.552917 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:29.553397 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:29.553030 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:31.552034 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:31.551462 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:31.552034 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:31.551462 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:31.552034 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:31.551462 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:31.552034 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:31.551621 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:31.552034 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:31.551688 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:31.552034 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:31.551764 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:33.169086 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:33.169034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:33.169597 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:33.169247 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:15:33.169597 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:33.169340 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret podName:8a1ec351-fa5c-4063-805b-df1e9c6cc243 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:41.169314083 +0000 UTC m=+18.059624111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret") pod "global-pull-secret-syncer-n4dh5" (UID: "8a1ec351-fa5c-4063-805b-df1e9c6cc243") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:15:33.269823 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:33.269766 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs\") pod \"network-metrics-daemon-dqx8f\" (UID: \"2f1aa242-11f4-4207-86f5-739e590470b1\") " pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:33.270009 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:33.269969 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:15:33.270087 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:33.270057 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs podName:2f1aa242-11f4-4207-86f5-739e590470b1 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:41.270034424 +0000 UTC m=+18.160344480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs") pod "network-metrics-daemon-dqx8f" (UID: "2f1aa242-11f4-4207-86f5-739e590470b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:15:33.371001 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:33.370959 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hq9c\" (UniqueName: \"kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c\") pod \"network-check-target-pnkz8\" (UID: \"d10166f9-2429-430f-9afa-92cda8651df9\") " pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:33.371183 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:33.371156 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:15:33.371183 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:33.371180 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:15:33.371310 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:33.371196 2561 projected.go:196] Error preparing data for projected volume kube-api-access-9hq9c for pod openshift-network-diagnostics/network-check-target-pnkz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:15:33.371310 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:33.371261 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c podName:d10166f9-2429-430f-9afa-92cda8651df9 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:41.371241653 +0000 UTC m=+18.261551708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hq9c" (UniqueName: "kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c") pod "network-check-target-pnkz8" (UID: "d10166f9-2429-430f-9afa-92cda8651df9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:15:33.552172 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:33.552090 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:33.552351 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:33.552206 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:33.552351 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:33.552246 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:33.552351 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:33.552252 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:33.552533 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:33.552392 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:33.552533 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:33.552464 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:35.552315 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:35.552239 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:35.552315 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:35.552293 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:35.552860 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:35.552393 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:35.552860 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:35.552460 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:35.552860 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:35.552518 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:35.552860 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:35.552594 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:37.551435 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:37.551398 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:37.551846 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:37.551416 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:37.551846 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:37.551529 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:37.551846 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:37.551416 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:37.551846 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:37.551631 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:37.551846 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:37.551666 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:39.551229 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:39.551187 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:39.551642 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:39.551187 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:39.551642 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:39.551319 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:39.551642 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:39.551331 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:39.551642 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:39.551445 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:39.551642 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:39.551547 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:41.234068 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:41.234021 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:41.234652 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:41.234170 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:15:41.234652 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:41.234260 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret podName:8a1ec351-fa5c-4063-805b-df1e9c6cc243 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:57.234236819 +0000 UTC m=+34.124546849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret") pod "global-pull-secret-syncer-n4dh5" (UID: "8a1ec351-fa5c-4063-805b-df1e9c6cc243") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:15:41.335472 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:41.335430 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs\") pod \"network-metrics-daemon-dqx8f\" (UID: \"2f1aa242-11f4-4207-86f5-739e590470b1\") " pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:41.335653 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:41.335563 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:15:41.335653 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:41.335624 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs podName:2f1aa242-11f4-4207-86f5-739e590470b1 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:57.335604166 +0000 UTC m=+34.225914191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs") pod "network-metrics-daemon-dqx8f" (UID: "2f1aa242-11f4-4207-86f5-739e590470b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:15:41.436428 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:41.436389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hq9c\" (UniqueName: \"kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c\") pod \"network-check-target-pnkz8\" (UID: \"d10166f9-2429-430f-9afa-92cda8651df9\") " pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:41.436603 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:41.436535 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:15:41.436603 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:41.436552 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:15:41.436603 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:41.436566 2561 projected.go:196] Error preparing data for projected volume kube-api-access-9hq9c for pod openshift-network-diagnostics/network-check-target-pnkz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:15:41.436747 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:41.436623 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c podName:d10166f9-2429-430f-9afa-92cda8651df9 nodeName:}" failed. No retries permitted until 2026-07-02 13:15:57.436608564 +0000 UTC m=+34.326918609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hq9c" (UniqueName: "kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c") pod "network-check-target-pnkz8" (UID: "d10166f9-2429-430f-9afa-92cda8651df9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:15:41.551566 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:41.551477 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:41.551732 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:41.551477 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:41.551732 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:41.551609 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:41.551732 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:41.551637 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:41.551926 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:41.551754 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:41.551926 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:41.551865 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:43.552581 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:43.552544 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:43.553068 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:43.552658 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:43.553068 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:43.552836 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:43.553068 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:43.552943 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:43.553068 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:43.552986 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:43.553068 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:43.553048 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:45.551874 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:45.551838 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:45.551874 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:45.551862 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:45.552396 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:45.551838 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:45.552396 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:45.551986 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:45.552396 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:45.552043 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:45.552396 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:45.552143 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:47.552574 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.552269 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:47.553269 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.552268 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:47.553269 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:47.552651 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:47.553269 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.552323 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:47.553269 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:47.552736 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:47.553269 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:47.552863 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:47.686549 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.686505 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-crfrg" event={"ID":"5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c","Type":"ContainerStarted","Data":"2043af14a798b9c5c0176d7303c38e47b3378ae715d8af8d939345679b538de1"} Jul 02 13:15:47.688523 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.688491 2561 generic.go:356] "Generic (PLEG): container finished" podID="e18c5276c3f8418c95c7a9d6975e4111" containerID="e674fba0e7827d0597af1b011ed5541f778b1cd5fc6b2064ab78d72d9558f87b" exitCode=0 Jul 02 13:15:47.688678 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.688585 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal" event={"ID":"e18c5276c3f8418c95c7a9d6975e4111","Type":"ContainerDied","Data":"e674fba0e7827d0597af1b011ed5541f778b1cd5fc6b2064ab78d72d9558f87b"} Jul 02 13:15:47.690755 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.690720 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j8qj5" event={"ID":"613767fc-09e6-4b4a-b525-0fff8120e7d7","Type":"ContainerStarted","Data":"86c7e3391561a74d185fba0a4905be9758223f21670e1469feeabe85eabd2635"} Jul 02 13:15:47.693132 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.693096 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" event={"ID":"c648e181-461c-41a6-9dec-618c0fa65db4","Type":"ContainerStarted","Data":"10326773c524ed0dbc5e2779d2a8bf346da17da294afef3ad400539affe36a72"} Jul 02 13:15:47.695078 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.695051 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8dlht" event={"ID":"9082e027-f992-4698-8370-a11ad9c4467d","Type":"ContainerStarted","Data":"97a8394217891c17b365dd3ad04e4a2ec6c9e38985a39743a83e20129f9685a1"} Jul 02 13:15:47.698337 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.698316 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:15:47.698714 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.698691 2561 generic.go:356] "Generic (PLEG): container finished" podID="b2ddf1fc-da82-425b-9781-890ab6e30d11" containerID="1477d3601b5706f10c5f92ec5ccd7442dee92188ae3faa90aba0d64045b0987c" exitCode=1 Jul 02 13:15:47.698898 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.698770 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" event={"ID":"b2ddf1fc-da82-425b-9781-890ab6e30d11","Type":"ContainerStarted","Data":"7b12582905bbb7dd80f9882be8a0bfef575349a070b9cc685ec5e76533850e6f"} Jul 02 13:15:47.698898 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.698878 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" event={"ID":"b2ddf1fc-da82-425b-9781-890ab6e30d11","Type":"ContainerStarted","Data":"53e3249e6a13574d969e535acbb1f0ccbe8ebe212559c3f16f7e74585b850ba9"} Jul 02 13:15:47.698991 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.698929 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" event={"ID":"b2ddf1fc-da82-425b-9781-890ab6e30d11","Type":"ContainerStarted","Data":"3c2f00d39d25ff52ff448859bf444016362a4fc6c65f74a13121af4be78ac79b"} Jul 02 13:15:47.698991 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.698976 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" event={"ID":"b2ddf1fc-da82-425b-9781-890ab6e30d11","Type":"ContainerStarted","Data":"39a2dfbfbce4212668042f5ca90fe0444506c36caca0ea7c7cb2b5de4de534ab"} Jul 02 13:15:47.699100 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.699022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" event={"ID":"b2ddf1fc-da82-425b-9781-890ab6e30d11","Type":"ContainerDied","Data":"1477d3601b5706f10c5f92ec5ccd7442dee92188ae3faa90aba0d64045b0987c"} Jul 02 13:15:47.699100 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.699074 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" event={"ID":"b2ddf1fc-da82-425b-9781-890ab6e30d11","Type":"ContainerStarted","Data":"a96feb724e6c1477de0b0eae8eeb87d8205a2cb9fd56d30a8bd42c3ee50fded8"} Jul 02 13:15:47.700441 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.700389 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-111.ec2.internal" event={"ID":"0af90d6e33273b8a76167f3f487fd1b0","Type":"ContainerStarted","Data":"350a29c6f470c5da78623675ee9ba68148bdc451619d6af39d2cd6fba1bf04f0"} Jul 02 13:15:47.702042 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.702018 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dxl9g" event={"ID":"2bdc1df0-73e3-4547-896b-304714d02833","Type":"ContainerStarted","Data":"8e18996e73c7feb4131ae5c2ac3ec860f26cd8aee2c5c237b73ae3d475077b29"} Jul 02 13:15:47.702903 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.702852 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-crfrg" podStartSLOduration=10.8887575 podStartE2EDuration="23.702794914s" totalImagesPullingTime="12.814037414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:15:47.701547213 +0000 UTC m=+24.591857262" watchObservedRunningTime="2026-07-02 13:15:47.702794914 +0000 UTC m=+24.593104964" Jul 02 13:15:47.703828 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.703786 2561 generic.go:356] "Generic (PLEG): container finished" podID="e0d8869e-bf53-419d-a309-080a540fc557" containerID="08b7a32aaf7bd6c9b18e0917cb81eb297f932c224c20fd5f6d615c4a729b3ac9" exitCode=0 Jul 02 13:15:47.703933 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.703885 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpn86" event={"ID":"e0d8869e-bf53-419d-a309-080a540fc557","Type":"ContainerDied","Data":"08b7a32aaf7bd6c9b18e0917cb81eb297f932c224c20fd5f6d615c4a729b3ac9"} Jul 02 13:15:47.706238 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.706191 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" event={"ID":"d132de26-0eb0-47ac-8ff6-e7855d3f2c68","Type":"ContainerStarted","Data":"232abb0845420703e66062f48c7ef139a4f82c86b5daf101eb0ceb7659dff3dd"} Jul 02 13:15:47.737011 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.736949 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8dlht" podStartSLOduration=2.799805208 podStartE2EDuration="23.736926038s" totalImagesPullingTime="20.93712083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:15:47.736294255 +0000 UTC m=+24.626604303" watchObservedRunningTime="2026-07-02 13:15:47.736926038 +0000 UTC m=+24.627236087" Jul 02 13:15:47.769555 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.769503 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xw4f6" podStartSLOduration=2.8592954649999998 podStartE2EDuration="23.769483198s" totalImagesPullingTime="20.910187733s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:15:47.752993631 +0000 UTC m=+24.643303682" watchObservedRunningTime="2026-07-02 13:15:47.769483198 +0000 UTC m=+24.659793250" Jul 02 13:15:47.784274 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.783617 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-111.ec2.internal" podStartSLOduration=22.783592088 podStartE2EDuration="22.783592088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:15:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:15:47.782904573 +0000 UTC m=+24.673214622" watchObservedRunningTime="2026-07-02 13:15:47.783592088 +0000 UTC m=+24.673902132" Jul 02 13:15:47.784437 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.784293 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j8qj5" podStartSLOduration=2.928086559 podStartE2EDuration="23.784194235s" totalImagesPullingTime="20.856107676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:15:47.768572371 +0000 UTC m=+24.658882420" watchObservedRunningTime="2026-07-02 13:15:47.784194235 +0000 UTC m=+24.674504282" Jul 02 13:15:47.824365 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:47.824304 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dxl9g" podStartSLOduration=2.977651443 podStartE2EDuration="23.824280357s" totalImagesPullingTime="20.846628914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:15:47.823963567 +0000 UTC m=+24.714273615" watchObservedRunningTime="2026-07-02 13:15:47.824280357 +0000 UTC m=+24.714590407" Jul 02 13:15:48.514745 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:48.514716 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 13:15:48.550232 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:48.550135 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T13:15:48.514735944Z","UUID":"9a05842c-4be3-4dff-8034-9e680f1ad798","Handler":null,"Name":"","Endpoint":""} Jul 02 13:15:48.551763 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:48.551741 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 13:15:48.551911 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:48.551776 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 13:15:48.710542 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:48.710508 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal" event={"ID":"e18c5276c3f8418c95c7a9d6975e4111","Type":"ContainerStarted","Data":"b57961be9c565898fd5b403e71ee37a7af814a90d242822d288d3e81d457cff0"} Jul 02 13:15:48.711906 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:48.711882 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-klrj5" event={"ID":"927b0641-f215-415b-854d-98668f379177","Type":"ContainerStarted","Data":"e5d2a67f3063cd70d652973e0f166b53a6e862c09e80d9295ab0718e1f6fdfd7"} Jul 02 13:15:48.713613 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:48.713587 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" event={"ID":"d132de26-0eb0-47ac-8ff6-e7855d3f2c68","Type":"ContainerStarted","Data":"4fe3afc4c43e9ccd241fc3c8c9e0379fb4450d1a2c24fe975947ce275a1ecf3a"} Jul 02 13:15:48.729301 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:48.729244 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-111.ec2.internal" podStartSLOduration=23.729228992 podStartE2EDuration="23.729228992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:15:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:15:48.729000474 +0000 UTC m=+25.619310522" watchObservedRunningTime="2026-07-02 13:15:48.729228992 +0000 UTC m=+25.619539040" Jul 02 13:15:48.743854 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:48.743785 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-klrj5" podStartSLOduration=3.872632357 podStartE2EDuration="24.743770428s" totalImagesPullingTime="20.871138071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:15:48.743402213 +0000 UTC m=+25.633712262" watchObservedRunningTime="2026-07-02 13:15:48.743770428 +0000 UTC m=+25.634080475" Jul 02 13:15:49.551767 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:49.551727 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:49.552050 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:49.551727 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:49.552050 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:49.551881 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:49.552050 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:49.551882 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:49.552050 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:49.552013 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:49.552238 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:49.552149 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:50.525045 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:50.524998 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-crfrg" Jul 02 13:15:50.525899 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:50.525612 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-crfrg" Jul 02 13:15:50.722367 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:50.722286 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:15:50.722774 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:50.722745 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" event={"ID":"b2ddf1fc-da82-425b-9781-890ab6e30d11","Type":"ContainerStarted","Data":"2f979a62651d07cdccac45da12e50acceda1c211512cd9ccddf22a05a351ab34"} Jul 02 13:15:50.725216 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:50.725181 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" event={"ID":"d132de26-0eb0-47ac-8ff6-e7855d3f2c68","Type":"ContainerStarted","Data":"344900f2bf511ac0d0e71a4ce00e43b63271076268d6a3461c8901bbfc50e799"} Jul 02 13:15:50.725403 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:50.725382 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-crfrg" Jul 02 13:15:50.725920 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:50.725900 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-crfrg" Jul 02 13:15:50.745705 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:50.745643 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tq9l5" podStartSLOduration=2.680751766 podStartE2EDuration="26.745621405s" totalImagesPullingTime="24.064869639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:15:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:15:50.745170399 +0000 UTC m=+27.635480452" watchObservedRunningTime="2026-07-02 13:15:50.745621405 +0000 UTC m=+27.635931456" Jul 02 13:15:51.551574 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:51.551539 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:51.551574 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:51.551556 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:51.552141 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:51.551673 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:51.552141 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:51.551679 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:51.552141 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:51.551820 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:51.552141 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:51.551900 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:53.555063 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:53.554883 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:53.555708 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:53.554883 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:53.555708 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:53.555145 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:53.555708 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:53.554899 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:53.555708 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:53.555222 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:53.555708 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:53.555259 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:53.734957 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:53.734932 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:15:53.735352 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:53.735325 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" event={"ID":"b2ddf1fc-da82-425b-9781-890ab6e30d11","Type":"ContainerStarted","Data":"5df2a6adca57fa211b058e72520a7a3986629b6ce2472bbcd1118c124d111c41"} Jul 02 13:15:53.735647 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:53.735628 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:53.735726 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:53.735704 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:53.735857 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:53.735841 2561 scope.go:117] "RemoveContainer" containerID="1477d3601b5706f10c5f92ec5ccd7442dee92188ae3faa90aba0d64045b0987c" Jul 02 13:15:53.737267 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:53.737245 2561 generic.go:356] "Generic (PLEG): container finished" podID="e0d8869e-bf53-419d-a309-080a540fc557" containerID="2be3e527ced28db98912e359b0179824ba4c53fe3d2429f3748934dc468ee949" exitCode=0 Jul 02 13:15:53.737380 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:53.737284 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpn86" event={"ID":"e0d8869e-bf53-419d-a309-080a540fc557","Type":"ContainerDied","Data":"2be3e527ced28db98912e359b0179824ba4c53fe3d2429f3748934dc468ee949"} Jul 02 13:15:53.753931 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:53.753906 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:54.743545 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:54.743516 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:15:54.744264 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:54.743900 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" event={"ID":"b2ddf1fc-da82-425b-9781-890ab6e30d11","Type":"ContainerStarted","Data":"afe927b811d4185768e7d909262c5bb62504bc62ebb343c60a24a9e8b20dafbf"} Jul 02 13:15:54.744264 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:54.744212 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:54.761213 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:54.761180 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:15:54.777398 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:54.777344 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" podStartSLOduration=9.76168898 podStartE2EDuration="30.777328618s" totalImagesPullingTime="21.015639638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:15:54.775827947 +0000 UTC m=+31.666137995" watchObservedRunningTime="2026-07-02 13:15:54.777328618 +0000 UTC m=+31.667638667" Jul 02 13:15:55.078861 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:55.078525 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pnkz8"] Jul 02 13:15:55.078985 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:55.078862 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:55.078985 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:55.078948 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:55.080693 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:55.080672 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dqx8f"] Jul 02 13:15:55.080824 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:55.080759 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:55.080870 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:55.080852 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:55.092932 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:55.092901 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4dh5"] Jul 02 13:15:55.093080 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:55.093012 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:55.093152 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:55.093101 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:55.748624 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:55.748590 2561 generic.go:356] "Generic (PLEG): container finished" podID="e0d8869e-bf53-419d-a309-080a540fc557" containerID="cb9a617f6fbcac92b50581f1f0f07aebed09d78106af9761a902e6d68c3a4d5e" exitCode=0 Jul 02 13:15:55.749075 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:55.748682 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpn86" event={"ID":"e0d8869e-bf53-419d-a309-080a540fc557","Type":"ContainerDied","Data":"cb9a617f6fbcac92b50581f1f0f07aebed09d78106af9761a902e6d68c3a4d5e"} Jul 02 13:15:56.551730 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:56.551698 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:56.551943 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:56.551699 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:56.551943 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:56.551841 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:56.551943 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:56.551915 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:56.551943 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:56.551712 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:56.552152 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:56.551988 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:15:57.246837 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:57.246775 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:57.247307 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:57.246975 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:15:57.247307 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:57.247056 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret podName:8a1ec351-fa5c-4063-805b-df1e9c6cc243 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:29.2470351 +0000 UTC m=+66.137345147 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret") pod "global-pull-secret-syncer-n4dh5" (UID: "8a1ec351-fa5c-4063-805b-df1e9c6cc243") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:15:57.348168 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:57.348074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs\") pod \"network-metrics-daemon-dqx8f\" (UID: \"2f1aa242-11f4-4207-86f5-739e590470b1\") " pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:57.348307 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:57.348237 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:15:57.348346 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:57.348306 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs podName:2f1aa242-11f4-4207-86f5-739e590470b1 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:29.348287092 +0000 UTC m=+66.238597118 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs") pod "network-metrics-daemon-dqx8f" (UID: "2f1aa242-11f4-4207-86f5-739e590470b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:15:57.449041 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:57.448998 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hq9c\" (UniqueName: \"kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c\") pod \"network-check-target-pnkz8\" (UID: \"d10166f9-2429-430f-9afa-92cda8651df9\") " pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:57.449216 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:57.449179 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:15:57.449216 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:57.449210 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:15:57.449298 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:57.449222 2561 projected.go:196] Error preparing data for projected volume kube-api-access-9hq9c for pod openshift-network-diagnostics/network-check-target-pnkz8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:15:57.449298 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:57.449273 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c podName:d10166f9-2429-430f-9afa-92cda8651df9 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:29.4492586 +0000 UTC m=+66.339568651 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hq9c" (UniqueName: "kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c") pod "network-check-target-pnkz8" (UID: "d10166f9-2429-430f-9afa-92cda8651df9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:15:57.756890 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:57.756858 2561 generic.go:356] "Generic (PLEG): container finished" podID="e0d8869e-bf53-419d-a309-080a540fc557" containerID="1afb28baa1a8d066f0d61057ca890418fee6daeff65cefe5fb903e896a44c772" exitCode=0 Jul 02 13:15:57.757044 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:57.756924 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpn86" event={"ID":"e0d8869e-bf53-419d-a309-080a540fc557","Type":"ContainerDied","Data":"1afb28baa1a8d066f0d61057ca890418fee6daeff65cefe5fb903e896a44c772"} Jul 02 13:15:58.551310 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:58.551278 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:15:58.551753 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:58.551278 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:15:58.551753 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:58.551411 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:15:58.551753 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:58.551502 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:15:58.551753 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:15:58.551278 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:15:58.551753 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:15:58.551598 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:16:00.551944 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.551902 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:16:00.552390 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.551923 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:16:00.552390 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:00.552054 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqx8f" podUID="2f1aa242-11f4-4207-86f5-739e590470b1" Jul 02 13:16:00.552390 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.551925 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:16:00.552390 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:00.552120 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4dh5" podUID="8a1ec351-fa5c-4063-805b-df1e9c6cc243" Jul 02 13:16:00.552390 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:00.552199 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnkz8" podUID="d10166f9-2429-430f-9afa-92cda8651df9" Jul 02 13:16:00.912012 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.911977 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-111.ec2.internal" event="NodeReady" Jul 02 13:16:00.912200 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.912113 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 13:16:00.965753 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.965704 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8bxfs"] Jul 02 13:16:00.968612 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.968596 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6b2xw"] Jul 02 13:16:00.968735 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.968711 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:00.971219 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.971188 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 13:16:00.971219 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.971205 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 13:16:00.971412 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.971256 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6bdfl\"" Jul 02 13:16:00.971537 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.971519 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 13:16:00.971611 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.971594 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:00.971663 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.971612 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 13:16:00.973911 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.973892 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 13:16:00.974213 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.974193 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 13:16:00.974434 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.974422 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mrpc5\"" Jul 02 13:16:00.978448 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.978421 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6b2xw"] Jul 02 13:16:00.981280 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:00.981221 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8bxfs"] Jul 02 13:16:01.077080 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.077038 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gkvdd"] Jul 02 13:16:01.077318 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.077283 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpsp7\" (UniqueName: \"kubernetes.io/projected/366e6fd3-acec-45ee-95eb-e2378409a2d9-kube-api-access-hpsp7\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:01.077464 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.077339 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:01.077464 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.077405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/366e6fd3-acec-45ee-95eb-e2378409a2d9-tmp-dir\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:01.077464 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.077436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.077598 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.077491 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqd8j\" (UniqueName: \"kubernetes.io/projected/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-api-access-vqd8j\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.077598 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.077535 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25477ed5-78a5-45ef-9321-cb1c6b4aa814-data-volume\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.077598 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.077569 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/366e6fd3-acec-45ee-95eb-e2378409a2d9-config-volume\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:01.077732 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.077600 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25477ed5-78a5-45ef-9321-cb1c6b4aa814-crio-socket\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.077732 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.077633 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.080230 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.080212 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gkvdd" Jul 02 13:16:01.083001 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.082974 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 13:16:01.083130 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.082978 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 13:16:01.083130 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.083056 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 13:16:01.083462 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.083448 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-phqj7\"" Jul 02 13:16:01.092908 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.092884 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gkvdd"] Jul 02 13:16:01.178300 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.178213 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/366e6fd3-acec-45ee-95eb-e2378409a2d9-tmp-dir\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:01.178300 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.178263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.178300 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.178290 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqd8j\" (UniqueName: \"kubernetes.io/projected/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-api-access-vqd8j\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.178552 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.178318 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25477ed5-78a5-45ef-9321-cb1c6b4aa814-data-volume\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.178552 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.178344 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/366e6fd3-acec-45ee-95eb-e2378409a2d9-config-volume\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:01.178552 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.178379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25477ed5-78a5-45ef-9321-cb1c6b4aa814-crio-socket\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.178552 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.178417 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.178552 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:01.178440 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:16:01.178552 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.178457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsvxb\" (UniqueName: \"kubernetes.io/projected/88b698a4-c42a-4a3d-9707-16d60f7e7b42-kube-api-access-tsvxb\") pod \"ingress-canary-gkvdd\" (UID: \"88b698a4-c42a-4a3d-9707-16d60f7e7b42\") " pod="openshift-ingress-canary/ingress-canary-gkvdd" Jul 02 13:16:01.178552 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:01.178527 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls podName:25477ed5-78a5-45ef-9321-cb1c6b4aa814 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:01.67850312 +0000 UTC m=+38.568813175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8bxfs" (UID: "25477ed5-78a5-45ef-9321-cb1c6b4aa814") : secret "insights-runtime-extractor-tls" not found Jul 02 13:16:01.178879 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.178557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpsp7\" (UniqueName: \"kubernetes.io/projected/366e6fd3-acec-45ee-95eb-e2378409a2d9-kube-api-access-hpsp7\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:01.178879 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.178594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88b698a4-c42a-4a3d-9707-16d60f7e7b42-cert\") pod \"ingress-canary-gkvdd\" (UID: \"88b698a4-c42a-4a3d-9707-16d60f7e7b42\") " pod="openshift-ingress-canary/ingress-canary-gkvdd" Jul 02 13:16:01.178879 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.178646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:01.178879 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.178650 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25477ed5-78a5-45ef-9321-cb1c6b4aa814-crio-socket\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.178879 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:01.178711 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:16:01.178879 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:01.178763 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm podName:25477ed5-78a5-45ef-9321-cb1c6b4aa814 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:01.678747675 +0000 UTC m=+38.569057726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8bxfs" (UID: "25477ed5-78a5-45ef-9321-cb1c6b4aa814") : configmap "kube-rbac-proxy" not found Jul 02 13:16:01.178879 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:01.178778 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:16:01.178879 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:01.178843 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls podName:366e6fd3-acec-45ee-95eb-e2378409a2d9 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:01.678828038 +0000 UTC m=+38.569138081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls") pod "dns-default-6b2xw" (UID: "366e6fd3-acec-45ee-95eb-e2378409a2d9") : secret "dns-default-metrics-tls" not found Jul 02 13:16:01.179158 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.178959 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25477ed5-78a5-45ef-9321-cb1c6b4aa814-data-volume\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.179398 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.179383 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/366e6fd3-acec-45ee-95eb-e2378409a2d9-tmp-dir\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:01.179604 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.179586 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/366e6fd3-acec-45ee-95eb-e2378409a2d9-config-volume\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:01.193082 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.192958 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpsp7\" (UniqueName: \"kubernetes.io/projected/366e6fd3-acec-45ee-95eb-e2378409a2d9-kube-api-access-hpsp7\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:01.193225 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.192992 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqd8j\" (UniqueName: \"kubernetes.io/projected/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-api-access-vqd8j\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.279943 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.279902 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsvxb\" (UniqueName: \"kubernetes.io/projected/88b698a4-c42a-4a3d-9707-16d60f7e7b42-kube-api-access-tsvxb\") pod \"ingress-canary-gkvdd\" (UID: \"88b698a4-c42a-4a3d-9707-16d60f7e7b42\") " pod="openshift-ingress-canary/ingress-canary-gkvdd" Jul 02 13:16:01.279943 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.279945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88b698a4-c42a-4a3d-9707-16d60f7e7b42-cert\") pod \"ingress-canary-gkvdd\" (UID: \"88b698a4-c42a-4a3d-9707-16d60f7e7b42\") " pod="openshift-ingress-canary/ingress-canary-gkvdd" Jul 02 13:16:01.283091 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.283062 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88b698a4-c42a-4a3d-9707-16d60f7e7b42-cert\") pod \"ingress-canary-gkvdd\" (UID: \"88b698a4-c42a-4a3d-9707-16d60f7e7b42\") " pod="openshift-ingress-canary/ingress-canary-gkvdd" Jul 02 13:16:01.289738 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.289702 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsvxb\" (UniqueName: \"kubernetes.io/projected/88b698a4-c42a-4a3d-9707-16d60f7e7b42-kube-api-access-tsvxb\") pod \"ingress-canary-gkvdd\" (UID: \"88b698a4-c42a-4a3d-9707-16d60f7e7b42\") " pod="openshift-ingress-canary/ingress-canary-gkvdd" Jul 02 13:16:01.389757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.389721 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gkvdd" Jul 02 13:16:01.680506 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.680469 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dxl9g_2bdc1df0-73e3-4547-896b-304714d02833/dns-node-resolver/0.log" Jul 02 13:16:01.683709 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.683672 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.683879 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.683756 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:01.683879 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:01.683823 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:16:01.683879 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:01.683833 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:01.684049 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:01.683895 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm podName:25477ed5-78a5-45ef-9321-cb1c6b4aa814 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:02.683873476 +0000 UTC m=+39.574183544 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8bxfs" (UID: "25477ed5-78a5-45ef-9321-cb1c6b4aa814") : configmap "kube-rbac-proxy" not found Jul 02 13:16:01.684049 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:01.683972 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:16:01.684049 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:01.684022 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls podName:25477ed5-78a5-45ef-9321-cb1c6b4aa814 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:02.684009057 +0000 UTC m=+39.574319082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8bxfs" (UID: "25477ed5-78a5-45ef-9321-cb1c6b4aa814") : secret "insights-runtime-extractor-tls" not found Jul 02 13:16:01.684203 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:01.684116 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:16:01.684203 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:01.684154 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls podName:366e6fd3-acec-45ee-95eb-e2378409a2d9 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:02.684144298 +0000 UTC m=+39.574454328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls") pod "dns-default-6b2xw" (UID: "366e6fd3-acec-45ee-95eb-e2378409a2d9") : secret "dns-default-metrics-tls" not found Jul 02 13:16:02.465849 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.465798 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j8qj5_613767fc-09e6-4b4a-b525-0fff8120e7d7/node-ca/0.log" Jul 02 13:16:02.551723 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.551688 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:16:02.551933 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.551688 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:16:02.551933 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.551688 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:16:02.554385 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.554358 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 13:16:02.555644 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.555624 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qblmr\"" Jul 02 13:16:02.555745 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.555624 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ncrqc\"" Jul 02 13:16:02.555745 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.555714 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 13:16:02.555903 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.555622 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 13:16:02.555903 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.555711 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 13:16:02.693762 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.693731 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:02.694436 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.693826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:02.694436 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.693894 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:02.694436 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:02.693928 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:16:02.694436 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:02.693978 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:16:02.694436 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:02.693979 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:16:02.694436 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:02.694016 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls podName:25477ed5-78a5-45ef-9321-cb1c6b4aa814 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:04.693990674 +0000 UTC m=+41.584300920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8bxfs" (UID: "25477ed5-78a5-45ef-9321-cb1c6b4aa814") : secret "insights-runtime-extractor-tls" not found Jul 02 13:16:02.694436 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:02.694042 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm podName:25477ed5-78a5-45ef-9321-cb1c6b4aa814 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:04.69403171 +0000 UTC m=+41.584341739 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8bxfs" (UID: "25477ed5-78a5-45ef-9321-cb1c6b4aa814") : configmap "kube-rbac-proxy" not found Jul 02 13:16:02.694436 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:02.694059 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls podName:366e6fd3-acec-45ee-95eb-e2378409a2d9 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:04.694049228 +0000 UTC m=+41.584359259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls") pod "dns-default-6b2xw" (UID: "366e6fd3-acec-45ee-95eb-e2378409a2d9") : secret "dns-default-metrics-tls" not found Jul 02 13:16:02.788661 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.788628 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9"] Jul 02 13:16:02.793182 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.793151 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" Jul 02 13:16:02.796234 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.796202 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 13:16:02.796486 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.796466 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:16:02.796546 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.796504 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-k9tfw\"" Jul 02 13:16:02.796752 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.796736 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 13:16:02.796845 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.796757 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 13:16:02.800974 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.800914 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9"] Jul 02 13:16:02.842123 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.841932 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gkvdd"] Jul 02 13:16:02.862082 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:16:02.862046 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b698a4_c42a_4a3d_9707_16d60f7e7b42.slice/crio-1e0ac804c9a2c9296d5362383a371ce6c7e1c15bd1ce0fa6c8743570b0265e26 WatchSource:0}: Error finding container 1e0ac804c9a2c9296d5362383a371ce6c7e1c15bd1ce0fa6c8743570b0265e26: Status 404 returned error can't find the container with id 1e0ac804c9a2c9296d5362383a371ce6c7e1c15bd1ce0fa6c8743570b0265e26 Jul 02 13:16:02.894666 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.894643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzznv\" (UniqueName: \"kubernetes.io/projected/c532bcab-a588-49cb-8b64-4a66a3c04558-kube-api-access-fzznv\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wbjr9\" (UID: \"c532bcab-a588-49cb-8b64-4a66a3c04558\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" Jul 02 13:16:02.894737 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.894693 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c532bcab-a588-49cb-8b64-4a66a3c04558-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wbjr9\" (UID: \"c532bcab-a588-49cb-8b64-4a66a3c04558\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" Jul 02 13:16:02.894883 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.894861 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c532bcab-a588-49cb-8b64-4a66a3c04558-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wbjr9\" (UID: \"c532bcab-a588-49cb-8b64-4a66a3c04558\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" Jul 02 13:16:02.995653 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.995563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzznv\" (UniqueName: \"kubernetes.io/projected/c532bcab-a588-49cb-8b64-4a66a3c04558-kube-api-access-fzznv\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wbjr9\" (UID: \"c532bcab-a588-49cb-8b64-4a66a3c04558\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" Jul 02 13:16:02.995653 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.995614 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c532bcab-a588-49cb-8b64-4a66a3c04558-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wbjr9\" (UID: \"c532bcab-a588-49cb-8b64-4a66a3c04558\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" Jul 02 13:16:02.995785 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.995669 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c532bcab-a588-49cb-8b64-4a66a3c04558-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wbjr9\" (UID: \"c532bcab-a588-49cb-8b64-4a66a3c04558\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" Jul 02 13:16:02.996259 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.996235 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c532bcab-a588-49cb-8b64-4a66a3c04558-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wbjr9\" (UID: \"c532bcab-a588-49cb-8b64-4a66a3c04558\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" Jul 02 13:16:02.998799 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:02.998763 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c532bcab-a588-49cb-8b64-4a66a3c04558-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wbjr9\" (UID: \"c532bcab-a588-49cb-8b64-4a66a3c04558\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" Jul 02 13:16:03.004559 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:03.004538 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzznv\" (UniqueName: \"kubernetes.io/projected/c532bcab-a588-49cb-8b64-4a66a3c04558-kube-api-access-fzznv\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wbjr9\" (UID: \"c532bcab-a588-49cb-8b64-4a66a3c04558\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" Jul 02 13:16:03.107656 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:03.107614 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" Jul 02 13:16:03.239527 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:03.239495 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9"] Jul 02 13:16:03.243298 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:16:03.243259 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc532bcab_a588_49cb_8b64_4a66a3c04558.slice/crio-b706a180ee9d500efb8f0093621f938cc5c60409b45316c48f486953b4e5e060 WatchSource:0}: Error finding container b706a180ee9d500efb8f0093621f938cc5c60409b45316c48f486953b4e5e060: Status 404 returned error can't find the container with id b706a180ee9d500efb8f0093621f938cc5c60409b45316c48f486953b4e5e060 Jul 02 13:16:03.777417 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:03.777371 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" event={"ID":"c532bcab-a588-49cb-8b64-4a66a3c04558","Type":"ContainerStarted","Data":"b706a180ee9d500efb8f0093621f938cc5c60409b45316c48f486953b4e5e060"} Jul 02 13:16:03.778941 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:03.778906 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gkvdd" event={"ID":"88b698a4-c42a-4a3d-9707-16d60f7e7b42","Type":"ContainerStarted","Data":"1e0ac804c9a2c9296d5362383a371ce6c7e1c15bd1ce0fa6c8743570b0265e26"} Jul 02 13:16:03.782192 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:03.782158 2561 generic.go:356] "Generic (PLEG): container finished" podID="e0d8869e-bf53-419d-a309-080a540fc557" containerID="fef0f4f2f22848d12eb9dd4a65f88b86d35a6a03e78ec58a3923ae061d3354c3" exitCode=0 Jul 02 13:16:03.782319 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:03.782211 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpn86" event={"ID":"e0d8869e-bf53-419d-a309-080a540fc557","Type":"ContainerDied","Data":"fef0f4f2f22848d12eb9dd4a65f88b86d35a6a03e78ec58a3923ae061d3354c3"} Jul 02 13:16:04.708167 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.708129 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:04.708344 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.708184 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:04.708344 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.708232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:04.708344 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:04.708273 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:16:04.708344 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:04.708342 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm podName:25477ed5-78a5-45ef-9321-cb1c6b4aa814 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:08.708323298 +0000 UTC m=+45.598633340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8bxfs" (UID: "25477ed5-78a5-45ef-9321-cb1c6b4aa814") : configmap "kube-rbac-proxy" not found Jul 02 13:16:04.708574 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:04.708352 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:16:04.708574 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:04.708381 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:16:04.708574 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:04.708387 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls podName:25477ed5-78a5-45ef-9321-cb1c6b4aa814 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:08.708377108 +0000 UTC m=+45.598687148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8bxfs" (UID: "25477ed5-78a5-45ef-9321-cb1c6b4aa814") : secret "insights-runtime-extractor-tls" not found Jul 02 13:16:04.708574 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:04.708461 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls podName:366e6fd3-acec-45ee-95eb-e2378409a2d9 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:08.708442176 +0000 UTC m=+45.598752202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls") pod "dns-default-6b2xw" (UID: "366e6fd3-acec-45ee-95eb-e2378409a2d9") : secret "dns-default-metrics-tls" not found Jul 02 13:16:04.788434 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.788348 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4"] Jul 02 13:16:04.791220 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.791188 2561 generic.go:356] "Generic (PLEG): container finished" podID="e0d8869e-bf53-419d-a309-080a540fc557" containerID="da7ca0f928cf58a32007575e4c6b42a056bd531acee5598b03840dcecc4240d8" exitCode=0 Jul 02 13:16:04.801186 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.800857 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4"] Jul 02 13:16:04.801186 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.800897 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpn86" event={"ID":"e0d8869e-bf53-419d-a309-080a540fc557","Type":"ContainerDied","Data":"da7ca0f928cf58a32007575e4c6b42a056bd531acee5598b03840dcecc4240d8"} Jul 02 13:16:04.801186 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.801000 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" Jul 02 13:16:04.803544 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.803516 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 13:16:04.803868 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.803851 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 13:16:04.804041 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.804023 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:16:04.804231 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.804217 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 13:16:04.804452 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.804434 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hl7cd\"" Jul 02 13:16:04.909548 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.909502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1f931cc8-f55c-47da-b102-32d441db6934-config\") pod \"service-ca-operator-5d7b7dc95c-55mg4\" (UID: \"1f931cc8-f55c-47da-b102-32d441db6934\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" Jul 02 13:16:04.909868 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.909831 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7krd6\" (UniqueName: \"kubernetes.io/projected/1f931cc8-f55c-47da-b102-32d441db6934-kube-api-access-7krd6\") pod \"service-ca-operator-5d7b7dc95c-55mg4\" (UID: \"1f931cc8-f55c-47da-b102-32d441db6934\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" Jul 02 13:16:04.910029 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:04.909882 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f931cc8-f55c-47da-b102-32d441db6934-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-55mg4\" (UID: \"1f931cc8-f55c-47da-b102-32d441db6934\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" Jul 02 13:16:05.010973 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:05.010932 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1f931cc8-f55c-47da-b102-32d441db6934-config\") pod \"service-ca-operator-5d7b7dc95c-55mg4\" (UID: \"1f931cc8-f55c-47da-b102-32d441db6934\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" Jul 02 13:16:05.011145 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:05.011054 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7krd6\" (UniqueName: \"kubernetes.io/projected/1f931cc8-f55c-47da-b102-32d441db6934-kube-api-access-7krd6\") pod \"service-ca-operator-5d7b7dc95c-55mg4\" (UID: \"1f931cc8-f55c-47da-b102-32d441db6934\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" Jul 02 13:16:05.011145 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:05.011086 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f931cc8-f55c-47da-b102-32d441db6934-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-55mg4\" (UID: \"1f931cc8-f55c-47da-b102-32d441db6934\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" Jul 02 13:16:05.011652 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:05.011622 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1f931cc8-f55c-47da-b102-32d441db6934-config\") pod \"service-ca-operator-5d7b7dc95c-55mg4\" (UID: \"1f931cc8-f55c-47da-b102-32d441db6934\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" Jul 02 13:16:05.014992 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:05.014967 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f931cc8-f55c-47da-b102-32d441db6934-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-55mg4\" (UID: \"1f931cc8-f55c-47da-b102-32d441db6934\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" Jul 02 13:16:05.021273 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:05.021212 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7krd6\" (UniqueName: \"kubernetes.io/projected/1f931cc8-f55c-47da-b102-32d441db6934-kube-api-access-7krd6\") pod \"service-ca-operator-5d7b7dc95c-55mg4\" (UID: \"1f931cc8-f55c-47da-b102-32d441db6934\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" Jul 02 13:16:05.113252 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:05.113158 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" Jul 02 13:16:05.269340 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:05.269143 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4"] Jul 02 13:16:05.798160 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:05.798122 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpn86" event={"ID":"e0d8869e-bf53-419d-a309-080a540fc557","Type":"ContainerStarted","Data":"24246c4c3e6559ce6e1d9ad9c385e2e1e1e1259116321d3b93082e583c89690c"} Jul 02 13:16:05.822955 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:05.822892 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hpn86" podStartSLOduration=7.850070489 podStartE2EDuration="41.822873622s" totalImagesPullingTime="33.972803133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:15:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:16:05.820960845 +0000 UTC m=+42.711270894" watchObservedRunningTime="2026-07-02 13:16:05.822873622 +0000 UTC m=+42.713183648" Jul 02 13:16:06.039221 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:16:06.039190 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f931cc8_f55c_47da_b102_32d441db6934.slice/crio-63e9cf17317df4f165ea4b4c5e5aaf0d0179eccd6191c512b7bb0e826bb52480 WatchSource:0}: Error finding container 63e9cf17317df4f165ea4b4c5e5aaf0d0179eccd6191c512b7bb0e826bb52480: Status 404 returned error can't find the container with id 63e9cf17317df4f165ea4b4c5e5aaf0d0179eccd6191c512b7bb0e826bb52480 Jul 02 13:16:06.531280 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.531239 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-42xgd"] Jul 02 13:16:06.551567 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.551535 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-42xgd"] Jul 02 13:16:06.551720 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.551682 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-42xgd" Jul 02 13:16:06.554211 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.554176 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5trsm\"" Jul 02 13:16:06.626347 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.626313 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq96q\" (UniqueName: \"kubernetes.io/projected/a698b1ab-fe33-470f-889a-b40ed4fea58c-kube-api-access-vq96q\") pod \"network-check-source-56499946bc-42xgd\" (UID: \"a698b1ab-fe33-470f-889a-b40ed4fea58c\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-42xgd" Jul 02 13:16:06.727031 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.726987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq96q\" (UniqueName: \"kubernetes.io/projected/a698b1ab-fe33-470f-889a-b40ed4fea58c-kube-api-access-vq96q\") pod \"network-check-source-56499946bc-42xgd\" (UID: \"a698b1ab-fe33-470f-889a-b40ed4fea58c\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-42xgd" Jul 02 13:16:06.736114 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.736082 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq96q\" (UniqueName: \"kubernetes.io/projected/a698b1ab-fe33-470f-889a-b40ed4fea58c-kube-api-access-vq96q\") pod \"network-check-source-56499946bc-42xgd\" (UID: \"a698b1ab-fe33-470f-889a-b40ed4fea58c\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-42xgd" Jul 02 13:16:06.802170 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.802086 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" event={"ID":"1f931cc8-f55c-47da-b102-32d441db6934","Type":"ContainerStarted","Data":"63e9cf17317df4f165ea4b4c5e5aaf0d0179eccd6191c512b7bb0e826bb52480"} Jul 02 13:16:06.860902 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.860867 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-42xgd" Jul 02 13:16:06.956574 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.956541 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fc7d67f67-vdsbj"] Jul 02 13:16:06.969256 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.969030 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:06.971047 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.971026 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fc7d67f67-vdsbj"] Jul 02 13:16:06.972255 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.971936 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 13:16:06.972350 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.972328 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 13:16:06.972721 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.972645 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 13:16:06.973155 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:06.973140 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pfv2v\"" Jul 02 13:16:07.000595 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.000559 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 13:16:07.131006 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.130880 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-trusted-ca\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.131006 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.130934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-ca-trust-extracted\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.131006 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.131006 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-installation-pull-secrets\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.131287 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.131063 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-image-registry-private-configuration\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.131287 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.131103 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvlqc\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-kube-api-access-dvlqc\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.131287 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.131202 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-certificates\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.131287 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.131285 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.131526 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.131301 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-bound-sa-token\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.131989 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.131969 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-42xgd"] Jul 02 13:16:07.134856 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:16:07.134832 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda698b1ab_fe33_470f_889a_b40ed4fea58c.slice/crio-9a2f6a3f55450faf6c239a16b4e18119962553be5546961c08d10344bd871528 WatchSource:0}: Error finding container 9a2f6a3f55450faf6c239a16b4e18119962553be5546961c08d10344bd871528: Status 404 returned error can't find the container with id 9a2f6a3f55450faf6c239a16b4e18119962553be5546961c08d10344bd871528 Jul 02 13:16:07.232230 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.232196 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.232454 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.232236 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-bound-sa-token\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.232454 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.232342 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-trusted-ca\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.232564 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:07.232455 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:16:07.232564 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:07.232479 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fc7d67f67-vdsbj: secret "image-registry-tls" not found Jul 02 13:16:07.232564 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.232489 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-ca-trust-extracted\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.232564 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.232520 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-installation-pull-secrets\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.232564 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:07.232544 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls podName:f3e738ff-bc5a-463d-81c0-6d2ac4a2be22 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:07.732520235 +0000 UTC m=+44.622830279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls") pod "image-registry-5fc7d67f67-vdsbj" (UID: "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22") : secret "image-registry-tls" not found Jul 02 13:16:07.232823 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.232586 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-image-registry-private-configuration\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.232823 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.232612 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvlqc\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-kube-api-access-dvlqc\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.232823 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.232667 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-certificates\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.232991 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.232961 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-ca-trust-extracted\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.233250 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.233227 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-certificates\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.233521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.233497 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-trusted-ca\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.235095 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.235065 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-image-registry-private-configuration\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.235171 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.235126 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-installation-pull-secrets\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.242038 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.242002 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-bound-sa-token\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.242220 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.242197 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvlqc\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-kube-api-access-dvlqc\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.736764 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.736728 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:07.736992 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:07.736929 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:16:07.736992 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:07.736955 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fc7d67f67-vdsbj: secret "image-registry-tls" not found Jul 02 13:16:07.737117 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:07.737028 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls podName:f3e738ff-bc5a-463d-81c0-6d2ac4a2be22 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:08.73700704 +0000 UTC m=+45.627317076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls") pod "image-registry-5fc7d67f67-vdsbj" (UID: "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22") : secret "image-registry-tls" not found Jul 02 13:16:07.808000 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.807956 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" event={"ID":"c532bcab-a588-49cb-8b64-4a66a3c04558","Type":"ContainerStarted","Data":"7358b0e8b1cb29d38bf08adfb72ce134c8d0c0d9d3ec05ddff21a010ec4d1ebc"} Jul 02 13:16:07.810906 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.810871 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gkvdd" event={"ID":"88b698a4-c42a-4a3d-9707-16d60f7e7b42","Type":"ContainerStarted","Data":"9edb76a103a2d8910cf34d150b11044fcc79c08b6e20a9f3092aeae3de2a3af9"} Jul 02 13:16:07.812778 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.812726 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-42xgd" event={"ID":"a698b1ab-fe33-470f-889a-b40ed4fea58c","Type":"ContainerStarted","Data":"9a2f6a3f55450faf6c239a16b4e18119962553be5546961c08d10344bd871528"} Jul 02 13:16:07.825825 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.825748 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" podStartSLOduration=2.064591903 podStartE2EDuration="5.825726284s" totalImagesPullingTime="3.761134381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:16:07.824298133 +0000 UTC m=+44.714608181" watchObservedRunningTime="2026-07-02 13:16:07.825726284 +0000 UTC m=+44.716036313" Jul 02 13:16:07.848656 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:07.848590 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gkvdd" podStartSLOduration=2.709903606 podStartE2EDuration="6.848573595s" totalImagesPullingTime="4.138669989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:16:07.847430465 +0000 UTC m=+44.737740513" watchObservedRunningTime="2026-07-02 13:16:07.848573595 +0000 UTC m=+44.738883643" Jul 02 13:16:08.171851 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.171789 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-zgsx5"] Jul 02 13:16:08.191283 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.191217 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-zgsx5"] Jul 02 13:16:08.191464 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.191300 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-zgsx5" Jul 02 13:16:08.193895 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.193774 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 02 13:16:08.193895 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.193869 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 02 13:16:08.194147 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.194127 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-q5xj6\"" Jul 02 13:16:08.341783 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.341737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2wkw\" (UniqueName: \"kubernetes.io/projected/c13a5450-da76-449b-bf9e-28063a29eeb5-kube-api-access-z2wkw\") pod \"migrator-786f9fbc5-zgsx5\" (UID: \"c13a5450-da76-449b-bf9e-28063a29eeb5\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-zgsx5" Jul 02 13:16:08.442607 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.442512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2wkw\" (UniqueName: \"kubernetes.io/projected/c13a5450-da76-449b-bf9e-28063a29eeb5-kube-api-access-z2wkw\") pod \"migrator-786f9fbc5-zgsx5\" (UID: \"c13a5450-da76-449b-bf9e-28063a29eeb5\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-zgsx5" Jul 02 13:16:08.452403 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.452322 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2wkw\" (UniqueName: \"kubernetes.io/projected/c13a5450-da76-449b-bf9e-28063a29eeb5-kube-api-access-z2wkw\") pod \"migrator-786f9fbc5-zgsx5\" (UID: \"c13a5450-da76-449b-bf9e-28063a29eeb5\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-zgsx5" Jul 02 13:16:08.505773 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.505731 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-zgsx5" Jul 02 13:16:08.680971 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.680933 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-zgsx5"] Jul 02 13:16:08.683824 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:16:08.683776 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc13a5450_da76_449b_bf9e_28063a29eeb5.slice/crio-9de8c951c15a4b43cf0896e7ac68c6ce44625fc00a0d6bfe38f41759c688c23e WatchSource:0}: Error finding container 9de8c951c15a4b43cf0896e7ac68c6ce44625fc00a0d6bfe38f41759c688c23e: Status 404 returned error can't find the container with id 9de8c951c15a4b43cf0896e7ac68c6ce44625fc00a0d6bfe38f41759c688c23e Jul 02 13:16:08.746008 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.745918 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:08.746008 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.745967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:08.746212 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.746010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:08.746212 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:08.746026 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:16:08.746212 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:08.746094 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm podName:25477ed5-78a5-45ef-9321-cb1c6b4aa814 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:16.746073364 +0000 UTC m=+53.636383404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8bxfs" (UID: "25477ed5-78a5-45ef-9321-cb1c6b4aa814") : configmap "kube-rbac-proxy" not found Jul 02 13:16:08.746212 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:08.746128 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:16:08.746212 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:08.746146 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:16:08.746212 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:08.746165 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls podName:366e6fd3-acec-45ee-95eb-e2378409a2d9 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:16.746154232 +0000 UTC m=+53.636464274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls") pod "dns-default-6b2xw" (UID: "366e6fd3-acec-45ee-95eb-e2378409a2d9") : secret "dns-default-metrics-tls" not found Jul 02 13:16:08.746212 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:08.746168 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fc7d67f67-vdsbj: secret "image-registry-tls" not found Jul 02 13:16:08.746212 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:08.746201 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls podName:f3e738ff-bc5a-463d-81c0-6d2ac4a2be22 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:10.746191973 +0000 UTC m=+47.636501999 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls") pod "image-registry-5fc7d67f67-vdsbj" (UID: "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22") : secret "image-registry-tls" not found Jul 02 13:16:08.746617 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.746263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:08.746617 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:08.746358 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:16:08.746617 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:08.746400 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls podName:25477ed5-78a5-45ef-9321-cb1c6b4aa814 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:16.74638758 +0000 UTC m=+53.636697609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8bxfs" (UID: "25477ed5-78a5-45ef-9321-cb1c6b4aa814") : secret "insights-runtime-extractor-tls" not found Jul 02 13:16:08.817770 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:08.817730 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-zgsx5" event={"ID":"c13a5450-da76-449b-bf9e-28063a29eeb5","Type":"ContainerStarted","Data":"9de8c951c15a4b43cf0896e7ac68c6ce44625fc00a0d6bfe38f41759c688c23e"} Jul 02 13:16:10.765755 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:10.765718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:10.766361 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:10.765901 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:16:10.766361 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:10.765917 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fc7d67f67-vdsbj: secret "image-registry-tls" not found Jul 02 13:16:10.766361 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:10.765975 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls podName:f3e738ff-bc5a-463d-81c0-6d2ac4a2be22 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:14.765956364 +0000 UTC m=+51.656266688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls") pod "image-registry-5fc7d67f67-vdsbj" (UID: "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22") : secret "image-registry-tls" not found Jul 02 13:16:11.308385 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.308354 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp"] Jul 02 13:16:11.337455 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.337415 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp"] Jul 02 13:16:11.337608 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.337556 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.340164 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.340134 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 02 13:16:11.340373 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.340321 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 13:16:11.340489 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.340418 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 13:16:11.340791 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.340765 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 13:16:11.341015 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.341000 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 02 13:16:11.341609 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.341581 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 02 13:16:11.341723 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.341616 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 02 13:16:11.473045 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.473009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.473233 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.473059 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-ca\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.473233 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.473125 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-hub\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.473233 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.473181 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.473233 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.473203 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4bzp\" (UniqueName: \"kubernetes.io/projected/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-kube-api-access-r4bzp\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.473413 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.473317 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.574697 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.574609 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.574697 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.574652 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-ca\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.574945 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.574784 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-hub\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.575013 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.574990 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.575071 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.575025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4bzp\" (UniqueName: \"kubernetes.io/projected/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-kube-api-access-r4bzp\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.575218 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.575190 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.575857 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.575833 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.577460 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.577435 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-ca\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.577460 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.577457 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-hub\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.577669 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.577486 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.577669 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.577494 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.585713 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.585688 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4bzp\" (UniqueName: \"kubernetes.io/projected/17ea3bb3-c07a-4dba-baf9-8f3e5b598a45-kube-api-access-r4bzp\") pod \"cluster-proxy-proxy-agent-7786c88c6b-ds2vp\" (UID: \"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:11.657332 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:11.657284 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:16:12.192324 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:12.192287 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp"] Jul 02 13:16:12.196713 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:16:12.196684 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17ea3bb3_c07a_4dba_baf9_8f3e5b598a45.slice/crio-91341749566da2ea4e49ead5ca56d289c83a155d7865fa5be423007a8e37874b WatchSource:0}: Error finding container 91341749566da2ea4e49ead5ca56d289c83a155d7865fa5be423007a8e37874b: Status 404 returned error can't find the container with id 91341749566da2ea4e49ead5ca56d289c83a155d7865fa5be423007a8e37874b Jul 02 13:16:12.831433 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:12.831389 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-42xgd" event={"ID":"a698b1ab-fe33-470f-889a-b40ed4fea58c","Type":"ContainerStarted","Data":"b4bc01ad5512a59f6a8a969dae8358fe94c5eecce19491fbacb1665686347131"} Jul 02 13:16:12.832861 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:12.832831 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" event={"ID":"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45","Type":"ContainerStarted","Data":"91341749566da2ea4e49ead5ca56d289c83a155d7865fa5be423007a8e37874b"} Jul 02 13:16:12.834576 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:12.834544 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" event={"ID":"1f931cc8-f55c-47da-b102-32d441db6934","Type":"ContainerStarted","Data":"eb3cee74626c777a4406575155e657163773329aea52297117bd9772450d0c93"} Jul 02 13:16:12.836653 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:12.836627 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-zgsx5" event={"ID":"c13a5450-da76-449b-bf9e-28063a29eeb5","Type":"ContainerStarted","Data":"f1c520d4c11e1149d09a9461ac66247077aa49cd2d0695ff3d93e86c1e4d6b79"} Jul 02 13:16:12.836780 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:12.836676 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-zgsx5" event={"ID":"c13a5450-da76-449b-bf9e-28063a29eeb5","Type":"ContainerStarted","Data":"dc29c751ea73c1be2aee891c806f24eef6dbdbc8a671718599da83b7bd34451a"} Jul 02 13:16:12.847781 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:12.847722 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-42xgd" podStartSLOduration=1.9310285459999998 podStartE2EDuration="6.847704626s" totalImagesPullingTime="4.91667608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:16:12.84733607 +0000 UTC m=+49.737646121" watchObservedRunningTime="2026-07-02 13:16:12.847704626 +0000 UTC m=+49.738014676" Jul 02 13:16:12.868217 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:12.868152 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" podStartSLOduration=2.855674007 podStartE2EDuration="8.86812945s" totalImagesPullingTime="6.012455443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:16:12.867595856 +0000 UTC m=+49.757905907" watchObservedRunningTime="2026-07-02 13:16:12.86812945 +0000 UTC m=+49.758439495" Jul 02 13:16:12.886475 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:12.886413 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-zgsx5" podStartSLOduration=1.516389861 podStartE2EDuration="4.886395013s" totalImagesPullingTime="3.370005152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:16:12.885546444 +0000 UTC m=+49.775856493" watchObservedRunningTime="2026-07-02 13:16:12.886395013 +0000 UTC m=+49.776705060" Jul 02 13:16:14.806875 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:14.806839 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:14.807298 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:14.806999 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:16:14.807298 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:14.807022 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fc7d67f67-vdsbj: secret "image-registry-tls" not found Jul 02 13:16:14.807298 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:14.807103 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls podName:f3e738ff-bc5a-463d-81c0-6d2ac4a2be22 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:22.807081081 +0000 UTC m=+59.697391112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls") pod "image-registry-5fc7d67f67-vdsbj" (UID: "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22") : secret "image-registry-tls" not found Jul 02 13:16:16.823858 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:16.823800 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:16.824288 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:16.823882 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:16.824288 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:16.823933 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:16.824288 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:16.823943 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:16:16.824288 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:16.824020 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls podName:25477ed5-78a5-45ef-9321-cb1c6b4aa814 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:32.823998534 +0000 UTC m=+69.714308581 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8bxfs" (UID: "25477ed5-78a5-45ef-9321-cb1c6b4aa814") : secret "insights-runtime-extractor-tls" not found Jul 02 13:16:16.824288 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:16.824063 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:16:16.824288 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:16.824122 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls podName:366e6fd3-acec-45ee-95eb-e2378409a2d9 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:32.824106944 +0000 UTC m=+69.714416989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls") pod "dns-default-6b2xw" (UID: "366e6fd3-acec-45ee-95eb-e2378409a2d9") : secret "dns-default-metrics-tls" not found Jul 02 13:16:16.824479 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:16.824450 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25477ed5-78a5-45ef-9321-cb1c6b4aa814-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:16.853482 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:16.853447 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" event={"ID":"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45","Type":"ContainerStarted","Data":"ea6fca97ce3cb2f735ba414cd1404080b4ebcb8fdc2e50cc318b3fbf74463c5d"} Jul 02 13:16:16.853648 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:16.853497 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" event={"ID":"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45","Type":"ContainerStarted","Data":"bd392e279cdf0c0be8fff6be4fc9294163c4b0b7b463cf5164a9eda141617e23"} Jul 02 13:16:17.858226 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:17.858192 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" event={"ID":"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45","Type":"ContainerStarted","Data":"c7768d19eb7be9d3d26e93a278e1ea93483e83b52a9a19591bafb1099a23a446"} Jul 02 13:16:17.879112 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:17.879052 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" podStartSLOduration=2.5352143160000002 podStartE2EDuration="6.879028896s" totalImagesPullingTime="4.34381458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:16:17.87703878 +0000 UTC m=+54.767348830" watchObservedRunningTime="2026-07-02 13:16:17.879028896 +0000 UTC m=+54.769338945" Jul 02 13:16:22.873628 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:22.873596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:22.874127 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:22.873703 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:16:22.874127 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:22.873713 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fc7d67f67-vdsbj: secret "image-registry-tls" not found Jul 02 13:16:22.874127 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:22.873759 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls podName:f3e738ff-bc5a-463d-81c0-6d2ac4a2be22 nodeName:}" failed. No retries permitted until 2026-07-02 13:16:38.87374478 +0000 UTC m=+75.764054819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls") pod "image-registry-5fc7d67f67-vdsbj" (UID: "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22") : secret "image-registry-tls" not found Jul 02 13:16:26.772755 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:26.772716 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p5pk" Jul 02 13:16:29.329208 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.329163 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:16:29.331758 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.331738 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 13:16:29.341929 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.341905 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a1ec351-fa5c-4063-805b-df1e9c6cc243-original-pull-secret\") pod \"global-pull-secret-syncer-n4dh5\" (UID: \"8a1ec351-fa5c-4063-805b-df1e9c6cc243\") " pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:16:29.430457 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.430422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs\") pod \"network-metrics-daemon-dqx8f\" (UID: \"2f1aa242-11f4-4207-86f5-739e590470b1\") " pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:16:29.436366 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.433369 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 13:16:29.443695 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.443663 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f1aa242-11f4-4207-86f5-739e590470b1-metrics-certs\") pod \"network-metrics-daemon-dqx8f\" (UID: \"2f1aa242-11f4-4207-86f5-739e590470b1\") " pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:16:29.531696 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.531650 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hq9c\" (UniqueName: \"kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c\") pod \"network-check-target-pnkz8\" (UID: \"d10166f9-2429-430f-9afa-92cda8651df9\") " pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:16:29.534284 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.534255 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hq9c\" (UniqueName: \"kubernetes.io/projected/d10166f9-2429-430f-9afa-92cda8651df9-kube-api-access-9hq9c\") pod \"network-check-target-pnkz8\" (UID: \"d10166f9-2429-430f-9afa-92cda8651df9\") " pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:16:29.565987 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.565950 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qblmr\"" Jul 02 13:16:29.573123 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.573097 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ncrqc\"" Jul 02 13:16:29.574147 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.574133 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqx8f" Jul 02 13:16:29.577133 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.577113 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4dh5" Jul 02 13:16:29.581347 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.581323 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:16:29.730309 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.729216 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pnkz8"] Jul 02 13:16:29.732402 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:16:29.732373 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd10166f9_2429_430f_9afa_92cda8651df9.slice/crio-147cc1a40895c026e565788883d66a733fec5dc18964874b90d398165daab49e WatchSource:0}: Error finding container 147cc1a40895c026e565788883d66a733fec5dc18964874b90d398165daab49e: Status 404 returned error can't find the container with id 147cc1a40895c026e565788883d66a733fec5dc18964874b90d398165daab49e Jul 02 13:16:29.742536 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.742516 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4dh5"] Jul 02 13:16:29.744936 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:16:29.744913 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1ec351_fa5c_4063_805b_df1e9c6cc243.slice/crio-a9da95f3ae3f4ccfb0525fc8d9620f73a69da3da60884783d9c3edfb447be4f2 WatchSource:0}: Error finding container a9da95f3ae3f4ccfb0525fc8d9620f73a69da3da60884783d9c3edfb447be4f2: Status 404 returned error can't find the container with id a9da95f3ae3f4ccfb0525fc8d9620f73a69da3da60884783d9c3edfb447be4f2 Jul 02 13:16:29.762474 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.762313 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dqx8f"] Jul 02 13:16:29.764934 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:16:29.764909 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1aa242_11f4_4207_86f5_739e590470b1.slice/crio-b2e7494561939bf4c5fa2d79f15491bdf5146fab7604fcb547b5c30a7d3d40a9 WatchSource:0}: Error finding container b2e7494561939bf4c5fa2d79f15491bdf5146fab7604fcb547b5c30a7d3d40a9: Status 404 returned error can't find the container with id b2e7494561939bf4c5fa2d79f15491bdf5146fab7604fcb547b5c30a7d3d40a9 Jul 02 13:16:29.897201 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.897166 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pnkz8" event={"ID":"d10166f9-2429-430f-9afa-92cda8651df9","Type":"ContainerStarted","Data":"7754fc3f302603f7836a397d19ea375ca4f33e03765871c97e5206cf4a5aa1a6"} Jul 02 13:16:29.897381 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.897230 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pnkz8" event={"ID":"d10166f9-2429-430f-9afa-92cda8651df9","Type":"ContainerStarted","Data":"147cc1a40895c026e565788883d66a733fec5dc18964874b90d398165daab49e"} Jul 02 13:16:29.897381 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.897252 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:16:29.898392 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.898358 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4dh5" event={"ID":"8a1ec351-fa5c-4063-805b-df1e9c6cc243","Type":"ContainerStarted","Data":"a9da95f3ae3f4ccfb0525fc8d9620f73a69da3da60884783d9c3edfb447be4f2"} Jul 02 13:16:29.899414 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.899389 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dqx8f" event={"ID":"2f1aa242-11f4-4207-86f5-739e590470b1","Type":"ContainerStarted","Data":"b2e7494561939bf4c5fa2d79f15491bdf5146fab7604fcb547b5c30a7d3d40a9"} Jul 02 13:16:29.914399 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:29.914340 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pnkz8" podStartSLOduration=65.91432079 podStartE2EDuration="1m5.91432079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:16:29.912461334 +0000 UTC m=+66.802771385" watchObservedRunningTime="2026-07-02 13:16:29.91432079 +0000 UTC m=+66.804630817" Jul 02 13:16:31.908335 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:31.908290 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dqx8f" event={"ID":"2f1aa242-11f4-4207-86f5-739e590470b1","Type":"ContainerStarted","Data":"77dcb7c99f4f54511fb57857d371d966d4ead0724ea7480429c15e608cfa4cb4"} Jul 02 13:16:31.908850 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:31.908359 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dqx8f" event={"ID":"2f1aa242-11f4-4207-86f5-739e590470b1","Type":"ContainerStarted","Data":"401953ed46a0f1d056abc38274632d48d7d930c6318c2b5bb8e773004530bddc"} Jul 02 13:16:31.926986 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:31.926933 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dqx8f" podStartSLOduration=66.660734242 podStartE2EDuration="1m7.926915027s" totalImagesPullingTime="1.266180785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:16:31.926545736 +0000 UTC m=+68.816855805" watchObservedRunningTime="2026-07-02 13:16:31.926915027 +0000 UTC m=+68.817225075" Jul 02 13:16:32.860602 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:32.860555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:32.860789 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:32.860635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:32.863105 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:32.863075 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/366e6fd3-acec-45ee-95eb-e2378409a2d9-metrics-tls\") pod \"dns-default-6b2xw\" (UID: \"366e6fd3-acec-45ee-95eb-e2378409a2d9\") " pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:32.863220 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:32.863193 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25477ed5-78a5-45ef-9321-cb1c6b4aa814-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bxfs\" (UID: \"25477ed5-78a5-45ef-9321-cb1c6b4aa814\") " pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:33.082059 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:33.082032 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6bdfl\"" Jul 02 13:16:33.089569 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:33.089539 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mrpc5\"" Jul 02 13:16:33.089747 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:33.089668 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8bxfs" Jul 02 13:16:33.097079 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:33.097043 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:33.262765 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:33.262730 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8bxfs"] Jul 02 13:16:33.265657 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:16:33.265628 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25477ed5_78a5_45ef_9321_cb1c6b4aa814.slice/crio-b4246e56e389c3fc04252aa4b7c1ee55098e8be4f2363e5c04449a5ffa0fe483 WatchSource:0}: Error finding container b4246e56e389c3fc04252aa4b7c1ee55098e8be4f2363e5c04449a5ffa0fe483: Status 404 returned error can't find the container with id b4246e56e389c3fc04252aa4b7c1ee55098e8be4f2363e5c04449a5ffa0fe483 Jul 02 13:16:33.289010 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:33.288976 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6b2xw"] Jul 02 13:16:33.291832 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:16:33.291788 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod366e6fd3_acec_45ee_95eb_e2378409a2d9.slice/crio-56d861b721258a2c30a7c4a475b10ea23b6d6009dc9bc76494e91ac5f157e4ee WatchSource:0}: Error finding container 56d861b721258a2c30a7c4a475b10ea23b6d6009dc9bc76494e91ac5f157e4ee: Status 404 returned error can't find the container with id 56d861b721258a2c30a7c4a475b10ea23b6d6009dc9bc76494e91ac5f157e4ee Jul 02 13:16:33.916414 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:33.916366 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8bxfs" event={"ID":"25477ed5-78a5-45ef-9321-cb1c6b4aa814","Type":"ContainerStarted","Data":"b4246e56e389c3fc04252aa4b7c1ee55098e8be4f2363e5c04449a5ffa0fe483"} Jul 02 13:16:33.917670 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:33.917637 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6b2xw" event={"ID":"366e6fd3-acec-45ee-95eb-e2378409a2d9","Type":"ContainerStarted","Data":"56d861b721258a2c30a7c4a475b10ea23b6d6009dc9bc76494e91ac5f157e4ee"} Jul 02 13:16:35.935570 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:35.935241 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4dh5" event={"ID":"8a1ec351-fa5c-4063-805b-df1e9c6cc243","Type":"ContainerStarted","Data":"6b420cc93aa13fe1254c5ad4c0a38e3dd99b1aa0b2e3a5f6a31b31c32df6f051"} Jul 02 13:16:35.951696 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:35.951561 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n4dh5" podStartSLOduration=66.907290187 podStartE2EDuration="1m11.951537904s" totalImagesPullingTime="5.044247717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:16:35.95049797 +0000 UTC m=+72.840808037" watchObservedRunningTime="2026-07-02 13:16:35.951537904 +0000 UTC m=+72.841847955" Jul 02 13:16:38.627271 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:38.627242 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fc7d67f67-vdsbj"] Jul 02 13:16:38.627668 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:16:38.627493 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" podUID="f3e738ff-bc5a-463d-81c0-6d2ac4a2be22" Jul 02 13:16:38.916525 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:38.916494 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:38.918985 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:38.918953 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls\") pod \"image-registry-5fc7d67f67-vdsbj\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:38.947193 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:38.947158 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8bxfs" event={"ID":"25477ed5-78a5-45ef-9321-cb1c6b4aa814","Type":"ContainerStarted","Data":"18d429fb180c592661d00b8ae5ff0303fb3ef955a01f962ccd7263e80adf6567"} Jul 02 13:16:38.948642 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:38.948613 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:38.948774 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:38.948662 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6b2xw" event={"ID":"366e6fd3-acec-45ee-95eb-e2378409a2d9","Type":"ContainerStarted","Data":"05a17d8695b8b7f8a4f3609578a9f56b8b010976a44438f6dc8e9d5a36021920"} Jul 02 13:16:38.948774 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:38.948712 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6b2xw" event={"ID":"366e6fd3-acec-45ee-95eb-e2378409a2d9","Type":"ContainerStarted","Data":"09cde183c9bbadd6bf3b92b70d89312cb0234092a584feab2fdc3327f2f576f2"} Jul 02 13:16:38.954244 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:38.954223 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:38.967344 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:38.967290 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6b2xw" podStartSLOduration=33.831791846 podStartE2EDuration="38.967272809s" totalImagesPullingTime="5.135480963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:16:38.966179064 +0000 UTC m=+75.856489127" watchObservedRunningTime="2026-07-02 13:16:38.967272809 +0000 UTC m=+75.857582834" Jul 02 13:16:39.017208 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.017175 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-bound-sa-token\") pod \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " Jul 02 13:16:39.017413 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.017233 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-installation-pull-secrets\") pod \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " Jul 02 13:16:39.017413 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.017253 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-certificates\") pod \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " Jul 02 13:16:39.017413 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.017283 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-image-registry-private-configuration\") pod \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " Jul 02 13:16:39.017413 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.017305 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-ca-trust-extracted\") pod \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " Jul 02 13:16:39.017413 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.017322 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-trusted-ca\") pod \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " Jul 02 13:16:39.017413 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.017339 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvlqc\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-kube-api-access-dvlqc\") pod \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " Jul 02 13:16:39.017413 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.017354 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls\") pod \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\" (UID: \"f3e738ff-bc5a-463d-81c0-6d2ac4a2be22\") " Jul 02 13:16:39.017770 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.017618 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22" (UID: "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:16:39.017770 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.017675 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22" (UID: "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:16:39.017910 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.017834 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22" (UID: "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:16:39.019896 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.019785 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22" (UID: "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:16:39.020047 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.019944 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22" (UID: "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:16:39.020047 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.020018 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22" (UID: "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:16:39.020160 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.020088 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22" (UID: "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:16:39.020214 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.020170 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-kube-api-access-dvlqc" (OuterVolumeSpecName: "kube-api-access-dvlqc") pod "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22" (UID: "f3e738ff-bc5a-463d-81c0-6d2ac4a2be22"). InnerVolumeSpecName "kube-api-access-dvlqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:16:39.118688 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.118646 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-bound-sa-token\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:16:39.118688 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.118680 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-installation-pull-secrets\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:16:39.118688 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.118697 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-certificates\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:16:39.118975 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.118710 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-image-registry-private-configuration\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:16:39.118975 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.118719 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-ca-trust-extracted\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:16:39.118975 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.118727 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-trusted-ca\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:16:39.118975 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.118735 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvlqc\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-kube-api-access-dvlqc\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:16:39.118975 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.118743 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22-registry-tls\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:16:39.951923 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.951888 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fc7d67f67-vdsbj" Jul 02 13:16:39.952402 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.952265 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6b2xw" Jul 02 13:16:39.994568 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:39.994535 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fc7d67f67-vdsbj"] Jul 02 13:16:40.006279 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:40.006249 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5fc7d67f67-vdsbj"] Jul 02 13:16:40.957144 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:40.957108 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8bxfs" event={"ID":"25477ed5-78a5-45ef-9321-cb1c6b4aa814","Type":"ContainerStarted","Data":"f6a4151f102c5dbc4b817baceca30b2a8771131d2e377bc620276a4e0255bf32"} Jul 02 13:16:41.556638 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:41.556605 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3e738ff-bc5a-463d-81c0-6d2ac4a2be22" path="/var/lib/kubelet/pods/f3e738ff-bc5a-463d-81c0-6d2ac4a2be22/volumes" Jul 02 13:16:44.972407 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:44.972370 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8bxfs" event={"ID":"25477ed5-78a5-45ef-9321-cb1c6b4aa814","Type":"ContainerStarted","Data":"6810774f66c6d7dbd07b55a27f8a3148725624a30c39b138226a36a405784aea"} Jul 02 13:16:44.990747 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:44.990689 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8bxfs" podStartSLOduration=34.454528395 podStartE2EDuration="44.990671624s" totalImagesPullingTime="10.536143229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:16:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:16:44.989551441 +0000 UTC m=+81.879861519" watchObservedRunningTime="2026-07-02 13:16:44.990671624 +0000 UTC m=+81.880981672" Jul 02 13:16:49.960193 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:16:49.960162 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6b2xw" Jul 02 13:17:00.905509 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:00.905476 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pnkz8" Jul 02 13:17:18.255916 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.255880 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rqxx4"] Jul 02 13:17:18.264055 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.264026 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.266881 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.266850 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 13:17:18.267030 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.266885 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rpwj4\"" Jul 02 13:17:18.267183 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.267168 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 13:17:18.267766 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.267744 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 13:17:18.267844 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.267769 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 13:17:18.268075 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.268053 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 13:17:18.268182 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.268098 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 13:17:18.401842 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.401794 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.402036 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.401851 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk7r6\" (UniqueName: \"kubernetes.io/projected/1d73c669-420a-470c-a82d-1bbc68ce32d4-kube-api-access-gk7r6\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.402036 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.401880 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-textfile\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.402036 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.401897 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d73c669-420a-470c-a82d-1bbc68ce32d4-root\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.402036 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.401916 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-wtmp\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.402036 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.401938 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d73c669-420a-470c-a82d-1bbc68ce32d4-metrics-client-ca\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.402036 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.402020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d73c669-420a-470c-a82d-1bbc68ce32d4-sys\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.402277 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.402065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-tls\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.402277 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.402107 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.502878 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.502833 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.503083 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.502891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.503083 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.502921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk7r6\" (UniqueName: \"kubernetes.io/projected/1d73c669-420a-470c-a82d-1bbc68ce32d4-kube-api-access-gk7r6\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.503083 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.502949 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-textfile\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.503083 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.502970 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d73c669-420a-470c-a82d-1bbc68ce32d4-root\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.503083 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.502985 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-wtmp\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.503083 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.503001 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d73c669-420a-470c-a82d-1bbc68ce32d4-metrics-client-ca\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.503083 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.503025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d73c669-420a-470c-a82d-1bbc68ce32d4-sys\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.503083 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.503061 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-tls\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.503434 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.503074 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d73c669-420a-470c-a82d-1bbc68ce32d4-root\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.503434 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.503132 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d73c669-420a-470c-a82d-1bbc68ce32d4-sys\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.503434 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.503183 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-wtmp\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.503434 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.503367 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-textfile\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.503567 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.503535 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.503666 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.503648 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d73c669-420a-470c-a82d-1bbc68ce32d4-metrics-client-ca\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.505498 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.505474 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-tls\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.505724 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.505707 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d73c669-420a-470c-a82d-1bbc68ce32d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.516052 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.515989 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk7r6\" (UniqueName: \"kubernetes.io/projected/1d73c669-420a-470c-a82d-1bbc68ce32d4-kube-api-access-gk7r6\") pod \"node-exporter-rqxx4\" (UID: \"1d73c669-420a-470c-a82d-1bbc68ce32d4\") " pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.573589 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:18.573550 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rqxx4" Jul 02 13:17:18.583435 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:17:18.583397 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d73c669_420a_470c_a82d_1bbc68ce32d4.slice/crio-e9534bab3ea2464887f637f630aa7b1291fa73b43d73578b61fd1124a7a0875f WatchSource:0}: Error finding container e9534bab3ea2464887f637f630aa7b1291fa73b43d73578b61fd1124a7a0875f: Status 404 returned error can't find the container with id e9534bab3ea2464887f637f630aa7b1291fa73b43d73578b61fd1124a7a0875f Jul 02 13:17:19.086583 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.086548 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rqxx4" event={"ID":"1d73c669-420a-470c-a82d-1bbc68ce32d4","Type":"ContainerStarted","Data":"e9534bab3ea2464887f637f630aa7b1291fa73b43d73578b61fd1124a7a0875f"} Jul 02 13:17:19.337225 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.337134 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:17:19.340134 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.340106 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.343067 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.342862 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kmrrr\"" Jul 02 13:17:19.343067 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.342874 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 13:17:19.343067 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.342910 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 13:17:19.343067 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.342944 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 13:17:19.343350 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.343295 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 13:17:19.343350 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.343304 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 13:17:19.343350 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.343317 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 13:17:19.343459 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.343368 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 13:17:19.343459 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.343299 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 13:17:19.343540 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.343502 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 13:17:19.356391 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.356361 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:17:19.510251 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.510205 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8751fc8f-a196-468e-939e-d06248554ecb-config-out\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.510404 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.510276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.510404 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.510309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8751fc8f-a196-468e-939e-d06248554ecb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.510404 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.510334 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-web-config\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.510404 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.510359 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8751fc8f-a196-468e-939e-d06248554ecb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.510404 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.510388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.510631 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.510460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.510631 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.510496 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8751fc8f-a196-468e-939e-d06248554ecb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.510631 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.510527 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8751fc8f-a196-468e-939e-d06248554ecb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.510755 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.510634 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.510755 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.510702 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsn6d\" (UniqueName: \"kubernetes.io/projected/8751fc8f-a196-468e-939e-d06248554ecb-kube-api-access-wsn6d\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.510755 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.510747 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-config-volume\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.510884 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.510783 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.611745 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.611659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.611745 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.611701 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8751fc8f-a196-468e-939e-d06248554ecb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.611745 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.611719 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-web-config\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.611999 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.611956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8751fc8f-a196-468e-939e-d06248554ecb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.611999 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.611994 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.612106 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.612043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.612106 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.612070 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8751fc8f-a196-468e-939e-d06248554ecb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.612106 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.612097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8751fc8f-a196-468e-939e-d06248554ecb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.612263 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:17:19.612150 2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 02 13:17:19.612263 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:17:19.612250 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-main-tls podName:8751fc8f-a196-468e-939e-d06248554ecb nodeName:}" failed. No retries permitted until 2026-07-02 13:17:20.112225655 +0000 UTC m=+117.002535701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8751fc8f-a196-468e-939e-d06248554ecb") : secret "alertmanager-main-tls" not found Jul 02 13:17:19.612534 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.612158 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.612619 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.612563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsn6d\" (UniqueName: \"kubernetes.io/projected/8751fc8f-a196-468e-939e-d06248554ecb-kube-api-access-wsn6d\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.612619 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.612607 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-config-volume\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.612717 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.612637 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.612717 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.612676 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8751fc8f-a196-468e-939e-d06248554ecb-config-out\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.612717 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.612688 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8751fc8f-a196-468e-939e-d06248554ecb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.613631 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.613585 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8751fc8f-a196-468e-939e-d06248554ecb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.613833 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.613776 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8751fc8f-a196-468e-939e-d06248554ecb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.615016 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.614961 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.616006 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.615520 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.616006 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.615963 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.616177 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.616160 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8751fc8f-a196-468e-939e-d06248554ecb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.616755 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.616700 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8751fc8f-a196-468e-939e-d06248554ecb-config-out\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.616884 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.616853 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-config-volume\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.617051 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.617033 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-web-config\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.618246 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.618220 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:19.625037 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:19.625005 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsn6d\" (UniqueName: \"kubernetes.io/projected/8751fc8f-a196-468e-939e-d06248554ecb-kube-api-access-wsn6d\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:20.091594 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.091557 2561 generic.go:356] "Generic (PLEG): container finished" podID="1d73c669-420a-470c-a82d-1bbc68ce32d4" containerID="61081f9df20837298ed32e715f061e82fd5b3a4743efb5d776b6d3e294b954ae" exitCode=0 Jul 02 13:17:20.091794 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.091646 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rqxx4" event={"ID":"1d73c669-420a-470c-a82d-1bbc68ce32d4","Type":"ContainerDied","Data":"61081f9df20837298ed32e715f061e82fd5b3a4743efb5d776b6d3e294b954ae"} Jul 02 13:17:20.117973 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.117927 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:20.120326 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.120298 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:20.232467 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.232433 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f8d69bd8-868h7"] Jul 02 13:17:20.235066 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.235045 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.237606 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.237519 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 02 13:17:20.237769 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.237676 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 02 13:17:20.237769 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.237695 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 02 13:17:20.237769 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.237765 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 02 13:17:20.238049 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.238033 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 02 13:17:20.238049 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.238044 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ff9xw\"" Jul 02 13:17:20.238170 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.238108 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eivt249bmco1e\"" Jul 02 13:17:20.248118 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.248087 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f8d69bd8-868h7"] Jul 02 13:17:20.251390 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.251361 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:17:20.392643 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.392608 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:17:20.395743 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:17:20.395715 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8751fc8f_a196_468e_939e_d06248554ecb.slice/crio-5c9653448470400790d79520d95187355cb214151e6482cb560ffaa4469495e0 WatchSource:0}: Error finding container 5c9653448470400790d79520d95187355cb214151e6482cb560ffaa4469495e0: Status 404 returned error can't find the container with id 5c9653448470400790d79520d95187355cb214151e6482cb560ffaa4469495e0 Jul 02 13:17:20.419950 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.419916 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.419950 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.419953 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-grpc-tls\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.420165 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.419982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.420165 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.420042 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.420165 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.420088 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.420165 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.420124 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gvc5\" (UniqueName: \"kubernetes.io/projected/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-kube-api-access-9gvc5\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.420278 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.420180 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-tls\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.420278 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.420227 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-metrics-client-ca\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.521342 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.521298 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.521535 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.521351 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gvc5\" (UniqueName: \"kubernetes.io/projected/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-kube-api-access-9gvc5\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.521535 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.521394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-tls\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.521535 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.521428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-metrics-client-ca\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.521535 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.521467 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.521535 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.521493 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-grpc-tls\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.521535 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.521531 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.521839 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.521558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.522332 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.522278 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-metrics-client-ca\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.524156 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.524125 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.524256 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.524174 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-tls\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.524442 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.524421 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-grpc-tls\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.524487 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.524424 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.524570 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.524552 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.524608 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.524559 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.530590 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.530564 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gvc5\" (UniqueName: \"kubernetes.io/projected/384cabb5-ca2c-4758-bdcd-2ea7ed382bfa-kube-api-access-9gvc5\") pod \"thanos-querier-f8d69bd8-868h7\" (UID: \"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa\") " pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.545547 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.545511 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:20.570522 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.570494 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gkvdd_88b698a4-c42a-4a3d-9707-16d60f7e7b42/serve-healthcheck-canary/0.log" Jul 02 13:17:20.680091 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:20.680066 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f8d69bd8-868h7"] Jul 02 13:17:20.682449 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:17:20.682419 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384cabb5_ca2c_4758_bdcd_2ea7ed382bfa.slice/crio-b03c85697f869f241627773a2e59c03b6eb822612cfd78b066e091b4add71b70 WatchSource:0}: Error finding container b03c85697f869f241627773a2e59c03b6eb822612cfd78b066e091b4add71b70: Status 404 returned error can't find the container with id b03c85697f869f241627773a2e59c03b6eb822612cfd78b066e091b4add71b70 Jul 02 13:17:21.098079 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:21.097976 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rqxx4" event={"ID":"1d73c669-420a-470c-a82d-1bbc68ce32d4","Type":"ContainerStarted","Data":"76b4d236645b7cf8e91ed2c2ab60873f971c3719b67790e2b112386627cd8847"} Jul 02 13:17:21.098079 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:21.098051 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rqxx4" event={"ID":"1d73c669-420a-470c-a82d-1bbc68ce32d4","Type":"ContainerStarted","Data":"6f18dd2b261eaa7ee013cd4dec93743a3291d40ec6e8d661bb83e20f7d869574"} Jul 02 13:17:21.099226 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:21.099198 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" event={"ID":"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa","Type":"ContainerStarted","Data":"b03c85697f869f241627773a2e59c03b6eb822612cfd78b066e091b4add71b70"} Jul 02 13:17:21.100388 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:21.100365 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerStarted","Data":"5c9653448470400790d79520d95187355cb214151e6482cb560ffaa4469495e0"} Jul 02 13:17:21.116758 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:21.116704 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rqxx4" podStartSLOduration=2.143599637 podStartE2EDuration="3.116687066s" totalImagesPullingTime="903.781351ms" totalInitContainerRuntime="69.306078ms" isStatefulPod=true podCreationTimestamp="2026-07-02 13:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:17:21.116366638 +0000 UTC m=+118.006676686" watchObservedRunningTime="2026-07-02 13:17:21.116687066 +0000 UTC m=+118.006997114" Jul 02 13:17:23.032461 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.032423 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-22627"] Jul 02 13:17:23.034630 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.034612 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-22627" Jul 02 13:17:23.037282 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.037251 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 13:17:23.037408 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.037259 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zzxgv\"" Jul 02 13:17:23.043338 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.043314 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e43dc355-ca81-4e48-99ad-a6fd1d8d291c-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-22627\" (UID: \"e43dc355-ca81-4e48-99ad-a6fd1d8d291c\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-22627" Jul 02 13:17:23.043448 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.043354 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvlql\" (UniqueName: \"kubernetes.io/projected/e43dc355-ca81-4e48-99ad-a6fd1d8d291c-kube-api-access-fvlql\") pod \"monitoring-plugin-cd8656b8-22627\" (UID: \"e43dc355-ca81-4e48-99ad-a6fd1d8d291c\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-22627" Jul 02 13:17:23.044454 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.044430 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-22627"] Jul 02 13:17:23.110781 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.110749 2561 generic.go:356] "Generic (PLEG): container finished" podID="8751fc8f-a196-468e-939e-d06248554ecb" containerID="742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702" exitCode=0 Jul 02 13:17:23.111069 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.110843 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerDied","Data":"742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702"} Jul 02 13:17:23.112884 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.112861 2561 generic.go:356] "Generic (PLEG): container finished" podID="c532bcab-a588-49cb-8b64-4a66a3c04558" containerID="7358b0e8b1cb29d38bf08adfb72ce134c8d0c0d9d3ec05ddff21a010ec4d1ebc" exitCode=0 Jul 02 13:17:23.112981 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.112918 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" event={"ID":"c532bcab-a588-49cb-8b64-4a66a3c04558","Type":"ContainerDied","Data":"7358b0e8b1cb29d38bf08adfb72ce134c8d0c0d9d3ec05ddff21a010ec4d1ebc"} Jul 02 13:17:23.113345 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.113329 2561 scope.go:117] "RemoveContainer" containerID="7358b0e8b1cb29d38bf08adfb72ce134c8d0c0d9d3ec05ddff21a010ec4d1ebc" Jul 02 13:17:23.144415 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.144382 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e43dc355-ca81-4e48-99ad-a6fd1d8d291c-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-22627\" (UID: \"e43dc355-ca81-4e48-99ad-a6fd1d8d291c\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-22627" Jul 02 13:17:23.144575 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.144452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvlql\" (UniqueName: \"kubernetes.io/projected/e43dc355-ca81-4e48-99ad-a6fd1d8d291c-kube-api-access-fvlql\") pod \"monitoring-plugin-cd8656b8-22627\" (UID: \"e43dc355-ca81-4e48-99ad-a6fd1d8d291c\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-22627" Jul 02 13:17:23.147018 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.146990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e43dc355-ca81-4e48-99ad-a6fd1d8d291c-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-22627\" (UID: \"e43dc355-ca81-4e48-99ad-a6fd1d8d291c\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-22627" Jul 02 13:17:23.157098 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.157071 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvlql\" (UniqueName: \"kubernetes.io/projected/e43dc355-ca81-4e48-99ad-a6fd1d8d291c-kube-api-access-fvlql\") pod \"monitoring-plugin-cd8656b8-22627\" (UID: \"e43dc355-ca81-4e48-99ad-a6fd1d8d291c\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-22627" Jul 02 13:17:23.344153 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.344053 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-22627" Jul 02 13:17:23.484999 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:23.484974 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-22627"] Jul 02 13:17:23.487006 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:17:23.486982 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43dc355_ca81_4e48_99ad_a6fd1d8d291c.slice/crio-182ec57976663296d379fe2f4df3bba6ce45f5b604ca7e2004cb673ef467434b WatchSource:0}: Error finding container 182ec57976663296d379fe2f4df3bba6ce45f5b604ca7e2004cb673ef467434b: Status 404 returned error can't find the container with id 182ec57976663296d379fe2f4df3bba6ce45f5b604ca7e2004cb673ef467434b Jul 02 13:17:24.118993 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.118937 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wbjr9" event={"ID":"c532bcab-a588-49cb-8b64-4a66a3c04558","Type":"ContainerStarted","Data":"0488ae2ea3a8c8ccfe0f6c3f85247ddc6aa112bc8f217b93407a72035d909581"} Jul 02 13:17:24.120409 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.120385 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-22627" event={"ID":"e43dc355-ca81-4e48-99ad-a6fd1d8d291c","Type":"ContainerStarted","Data":"182ec57976663296d379fe2f4df3bba6ce45f5b604ca7e2004cb673ef467434b"} Jul 02 13:17:24.474989 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.473665 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:17:24.477409 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.477378 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.480472 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.480242 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-72v54pofe10u3\"" Jul 02 13:17:24.480472 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.480247 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 13:17:24.480472 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.480307 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jgf5q\"" Jul 02 13:17:24.480472 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.480362 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 13:17:24.480800 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.480605 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 13:17:24.480800 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.480658 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 13:17:24.480800 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.480726 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 13:17:24.480800 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.480777 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 13:17:24.481553 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.481395 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 13:17:24.482413 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.482389 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 13:17:24.483027 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.482763 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 13:17:24.483027 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.482881 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 13:17:24.483196 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.483094 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 13:17:24.483447 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.483425 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 13:17:24.483785 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.483768 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 13:17:24.485130 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.485111 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 13:17:24.488525 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.488500 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 13:17:24.493627 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.493561 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:17:24.556896 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.556690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.556896 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.556764 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.556896 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.556823 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-config\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.556896 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.556850 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.556896 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.556887 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557286 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.556996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557286 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.557060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557286 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.557101 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557286 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.557131 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557286 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.557165 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557286 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.557199 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557286 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.557235 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557621 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.557292 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e405ac5-bddc-406b-b9df-6368fb182860-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557621 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.557330 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557621 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.557362 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557621 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.557382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557621 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.557461 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e405ac5-bddc-406b-b9df-6368fb182860-config-out\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557621 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.557492 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-web-config\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557621 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.557548 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bvs8\" (UniqueName: \"kubernetes.io/projected/9e405ac5-bddc-406b-b9df-6368fb182860-kube-api-access-9bvs8\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.557621 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.557575 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.658775 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.658747 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.658775 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.658779 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.658994 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.658796 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.658994 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.658828 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.658994 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.658847 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.658994 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.658981 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659180 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659180 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659039 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e405ac5-bddc-406b-b9df-6368fb182860-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659180 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659180 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659096 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659180 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659136 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659442 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659192 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e405ac5-bddc-406b-b9df-6368fb182860-config-out\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659442 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-web-config\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659442 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bvs8\" (UniqueName: \"kubernetes.io/projected/9e405ac5-bddc-406b-b9df-6368fb182860-kube-api-access-9bvs8\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659442 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659281 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659442 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659312 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659442 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659356 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659442 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-config\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659442 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659846 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659445 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.659846 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.659636 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.660263 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.660239 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.660915 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.660785 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.661755 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.661425 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.661755 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.661633 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.662516 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.662181 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.662516 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.662369 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e405ac5-bddc-406b-b9df-6368fb182860-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.662672 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.662540 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.663247 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.663147 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-web-config\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.663835 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.663707 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.664034 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.663992 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.664159 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.664121 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-config\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.665435 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.665413 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.666140 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.666041 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e405ac5-bddc-406b-b9df-6368fb182860-config-out\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.666140 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.666131 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.666371 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.666350 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.666435 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.666390 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.667251 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.667175 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.667580 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.667559 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.668556 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.668534 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bvs8\" (UniqueName: \"kubernetes.io/projected/9e405ac5-bddc-406b-b9df-6368fb182860-kube-api-access-9bvs8\") pod \"prometheus-k8s-0\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:24.790988 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:24.790889 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:25.132553 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:25.132452 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" event={"ID":"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa","Type":"ContainerStarted","Data":"2f0f6706e685fa01acc65e66cdcd1e1f53e6ea516e6ad9a8d1228145be4b3ae1"} Jul 02 13:17:25.132983 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:25.132577 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" event={"ID":"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa","Type":"ContainerStarted","Data":"d4ca6e981e12c99af8f436deacd31cccb6dc8cb7c4262a3a0e884033fefd03e8"} Jul 02 13:17:25.132983 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:25.132617 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" event={"ID":"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa","Type":"ContainerStarted","Data":"e21b74fd522791046fc07624d7a1acfe869df8209956e382e60a81d1938a26b6"} Jul 02 13:17:25.308595 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:25.308484 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:17:25.315138 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:17:25.315101 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e405ac5_bddc_406b_b9df_6368fb182860.slice/crio-2b952870628288176462b1802fafc8f8c17fb678066cd85dee729daf1cef4159 WatchSource:0}: Error finding container 2b952870628288176462b1802fafc8f8c17fb678066cd85dee729daf1cef4159: Status 404 returned error can't find the container with id 2b952870628288176462b1802fafc8f8c17fb678066cd85dee729daf1cef4159 Jul 02 13:17:26.137307 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.137261 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-22627" event={"ID":"e43dc355-ca81-4e48-99ad-a6fd1d8d291c","Type":"ContainerStarted","Data":"ed17f05dc5e69e43aa944bc420e8d093a9d87f64408436e650bb95432186e5fb"} Jul 02 13:17:26.137757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.137424 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-22627" Jul 02 13:17:26.138917 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.138878 2561 generic.go:356] "Generic (PLEG): container finished" podID="9e405ac5-bddc-406b-b9df-6368fb182860" containerID="ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816" exitCode=0 Jul 02 13:17:26.139034 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.138985 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerDied","Data":"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816"} Jul 02 13:17:26.139117 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.139056 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerStarted","Data":"2b952870628288176462b1802fafc8f8c17fb678066cd85dee729daf1cef4159"} Jul 02 13:17:26.141698 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.141676 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" event={"ID":"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa","Type":"ContainerStarted","Data":"144f80f5a34fb8a1d37a0b595dc55b546e07b25adaa4ead22465ee740832641e"} Jul 02 13:17:26.141782 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.141753 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" event={"ID":"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa","Type":"ContainerStarted","Data":"9aa1faf8c3ec29c9c093b7c502f38b90a2e7a25b88b7164efa84be780ef61ce8"} Jul 02 13:17:26.143521 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.143502 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-22627" Jul 02 13:17:26.145589 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.145569 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerStarted","Data":"8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924"} Jul 02 13:17:26.145690 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.145648 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerStarted","Data":"f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469"} Jul 02 13:17:26.145754 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.145719 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerStarted","Data":"255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3"} Jul 02 13:17:26.145832 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.145775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerStarted","Data":"80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e"} Jul 02 13:17:26.145895 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.145844 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerStarted","Data":"cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be"} Jul 02 13:17:26.145951 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.145888 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerStarted","Data":"7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0"} Jul 02 13:17:26.178316 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.178260 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-22627" podStartSLOduration=0.719907696 podStartE2EDuration="3.178241062s" totalImagesPullingTime="2.458333366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:17:26.151709585 +0000 UTC m=+123.042019633" watchObservedRunningTime="2026-07-02 13:17:26.178241062 +0000 UTC m=+123.068551110" Jul 02 13:17:26.202447 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:26.202393 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.035557018 podStartE2EDuration="7.202376181s" totalImagesPullingTime="4.149636649s" totalInitContainerRuntime="17.182514ms" isStatefulPod=false podCreationTimestamp="2026-07-02 13:17:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:17:26.200162275 +0000 UTC m=+123.090472326" watchObservedRunningTime="2026-07-02 13:17:26.202376181 +0000 UTC m=+123.092686228" Jul 02 13:17:27.153097 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:27.153051 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" event={"ID":"384cabb5-ca2c-4758-bdcd-2ea7ed382bfa","Type":"ContainerStarted","Data":"6bcf30338846108ced725cc59ee8c33d364666653ec6527b04357bc51cd937bb"} Jul 02 13:17:27.176914 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:27.176712 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" podStartSLOduration=2.123347137 podStartE2EDuration="7.176690666s" totalImagesPullingTime="5.053343529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:17:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:17:27.176386986 +0000 UTC m=+124.066697034" watchObservedRunningTime="2026-07-02 13:17:27.176690666 +0000 UTC m=+124.067000715" Jul 02 13:17:28.158602 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:28.158556 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:29.168756 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:29.168719 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f8d69bd8-868h7" Jul 02 13:17:30.170329 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:30.170290 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerStarted","Data":"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3"} Jul 02 13:17:30.170787 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:30.170428 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerStarted","Data":"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574"} Jul 02 13:17:30.170787 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:30.170461 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerStarted","Data":"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76"} Jul 02 13:17:30.170787 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:30.170501 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerStarted","Data":"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083"} Jul 02 13:17:30.170787 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:30.170531 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerStarted","Data":"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1"} Jul 02 13:17:30.170787 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:30.170553 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerStarted","Data":"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a"} Jul 02 13:17:30.171737 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:30.171712 2561 generic.go:356] "Generic (PLEG): container finished" podID="1f931cc8-f55c-47da-b102-32d441db6934" containerID="eb3cee74626c777a4406575155e657163773329aea52297117bd9772450d0c93" exitCode=0 Jul 02 13:17:30.171837 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:30.171792 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" event={"ID":"1f931cc8-f55c-47da-b102-32d441db6934","Type":"ContainerDied","Data":"eb3cee74626c777a4406575155e657163773329aea52297117bd9772450d0c93"} Jul 02 13:17:30.172299 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:30.172284 2561 scope.go:117] "RemoveContainer" containerID="eb3cee74626c777a4406575155e657163773329aea52297117bd9772450d0c93" Jul 02 13:17:30.198706 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:30.198640 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.697407169 podStartE2EDuration="6.198617133s" totalImagesPullingTime="3.474599286s" totalInitContainerRuntime="26.610678ms" isStatefulPod=false podCreationTimestamp="2026-07-02 13:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:17:30.196331419 +0000 UTC m=+127.086641480" watchObservedRunningTime="2026-07-02 13:17:30.198617133 +0000 UTC m=+127.088927181" Jul 02 13:17:31.178572 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:31.178537 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-55mg4" event={"ID":"1f931cc8-f55c-47da-b102-32d441db6934","Type":"ContainerStarted","Data":"133412de196b7edd05c492b5e8ca2ac614d0a0e2f31184f1bf0c59f33091ea5a"} Jul 02 13:17:34.791435 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:34.791385 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:17:41.659055 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:41.658996 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" podUID="17ea3bb3-c07a-4dba-baf9-8f3e5b598a45" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 02 13:17:51.658771 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:17:51.658726 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" podUID="17ea3bb3-c07a-4dba-baf9-8f3e5b598a45" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 02 13:18:01.659259 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:01.659211 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" podUID="17ea3bb3-c07a-4dba-baf9-8f3e5b598a45" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 02 13:18:01.659712 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:01.659286 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" Jul 02 13:18:01.659798 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:01.659769 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c7768d19eb7be9d3d26e93a278e1ea93483e83b52a9a19591bafb1099a23a446"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 02 13:18:01.659876 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:01.659836 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" podUID="17ea3bb3-c07a-4dba-baf9-8f3e5b598a45" containerName="service-proxy" containerID="cri-o://c7768d19eb7be9d3d26e93a278e1ea93483e83b52a9a19591bafb1099a23a446" gracePeriod=30 Jul 02 13:18:02.307401 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:02.307365 2561 generic.go:356] "Generic (PLEG): container finished" podID="17ea3bb3-c07a-4dba-baf9-8f3e5b598a45" containerID="c7768d19eb7be9d3d26e93a278e1ea93483e83b52a9a19591bafb1099a23a446" exitCode=2 Jul 02 13:18:02.307660 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:02.307436 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" event={"ID":"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45","Type":"ContainerDied","Data":"c7768d19eb7be9d3d26e93a278e1ea93483e83b52a9a19591bafb1099a23a446"} Jul 02 13:18:02.307660 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:02.307477 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7786c88c6b-ds2vp" event={"ID":"17ea3bb3-c07a-4dba-baf9-8f3e5b598a45","Type":"ContainerStarted","Data":"17e22143ce646085c5d0edf022cc103da2da178d1d3130bb219449fe5e5c71ff"} Jul 02 13:18:24.791655 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:24.791552 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:24.811564 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:24.811533 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:25.413087 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:25.413059 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:38.626661 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:38.626200 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:18:38.628438 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:38.627627 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="alertmanager" containerID="cri-o://7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0" gracePeriod=120 Jul 02 13:18:38.628438 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:38.628053 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="kube-rbac-proxy" containerID="cri-o://255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3" gracePeriod=120 Jul 02 13:18:38.628438 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:38.628113 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="config-reloader" containerID="cri-o://cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be" gracePeriod=120 Jul 02 13:18:38.628438 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:38.628080 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="kube-rbac-proxy-web" containerID="cri-o://80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e" gracePeriod=120 Jul 02 13:18:38.628438 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:38.628276 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="prom-label-proxy" containerID="cri-o://8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924" gracePeriod=120 Jul 02 13:18:38.628438 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:38.628374 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="kube-rbac-proxy-metric" containerID="cri-o://f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469" gracePeriod=120 Jul 02 13:18:39.453050 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:39.453012 2561 generic.go:356] "Generic (PLEG): container finished" podID="8751fc8f-a196-468e-939e-d06248554ecb" containerID="8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924" exitCode=0 Jul 02 13:18:39.453050 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:39.453045 2561 generic.go:356] "Generic (PLEG): container finished" podID="8751fc8f-a196-468e-939e-d06248554ecb" containerID="255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3" exitCode=0 Jul 02 13:18:39.453050 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:39.453053 2561 generic.go:356] "Generic (PLEG): container finished" podID="8751fc8f-a196-468e-939e-d06248554ecb" containerID="cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be" exitCode=0 Jul 02 13:18:39.453050 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:39.453058 2561 generic.go:356] "Generic (PLEG): container finished" podID="8751fc8f-a196-468e-939e-d06248554ecb" containerID="7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0" exitCode=0 Jul 02 13:18:39.453302 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:39.453082 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerDied","Data":"8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924"} Jul 02 13:18:39.453302 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:39.453148 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerDied","Data":"255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3"} Jul 02 13:18:39.453302 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:39.453175 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerDied","Data":"cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be"} Jul 02 13:18:39.453302 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:39.453210 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerDied","Data":"7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0"} Jul 02 13:18:39.975904 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:39.975874 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:18:40.122441 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122343 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-web-config\") pod \"8751fc8f-a196-468e-939e-d06248554ecb\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " Jul 02 13:18:40.122441 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122387 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8751fc8f-a196-468e-939e-d06248554ecb\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " Jul 02 13:18:40.122441 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122408 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8751fc8f-a196-468e-939e-d06248554ecb-alertmanager-trusted-ca-bundle\") pod \"8751fc8f-a196-468e-939e-d06248554ecb\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " Jul 02 13:18:40.122441 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122424 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy\") pod \"8751fc8f-a196-468e-939e-d06248554ecb\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " Jul 02 13:18:40.122776 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122449 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8751fc8f-a196-468e-939e-d06248554ecb-config-out\") pod \"8751fc8f-a196-468e-939e-d06248554ecb\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " Jul 02 13:18:40.122776 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122474 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8751fc8f-a196-468e-939e-d06248554ecb-alertmanager-main-db\") pod \"8751fc8f-a196-468e-939e-d06248554ecb\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " Jul 02 13:18:40.122776 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122508 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-main-tls\") pod \"8751fc8f-a196-468e-939e-d06248554ecb\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " Jul 02 13:18:40.122776 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122548 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-cluster-tls-config\") pod \"8751fc8f-a196-468e-939e-d06248554ecb\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " Jul 02 13:18:40.122776 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122577 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsn6d\" (UniqueName: \"kubernetes.io/projected/8751fc8f-a196-468e-939e-d06248554ecb-kube-api-access-wsn6d\") pod \"8751fc8f-a196-468e-939e-d06248554ecb\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " Jul 02 13:18:40.122776 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122617 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-config-volume\") pod \"8751fc8f-a196-468e-939e-d06248554ecb\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " Jul 02 13:18:40.122776 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122670 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8751fc8f-a196-468e-939e-d06248554ecb-tls-assets\") pod \"8751fc8f-a196-468e-939e-d06248554ecb\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " Jul 02 13:18:40.122776 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122755 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8751fc8f-a196-468e-939e-d06248554ecb-metrics-client-ca\") pod \"8751fc8f-a196-468e-939e-d06248554ecb\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " Jul 02 13:18:40.123220 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122786 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy-web\") pod \"8751fc8f-a196-468e-939e-d06248554ecb\" (UID: \"8751fc8f-a196-468e-939e-d06248554ecb\") " Jul 02 13:18:40.123220 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122863 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8751fc8f-a196-468e-939e-d06248554ecb-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8751fc8f-a196-468e-939e-d06248554ecb" (UID: "8751fc8f-a196-468e-939e-d06248554ecb"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:18:40.123220 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.122910 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8751fc8f-a196-468e-939e-d06248554ecb-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8751fc8f-a196-468e-939e-d06248554ecb" (UID: "8751fc8f-a196-468e-939e-d06248554ecb"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:18:40.123220 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.123102 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8751fc8f-a196-468e-939e-d06248554ecb-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:40.123220 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.123124 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8751fc8f-a196-468e-939e-d06248554ecb-alertmanager-main-db\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:40.125464 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.125420 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8751fc8f-a196-468e-939e-d06248554ecb-config-out" (OuterVolumeSpecName: "config-out") pod "8751fc8f-a196-468e-939e-d06248554ecb" (UID: "8751fc8f-a196-468e-939e-d06248554ecb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:18:40.125972 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.125710 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8751fc8f-a196-468e-939e-d06248554ecb-kube-api-access-wsn6d" (OuterVolumeSpecName: "kube-api-access-wsn6d") pod "8751fc8f-a196-468e-939e-d06248554ecb" (UID: "8751fc8f-a196-468e-939e-d06248554ecb"). InnerVolumeSpecName "kube-api-access-wsn6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:18:40.125972 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.125790 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8751fc8f-a196-468e-939e-d06248554ecb" (UID: "8751fc8f-a196-468e-939e-d06248554ecb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:40.125972 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.125835 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8751fc8f-a196-468e-939e-d06248554ecb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8751fc8f-a196-468e-939e-d06248554ecb" (UID: "8751fc8f-a196-468e-939e-d06248554ecb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:18:40.125972 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.125859 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8751fc8f-a196-468e-939e-d06248554ecb" (UID: "8751fc8f-a196-468e-939e-d06248554ecb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:40.126324 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.126031 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8751fc8f-a196-468e-939e-d06248554ecb" (UID: "8751fc8f-a196-468e-939e-d06248554ecb"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:40.126324 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.126150 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8751fc8f-a196-468e-939e-d06248554ecb-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8751fc8f-a196-468e-939e-d06248554ecb" (UID: "8751fc8f-a196-468e-939e-d06248554ecb"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:18:40.126324 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.126252 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8751fc8f-a196-468e-939e-d06248554ecb" (UID: "8751fc8f-a196-468e-939e-d06248554ecb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:40.127291 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.127265 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-config-volume" (OuterVolumeSpecName: "config-volume") pod "8751fc8f-a196-468e-939e-d06248554ecb" (UID: "8751fc8f-a196-468e-939e-d06248554ecb"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:40.130798 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.130772 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8751fc8f-a196-468e-939e-d06248554ecb" (UID: "8751fc8f-a196-468e-939e-d06248554ecb"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:40.136609 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.136575 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-web-config" (OuterVolumeSpecName: "web-config") pod "8751fc8f-a196-468e-939e-d06248554ecb" (UID: "8751fc8f-a196-468e-939e-d06248554ecb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:40.223982 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.223934 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8751fc8f-a196-468e-939e-d06248554ecb-tls-assets\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:40.223982 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.223974 2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8751fc8f-a196-468e-939e-d06248554ecb-metrics-client-ca\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:40.223982 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.223986 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:40.223982 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.223995 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-web-config\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:40.223982 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.224004 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:40.224281 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.224013 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:40.224281 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.224023 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8751fc8f-a196-468e-939e-d06248554ecb-config-out\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:40.224281 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.224031 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-secret-alertmanager-main-tls\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:40.224281 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.224039 2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-cluster-tls-config\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:40.224281 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.224047 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsn6d\" (UniqueName: \"kubernetes.io/projected/8751fc8f-a196-468e-939e-d06248554ecb-kube-api-access-wsn6d\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:40.224281 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.224056 2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8751fc8f-a196-468e-939e-d06248554ecb-config-volume\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:40.460058 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.460025 2561 generic.go:356] "Generic (PLEG): container finished" podID="8751fc8f-a196-468e-939e-d06248554ecb" containerID="f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469" exitCode=0 Jul 02 13:18:40.460058 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.460050 2561 generic.go:356] "Generic (PLEG): container finished" podID="8751fc8f-a196-468e-939e-d06248554ecb" containerID="80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e" exitCode=0 Jul 02 13:18:40.460276 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.460084 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerDied","Data":"f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469"} Jul 02 13:18:40.460276 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.460100 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:18:40.460276 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.460142 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerDied","Data":"80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e"} Jul 02 13:18:40.460276 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.460170 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8751fc8f-a196-468e-939e-d06248554ecb","Type":"ContainerDied","Data":"5c9653448470400790d79520d95187355cb214151e6482cb560ffaa4469495e0"} Jul 02 13:18:40.460276 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.460202 2561 scope.go:117] "RemoveContainer" containerID="8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924" Jul 02 13:18:40.468918 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.468883 2561 scope.go:117] "RemoveContainer" containerID="f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469" Jul 02 13:18:40.477323 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.477300 2561 scope.go:117] "RemoveContainer" containerID="255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3" Jul 02 13:18:40.485534 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.485506 2561 scope.go:117] "RemoveContainer" containerID="80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e" Jul 02 13:18:40.489065 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.488960 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:18:40.493763 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.493738 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:18:40.494311 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.494284 2561 scope.go:117] "RemoveContainer" containerID="cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be" Jul 02 13:18:40.502752 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.502732 2561 scope.go:117] "RemoveContainer" containerID="7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0" Jul 02 13:18:40.511345 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.511301 2561 scope.go:117] "RemoveContainer" containerID="742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702" Jul 02 13:18:40.521584 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.521556 2561 scope.go:117] "RemoveContainer" containerID="8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924" Jul 02 13:18:40.522344 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:18:40.522315 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924\": container with ID starting with 8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924 not found: ID does not exist" containerID="8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924" Jul 02 13:18:40.522474 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.522351 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924"} err="failed to get container status \"8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924\": rpc error: code = NotFound desc = could not find container \"8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924\": container with ID starting with 8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924 not found: ID does not exist" Jul 02 13:18:40.522474 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.522371 2561 scope.go:117] "RemoveContainer" containerID="f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469" Jul 02 13:18:40.522689 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:18:40.522670 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469\": container with ID starting with f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469 not found: ID does not exist" containerID="f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469" Jul 02 13:18:40.522739 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.522698 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469"} err="failed to get container status \"f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469\": rpc error: code = NotFound desc = could not find container \"f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469\": container with ID starting with f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469 not found: ID does not exist" Jul 02 13:18:40.522739 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.522715 2561 scope.go:117] "RemoveContainer" containerID="255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3" Jul 02 13:18:40.523015 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:18:40.522999 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3\": container with ID starting with 255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3 not found: ID does not exist" containerID="255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3" Jul 02 13:18:40.523089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.523022 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3"} err="failed to get container status \"255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3\": rpc error: code = NotFound desc = could not find container \"255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3\": container with ID starting with 255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3 not found: ID does not exist" Jul 02 13:18:40.523089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.523037 2561 scope.go:117] "RemoveContainer" containerID="80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e" Jul 02 13:18:40.523284 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:18:40.523250 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e\": container with ID starting with 80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e not found: ID does not exist" containerID="80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e" Jul 02 13:18:40.523321 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.523290 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e"} err="failed to get container status \"80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e\": rpc error: code = NotFound desc = could not find container \"80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e\": container with ID starting with 80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e not found: ID does not exist" Jul 02 13:18:40.523321 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.523304 2561 scope.go:117] "RemoveContainer" containerID="cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be" Jul 02 13:18:40.523549 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:18:40.523529 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be\": container with ID starting with cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be not found: ID does not exist" containerID="cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be" Jul 02 13:18:40.523647 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.523551 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be"} err="failed to get container status \"cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be\": rpc error: code = NotFound desc = could not find container \"cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be\": container with ID starting with cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be not found: ID does not exist" Jul 02 13:18:40.523647 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.523566 2561 scope.go:117] "RemoveContainer" containerID="7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0" Jul 02 13:18:40.523886 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:18:40.523868 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0\": container with ID starting with 7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0 not found: ID does not exist" containerID="7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0" Jul 02 13:18:40.523937 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.523889 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0"} err="failed to get container status \"7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0\": rpc error: code = NotFound desc = could not find container \"7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0\": container with ID starting with 7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0 not found: ID does not exist" Jul 02 13:18:40.523937 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.523904 2561 scope.go:117] "RemoveContainer" containerID="742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702" Jul 02 13:18:40.524091 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:18:40.524078 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702\": container with ID starting with 742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702 not found: ID does not exist" containerID="742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702" Jul 02 13:18:40.524140 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.524094 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702"} err="failed to get container status \"742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702\": rpc error: code = NotFound desc = could not find container \"742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702\": container with ID starting with 742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702 not found: ID does not exist" Jul 02 13:18:40.524140 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.524107 2561 scope.go:117] "RemoveContainer" containerID="8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924" Jul 02 13:18:40.524297 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.524276 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924"} err="failed to get container status \"8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924\": rpc error: code = NotFound desc = could not find container \"8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924\": container with ID starting with 8fb39054b0a9fda7db83217e192880ea6fab949ddbf7fee55c4bbc3a60a5e924 not found: ID does not exist" Jul 02 13:18:40.524337 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.524298 2561 scope.go:117] "RemoveContainer" containerID="f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469" Jul 02 13:18:40.524490 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.524476 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469"} err="failed to get container status \"f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469\": rpc error: code = NotFound desc = could not find container \"f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469\": container with ID starting with f20721ad5d1ea90404257446445eab404123a7baf6d6386503dbbc41e6368469 not found: ID does not exist" Jul 02 13:18:40.524535 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.524491 2561 scope.go:117] "RemoveContainer" containerID="255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3" Jul 02 13:18:40.524708 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.524690 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3"} err="failed to get container status \"255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3\": rpc error: code = NotFound desc = could not find container \"255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3\": container with ID starting with 255423dc51066c2d70875ab6f3208bab234efa3581dd46b4d11d3209edb9d1f3 not found: ID does not exist" Jul 02 13:18:40.524754 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.524708 2561 scope.go:117] "RemoveContainer" containerID="80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e" Jul 02 13:18:40.524954 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.524936 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e"} err="failed to get container status \"80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e\": rpc error: code = NotFound desc = could not find container \"80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e\": container with ID starting with 80ce687f06f2c2d5be70ba7729b90dc602dbe362474e839f92fc9d15ee75167e not found: ID does not exist" Jul 02 13:18:40.524954 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.524953 2561 scope.go:117] "RemoveContainer" containerID="cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be" Jul 02 13:18:40.525153 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.525138 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be"} err="failed to get container status \"cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be\": rpc error: code = NotFound desc = could not find container \"cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be\": container with ID starting with cb727a40f4fac4559b620a8122afec036fbb1a9b84d8f2727a958e7e3571e6be not found: ID does not exist" Jul 02 13:18:40.525205 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.525155 2561 scope.go:117] "RemoveContainer" containerID="7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0" Jul 02 13:18:40.525322 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.525307 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0"} err="failed to get container status \"7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0\": rpc error: code = NotFound desc = could not find container \"7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0\": container with ID starting with 7a45b0a293aa9338506495a82e968612cd7b8501a64454ad91160361adbfa2f0 not found: ID does not exist" Jul 02 13:18:40.525362 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.525322 2561 scope.go:117] "RemoveContainer" containerID="742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702" Jul 02 13:18:40.525544 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:40.525526 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702"} err="failed to get container status \"742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702\": rpc error: code = NotFound desc = could not find container \"742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702\": container with ID starting with 742cac8de606aa275c113486dd840bee5711126b18fc5631bb0dc088392d8702 not found: ID does not exist" Jul 02 13:18:41.555929 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:41.555897 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8751fc8f-a196-468e-939e-d06248554ecb" path="/var/lib/kubelet/pods/8751fc8f-a196-468e-939e-d06248554ecb/volumes" Jul 02 13:18:42.945873 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:42.945833 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:18:42.946310 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:42.946153 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="prometheus" containerID="cri-o://1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a" gracePeriod=600 Jul 02 13:18:42.946310 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:42.946224 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="kube-rbac-proxy" containerID="cri-o://3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574" gracePeriod=600 Jul 02 13:18:42.946310 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:42.946260 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="kube-rbac-proxy-web" containerID="cri-o://f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76" gracePeriod=600 Jul 02 13:18:42.946310 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:42.946269 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="config-reloader" containerID="cri-o://ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1" gracePeriod=600 Jul 02 13:18:42.946310 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:42.946285 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="kube-rbac-proxy-thanos" containerID="cri-o://89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3" gracePeriod=600 Jul 02 13:18:42.946581 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:42.946232 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="thanos-sidecar" containerID="cri-o://ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083" gracePeriod=600 Jul 02 13:18:43.191171 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.191146 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.350210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350117 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bvs8\" (UniqueName: \"kubernetes.io/projected/9e405ac5-bddc-406b-b9df-6368fb182860-kube-api-access-9bvs8\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.350210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350170 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.350210 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350201 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-kubelet-serving-ca-bundle\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.350496 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350217 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-thanos-prometheus-http-client-file\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.350496 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350237 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e405ac5-bddc-406b-b9df-6368fb182860-config-out\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.350496 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350257 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e405ac5-bddc-406b-b9df-6368fb182860-tls-assets\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.350496 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350282 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-2\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.350496 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350306 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-web-config\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.350496 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350335 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-tls\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.350496 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350372 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-kube-rbac-proxy\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.350496 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350412 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-metrics-client-ca\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.350496 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350435 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.350496 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350474 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-serving-certs-ca-bundle\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.351013 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350507 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-1\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.351013 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350529 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-grpc-tls\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.351013 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350552 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-config\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.351013 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350567 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-metrics-client-certs\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.351013 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350584 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-trusted-ca-bundle\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.351013 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350604 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-0\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.351013 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350633 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-db\") pod \"9e405ac5-bddc-406b-b9df-6368fb182860\" (UID: \"9e405ac5-bddc-406b-b9df-6368fb182860\") " Jul 02 13:18:43.351013 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350631 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:18:43.351013 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.350905 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.351457 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.351133 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:18:43.351457 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.351419 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:18:43.351995 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.351958 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:18:43.353093 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.353058 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e405ac5-bddc-406b-b9df-6368fb182860-kube-api-access-9bvs8" (OuterVolumeSpecName: "kube-api-access-9bvs8") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "kube-api-access-9bvs8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:18:43.353615 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.353577 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:18:43.353711 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.353638 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:18:43.354042 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.354016 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:18:43.354133 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.354092 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:43.354477 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.354448 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:43.354573 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.354453 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:18:43.354995 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.354969 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e405ac5-bddc-406b-b9df-6368fb182860-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:18:43.355116 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.355059 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e405ac5-bddc-406b-b9df-6368fb182860-config-out" (OuterVolumeSpecName: "config-out") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:18:43.355116 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.355104 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:43.355231 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.355206 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:43.355332 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.355307 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:43.355377 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.355324 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-config" (OuterVolumeSpecName: "config") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:43.355898 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.355874 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:43.356365 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.356343 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:43.364936 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.364902 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-web-config" (OuterVolumeSpecName: "web-config") pod "9e405ac5-bddc-406b-b9df-6368fb182860" (UID: "9e405ac5-bddc-406b-b9df-6368fb182860"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:18:43.451756 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451700 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.451756 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451747 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-db\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.451756 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451758 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bvs8\" (UniqueName: \"kubernetes.io/projected/9e405ac5-bddc-406b-b9df-6368fb182860-kube-api-access-9bvs8\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.451756 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451769 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.451756 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451779 2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.452089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451788 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e405ac5-bddc-406b-b9df-6368fb182860-config-out\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.452089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451797 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e405ac5-bddc-406b-b9df-6368fb182860-tls-assets\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.452089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451829 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.452089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451838 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-web-config\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.452089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451847 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.452089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451855 2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-kube-rbac-proxy\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.452089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451864 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-metrics-client-ca\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.452089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451875 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.452089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451883 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.452089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451893 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.452089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451901 2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-grpc-tls\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.452089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451909 2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-config\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.452089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451916 2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9e405ac5-bddc-406b-b9df-6368fb182860-secret-metrics-client-certs\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.452089 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.451923 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e405ac5-bddc-406b-b9df-6368fb182860-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-111.ec2.internal\" DevicePath \"\"" Jul 02 13:18:43.481322 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481283 2561 generic.go:356] "Generic (PLEG): container finished" podID="9e405ac5-bddc-406b-b9df-6368fb182860" containerID="89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3" exitCode=0 Jul 02 13:18:43.481322 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481311 2561 generic.go:356] "Generic (PLEG): container finished" podID="9e405ac5-bddc-406b-b9df-6368fb182860" containerID="3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574" exitCode=0 Jul 02 13:18:43.481322 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481316 2561 generic.go:356] "Generic (PLEG): container finished" podID="9e405ac5-bddc-406b-b9df-6368fb182860" containerID="f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76" exitCode=0 Jul 02 13:18:43.481322 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481322 2561 generic.go:356] "Generic (PLEG): container finished" podID="9e405ac5-bddc-406b-b9df-6368fb182860" containerID="ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083" exitCode=0 Jul 02 13:18:43.481322 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481327 2561 generic.go:356] "Generic (PLEG): container finished" podID="9e405ac5-bddc-406b-b9df-6368fb182860" containerID="ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1" exitCode=0 Jul 02 13:18:43.481322 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481332 2561 generic.go:356] "Generic (PLEG): container finished" podID="9e405ac5-bddc-406b-b9df-6368fb182860" containerID="1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a" exitCode=0 Jul 02 13:18:43.481662 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481361 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.481662 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481361 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerDied","Data":"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3"} Jul 02 13:18:43.481662 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481430 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerDied","Data":"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574"} Jul 02 13:18:43.481662 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481459 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerDied","Data":"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76"} Jul 02 13:18:43.481662 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481485 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerDied","Data":"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083"} Jul 02 13:18:43.481662 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481496 2561 scope.go:117] "RemoveContainer" containerID="89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3" Jul 02 13:18:43.481662 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481509 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerDied","Data":"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1"} Jul 02 13:18:43.481662 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481535 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerDied","Data":"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a"} Jul 02 13:18:43.481662 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.481559 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e405ac5-bddc-406b-b9df-6368fb182860","Type":"ContainerDied","Data":"2b952870628288176462b1802fafc8f8c17fb678066cd85dee729daf1cef4159"} Jul 02 13:18:43.489561 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.489533 2561 scope.go:117] "RemoveContainer" containerID="3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574" Jul 02 13:18:43.496910 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.496890 2561 scope.go:117] "RemoveContainer" containerID="f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76" Jul 02 13:18:43.504713 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.504688 2561 scope.go:117] "RemoveContainer" containerID="ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083" Jul 02 13:18:43.507552 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.507523 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:18:43.513444 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.513285 2561 scope.go:117] "RemoveContainer" containerID="ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1" Jul 02 13:18:43.515002 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.514980 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:18:43.520989 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.520968 2561 scope.go:117] "RemoveContainer" containerID="1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a" Jul 02 13:18:43.529137 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.529111 2561 scope.go:117] "RemoveContainer" containerID="ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816" Jul 02 13:18:43.536681 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.536656 2561 scope.go:117] "RemoveContainer" containerID="89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3" Jul 02 13:18:43.537007 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:18:43.536988 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3\": container with ID starting with 89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3 not found: ID does not exist" containerID="89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3" Jul 02 13:18:43.537054 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.537017 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3"} err="failed to get container status \"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3\": rpc error: code = NotFound desc = could not find container \"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3\": container with ID starting with 89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3 not found: ID does not exist" Jul 02 13:18:43.537054 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.537042 2561 scope.go:117] "RemoveContainer" containerID="3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574" Jul 02 13:18:43.537295 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:18:43.537276 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574\": container with ID starting with 3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574 not found: ID does not exist" containerID="3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574" Jul 02 13:18:43.537331 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.537303 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574"} err="failed to get container status \"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574\": rpc error: code = NotFound desc = could not find container \"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574\": container with ID starting with 3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574 not found: ID does not exist" Jul 02 13:18:43.537331 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.537324 2561 scope.go:117] "RemoveContainer" containerID="f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76" Jul 02 13:18:43.537564 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:18:43.537549 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76\": container with ID starting with f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76 not found: ID does not exist" containerID="f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76" Jul 02 13:18:43.537606 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.537569 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76"} err="failed to get container status \"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76\": rpc error: code = NotFound desc = could not find container \"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76\": container with ID starting with f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76 not found: ID does not exist" Jul 02 13:18:43.537606 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.537582 2561 scope.go:117] "RemoveContainer" containerID="ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083" Jul 02 13:18:43.537848 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:18:43.537827 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083\": container with ID starting with ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083 not found: ID does not exist" containerID="ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083" Jul 02 13:18:43.537898 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.537857 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083"} err="failed to get container status \"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083\": rpc error: code = NotFound desc = could not find container \"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083\": container with ID starting with ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083 not found: ID does not exist" Jul 02 13:18:43.537898 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.537876 2561 scope.go:117] "RemoveContainer" containerID="ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1" Jul 02 13:18:43.538127 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:18:43.538106 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1\": container with ID starting with ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1 not found: ID does not exist" containerID="ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1" Jul 02 13:18:43.538180 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.538132 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1"} err="failed to get container status \"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1\": rpc error: code = NotFound desc = could not find container \"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1\": container with ID starting with ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1 not found: ID does not exist" Jul 02 13:18:43.538180 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.538172 2561 scope.go:117] "RemoveContainer" containerID="1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a" Jul 02 13:18:43.538379 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:18:43.538363 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a\": container with ID starting with 1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a not found: ID does not exist" containerID="1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a" Jul 02 13:18:43.538415 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.538382 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a"} err="failed to get container status \"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a\": rpc error: code = NotFound desc = could not find container \"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a\": container with ID starting with 1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a not found: ID does not exist" Jul 02 13:18:43.538415 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.538396 2561 scope.go:117] "RemoveContainer" containerID="ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816" Jul 02 13:18:43.538648 ip-10-0-133-111 kubenswrapper[2561]: E0702 13:18:43.538626 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816\": container with ID starting with ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816 not found: ID does not exist" containerID="ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816" Jul 02 13:18:43.538715 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.538659 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816"} err="failed to get container status \"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816\": rpc error: code = NotFound desc = could not find container \"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816\": container with ID starting with ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816 not found: ID does not exist" Jul 02 13:18:43.538715 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.538682 2561 scope.go:117] "RemoveContainer" containerID="89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3" Jul 02 13:18:43.538990 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.538964 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3"} err="failed to get container status \"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3\": rpc error: code = NotFound desc = could not find container \"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3\": container with ID starting with 89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3 not found: ID does not exist" Jul 02 13:18:43.538990 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.538990 2561 scope.go:117] "RemoveContainer" containerID="3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574" Jul 02 13:18:43.539469 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.539365 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574"} err="failed to get container status \"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574\": rpc error: code = NotFound desc = could not find container \"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574\": container with ID starting with 3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574 not found: ID does not exist" Jul 02 13:18:43.539469 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.539455 2561 scope.go:117] "RemoveContainer" containerID="f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76" Jul 02 13:18:43.540315 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.540285 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76"} err="failed to get container status \"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76\": rpc error: code = NotFound desc = could not find container \"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76\": container with ID starting with f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76 not found: ID does not exist" Jul 02 13:18:43.540403 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.540317 2561 scope.go:117] "RemoveContainer" containerID="ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083" Jul 02 13:18:43.540609 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.540589 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083"} err="failed to get container status \"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083\": rpc error: code = NotFound desc = could not find container \"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083\": container with ID starting with ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083 not found: ID does not exist" Jul 02 13:18:43.540692 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.540612 2561 scope.go:117] "RemoveContainer" containerID="ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1" Jul 02 13:18:43.540908 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.540880 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1"} err="failed to get container status \"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1\": rpc error: code = NotFound desc = could not find container \"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1\": container with ID starting with ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1 not found: ID does not exist" Jul 02 13:18:43.540908 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.540906 2561 scope.go:117] "RemoveContainer" containerID="1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a" Jul 02 13:18:43.541123 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541105 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:18:43.541175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541134 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a"} err="failed to get container status \"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a\": rpc error: code = NotFound desc = could not find container \"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a\": container with ID starting with 1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a not found: ID does not exist" Jul 02 13:18:43.541175 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541154 2561 scope.go:117] "RemoveContainer" containerID="ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816" Jul 02 13:18:43.541394 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541378 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="config-reloader" Jul 02 13:18:43.541444 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541395 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="config-reloader" Jul 02 13:18:43.541444 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541394 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816"} err="failed to get container status \"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816\": rpc error: code = NotFound desc = could not find container \"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816\": container with ID starting with ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816 not found: ID does not exist" Jul 02 13:18:43.541444 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541406 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="init-config-reloader" Jul 02 13:18:43.541444 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541413 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="init-config-reloader" Jul 02 13:18:43.541444 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541413 2561 scope.go:117] "RemoveContainer" containerID="89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3" Jul 02 13:18:43.541444 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541419 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="init-config-reloader" Jul 02 13:18:43.541444 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541425 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="init-config-reloader" Jul 02 13:18:43.541444 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541435 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="kube-rbac-proxy-metric" Jul 02 13:18:43.541444 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541440 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="kube-rbac-proxy-metric" Jul 02 13:18:43.541444 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541445 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="prom-label-proxy" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541453 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="prom-label-proxy" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541467 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="kube-rbac-proxy" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541475 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="kube-rbac-proxy" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541485 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="alertmanager" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541492 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="alertmanager" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541501 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="kube-rbac-proxy-web" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541510 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="kube-rbac-proxy-web" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541523 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="prometheus" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541531 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="prometheus" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541538 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="kube-rbac-proxy-thanos" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541546 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="kube-rbac-proxy-thanos" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541563 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="kube-rbac-proxy" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541571 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="kube-rbac-proxy" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541578 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="thanos-sidecar" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541588 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="thanos-sidecar" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541600 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="kube-rbac-proxy-web" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541606 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="kube-rbac-proxy-web" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541612 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="config-reloader" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541620 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="config-reloader" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541677 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="kube-rbac-proxy" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541686 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="config-reloader" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541691 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3"} err="failed to get container status \"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3\": rpc error: code = NotFound desc = could not find container \"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3\": container with ID starting with 89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3 not found: ID does not exist" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541713 2561 scope.go:117] "RemoveContainer" containerID="3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541698 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="alertmanager" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541759 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="thanos-sidecar" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541765 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="kube-rbac-proxy" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541774 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="kube-rbac-proxy-web" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541781 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="config-reloader" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541789 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="kube-rbac-proxy-web" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541795 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="kube-rbac-proxy-thanos" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541801 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="prom-label-proxy" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541824 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" containerName="prometheus" Jul 02 13:18:43.541793 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.541833 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8751fc8f-a196-468e-939e-d06248554ecb" containerName="kube-rbac-proxy-metric" Jul 02 13:18:43.542875 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.542009 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574"} err="failed to get container status \"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574\": rpc error: code = NotFound desc = could not find container \"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574\": container with ID starting with 3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574 not found: ID does not exist" Jul 02 13:18:43.542875 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.542028 2561 scope.go:117] "RemoveContainer" containerID="f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76" Jul 02 13:18:43.542875 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.542272 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76"} err="failed to get container status \"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76\": rpc error: code = NotFound desc = could not find container \"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76\": container with ID starting with f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76 not found: ID does not exist" Jul 02 13:18:43.542875 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.542292 2561 scope.go:117] "RemoveContainer" containerID="ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083" Jul 02 13:18:43.542875 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.542503 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083"} err="failed to get container status \"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083\": rpc error: code = NotFound desc = could not find container \"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083\": container with ID starting with ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083 not found: ID does not exist" Jul 02 13:18:43.542875 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.542522 2561 scope.go:117] "RemoveContainer" containerID="ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1" Jul 02 13:18:43.542875 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.542750 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1"} err="failed to get container status \"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1\": rpc error: code = NotFound desc = could not find container \"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1\": container with ID starting with ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1 not found: ID does not exist" Jul 02 13:18:43.542875 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.542768 2561 scope.go:117] "RemoveContainer" containerID="1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a" Jul 02 13:18:43.543181 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.543058 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a"} err="failed to get container status \"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a\": rpc error: code = NotFound desc = could not find container \"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a\": container with ID starting with 1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a not found: ID does not exist" Jul 02 13:18:43.543181 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.543082 2561 scope.go:117] "RemoveContainer" containerID="ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816" Jul 02 13:18:43.543322 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.543303 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816"} err="failed to get container status \"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816\": rpc error: code = NotFound desc = could not find container \"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816\": container with ID starting with ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816 not found: ID does not exist" Jul 02 13:18:43.543364 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.543323 2561 scope.go:117] "RemoveContainer" containerID="89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3" Jul 02 13:18:43.543547 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.543532 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3"} err="failed to get container status \"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3\": rpc error: code = NotFound desc = could not find container \"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3\": container with ID starting with 89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3 not found: ID does not exist" Jul 02 13:18:43.543547 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.543546 2561 scope.go:117] "RemoveContainer" containerID="3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574" Jul 02 13:18:43.543801 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.543779 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574"} err="failed to get container status \"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574\": rpc error: code = NotFound desc = could not find container \"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574\": container with ID starting with 3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574 not found: ID does not exist" Jul 02 13:18:43.543907 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.543802 2561 scope.go:117] "RemoveContainer" containerID="f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76" Jul 02 13:18:43.544061 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.544043 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76"} err="failed to get container status \"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76\": rpc error: code = NotFound desc = could not find container \"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76\": container with ID starting with f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76 not found: ID does not exist" Jul 02 13:18:43.544108 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.544064 2561 scope.go:117] "RemoveContainer" containerID="ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083" Jul 02 13:18:43.544264 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.544244 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083"} err="failed to get container status \"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083\": rpc error: code = NotFound desc = could not find container \"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083\": container with ID starting with ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083 not found: ID does not exist" Jul 02 13:18:43.544327 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.544265 2561 scope.go:117] "RemoveContainer" containerID="ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1" Jul 02 13:18:43.544483 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.544467 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1"} err="failed to get container status \"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1\": rpc error: code = NotFound desc = could not find container \"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1\": container with ID starting with ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1 not found: ID does not exist" Jul 02 13:18:43.544530 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.544484 2561 scope.go:117] "RemoveContainer" containerID="1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a" Jul 02 13:18:43.544694 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.544676 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a"} err="failed to get container status \"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a\": rpc error: code = NotFound desc = could not find container \"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a\": container with ID starting with 1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a not found: ID does not exist" Jul 02 13:18:43.544761 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.544696 2561 scope.go:117] "RemoveContainer" containerID="ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816" Jul 02 13:18:43.544923 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.544907 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816"} err="failed to get container status \"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816\": rpc error: code = NotFound desc = could not find container \"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816\": container with ID starting with ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816 not found: ID does not exist" Jul 02 13:18:43.544974 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.544923 2561 scope.go:117] "RemoveContainer" containerID="89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3" Jul 02 13:18:43.545121 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.545105 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3"} err="failed to get container status \"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3\": rpc error: code = NotFound desc = could not find container \"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3\": container with ID starting with 89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3 not found: ID does not exist" Jul 02 13:18:43.545169 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.545121 2561 scope.go:117] "RemoveContainer" containerID="3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574" Jul 02 13:18:43.545321 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.545305 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574"} err="failed to get container status \"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574\": rpc error: code = NotFound desc = could not find container \"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574\": container with ID starting with 3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574 not found: ID does not exist" Jul 02 13:18:43.545359 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.545328 2561 scope.go:117] "RemoveContainer" containerID="f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76" Jul 02 13:18:43.545359 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.545314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.545774 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.545615 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76"} err="failed to get container status \"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76\": rpc error: code = NotFound desc = could not find container \"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76\": container with ID starting with f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76 not found: ID does not exist" Jul 02 13:18:43.545774 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.545644 2561 scope.go:117] "RemoveContainer" containerID="ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083" Jul 02 13:18:43.546016 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.545993 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083"} err="failed to get container status \"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083\": rpc error: code = NotFound desc = could not find container \"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083\": container with ID starting with ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083 not found: ID does not exist" Jul 02 13:18:43.546079 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.546017 2561 scope.go:117] "RemoveContainer" containerID="ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1" Jul 02 13:18:43.546273 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.546253 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1"} err="failed to get container status \"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1\": rpc error: code = NotFound desc = could not find container \"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1\": container with ID starting with ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1 not found: ID does not exist" Jul 02 13:18:43.546342 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.546273 2561 scope.go:117] "RemoveContainer" containerID="1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a" Jul 02 13:18:43.546517 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.546497 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a"} err="failed to get container status \"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a\": rpc error: code = NotFound desc = could not find container \"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a\": container with ID starting with 1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a not found: ID does not exist" Jul 02 13:18:43.546580 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.546517 2561 scope.go:117] "RemoveContainer" containerID="ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816" Jul 02 13:18:43.546751 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.546728 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816"} err="failed to get container status \"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816\": rpc error: code = NotFound desc = could not find container \"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816\": container with ID starting with ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816 not found: ID does not exist" Jul 02 13:18:43.546839 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.546751 2561 scope.go:117] "RemoveContainer" containerID="89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3" Jul 02 13:18:43.547059 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.547039 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3"} err="failed to get container status \"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3\": rpc error: code = NotFound desc = could not find container \"89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3\": container with ID starting with 89dd6e80ab1052a64da923d8218188f4119326979d99dd582b077be537b2bdc3 not found: ID does not exist" Jul 02 13:18:43.547059 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.547059 2561 scope.go:117] "RemoveContainer" containerID="3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574" Jul 02 13:18:43.547311 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.547288 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574"} err="failed to get container status \"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574\": rpc error: code = NotFound desc = could not find container \"3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574\": container with ID starting with 3ecf8f2b164b3fe9d66e7e904f99387d225fa71fa5592f852c0c4fecc2a7f574 not found: ID does not exist" Jul 02 13:18:43.547311 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.547311 2561 scope.go:117] "RemoveContainer" containerID="f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76" Jul 02 13:18:43.547532 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.547510 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76"} err="failed to get container status \"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76\": rpc error: code = NotFound desc = could not find container \"f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76\": container with ID starting with f3fdf5b8cd329fdcff5ac4ad72c3419821da6e541df9ff3847110923e98f1e76 not found: ID does not exist" Jul 02 13:18:43.547532 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.547530 2561 scope.go:117] "RemoveContainer" containerID="ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083" Jul 02 13:18:43.547740 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.547722 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083"} err="failed to get container status \"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083\": rpc error: code = NotFound desc = could not find container \"ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083\": container with ID starting with ba8b66b0e4cf8c485f51bb05bb318f8839f9ba1e262d924df0fe6e91d6897083 not found: ID does not exist" Jul 02 13:18:43.547831 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.547741 2561 scope.go:117] "RemoveContainer" containerID="ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1" Jul 02 13:18:43.548016 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.547994 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1"} err="failed to get container status \"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1\": rpc error: code = NotFound desc = could not find container \"ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1\": container with ID starting with ba05db1873ea4db8bdd70b2c05dc322eb8faba745886130d7851d01a3fd1cbe1 not found: ID does not exist" Jul 02 13:18:43.548097 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.548017 2561 scope.go:117] "RemoveContainer" containerID="1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a" Jul 02 13:18:43.548097 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.548038 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 13:18:43.548097 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.548040 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 13:18:43.548242 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.548172 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jgf5q\"" Jul 02 13:18:43.548242 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.548197 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 13:18:43.548331 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.548279 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 13:18:43.548392 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.548342 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 13:18:43.548392 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.548284 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 13:18:43.548575 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.548549 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a"} err="failed to get container status \"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a\": rpc error: code = NotFound desc = could not find container \"1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a\": container with ID starting with 1ca4ccad9e91b6c89ae4a44f6d20fed7350f33ef1038a21e1d2a92852550bd6a not found: ID does not exist" Jul 02 13:18:43.548664 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.548576 2561 scope.go:117] "RemoveContainer" containerID="ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816" Jul 02 13:18:43.548664 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.548626 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-72v54pofe10u3\"" Jul 02 13:18:43.548856 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.548840 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 13:18:43.548856 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.548846 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816"} err="failed to get container status \"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816\": rpc error: code = NotFound desc = could not find container \"ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816\": container with ID starting with ab08b4a633ceea71d21bd092d4ce964ec87b4991733f83a3b21830e47f72b816 not found: ID does not exist" Jul 02 13:18:43.548969 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.548871 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 13:18:43.549110 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.549093 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 13:18:43.549250 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.549186 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 13:18:43.549326 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.549300 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 13:18:43.549387 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.549332 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 13:18:43.549443 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.549434 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 13:18:43.551435 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.551414 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 13:18:43.553969 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.553949 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 13:18:43.557456 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.557433 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e405ac5-bddc-406b-b9df-6368fb182860" path="/var/lib/kubelet/pods/9e405ac5-bddc-406b-b9df-6368fb182860/volumes" Jul 02 13:18:43.569702 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.568222 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:18:43.653262 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653229 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653416 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653271 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653416 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653293 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653416 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653356 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653416 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653384 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653416 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653410 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653610 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653429 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653610 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653446 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653610 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653463 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653610 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653483 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-config\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653610 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/665e50d9-ebb5-463c-b474-c90eca883098-config-out\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653610 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653511 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653610 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653526 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/665e50d9-ebb5-463c-b474-c90eca883098-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653610 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653574 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653610 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653981 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653642 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-web-config\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653981 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653675 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653981 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653981 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653720 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.653981 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.653738 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26f7m\" (UniqueName: \"kubernetes.io/projected/665e50d9-ebb5-463c-b474-c90eca883098-kube-api-access-26f7m\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754340 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754340 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754341 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754571 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754571 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754399 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754571 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754417 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754571 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754432 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754571 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754456 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-config\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754571 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754483 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/665e50d9-ebb5-463c-b474-c90eca883098-config-out\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754886 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754886 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754652 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/665e50d9-ebb5-463c-b474-c90eca883098-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754886 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754886 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754886 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-web-config\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754886 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754886 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754833 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.754886 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754880 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.755366 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26f7m\" (UniqueName: \"kubernetes.io/projected/665e50d9-ebb5-463c-b474-c90eca883098-kube-api-access-26f7m\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.755366 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.754971 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.755366 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.755027 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.755366 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.755030 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.755366 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.755055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.755366 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.755195 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.757274 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.756122 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.757274 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.756321 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.757274 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.756567 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.757274 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.756930 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.757274 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.757066 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.757883 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.757829 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.758127 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.758105 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/665e50d9-ebb5-463c-b474-c90eca883098-config-out\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.758226 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.758192 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-config\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.758730 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.758702 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.759277 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.759248 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.759277 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.759269 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.759840 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.759788 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-web-config\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.759920 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.759887 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/665e50d9-ebb5-463c-b474-c90eca883098-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.760038 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.760016 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/665e50d9-ebb5-463c-b474-c90eca883098-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.760185 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.760169 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.760584 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.760566 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.760646 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.760628 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/665e50d9-ebb5-463c-b474-c90eca883098-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.765326 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.765301 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26f7m\" (UniqueName: \"kubernetes.io/projected/665e50d9-ebb5-463c-b474-c90eca883098-kube-api-access-26f7m\") pod \"prometheus-k8s-0\" (UID: \"665e50d9-ebb5-463c-b474-c90eca883098\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.856787 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.856747 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:18:43.998023 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:43.998000 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:18:44.000476 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:18:44.000447 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod665e50d9_ebb5_463c_b474_c90eca883098.slice/crio-ac3f457048a89b1e5f1a539cbd09d2a8850fcdbbd0ca92df408c6ec9db9b435e WatchSource:0}: Error finding container ac3f457048a89b1e5f1a539cbd09d2a8850fcdbbd0ca92df408c6ec9db9b435e: Status 404 returned error can't find the container with id ac3f457048a89b1e5f1a539cbd09d2a8850fcdbbd0ca92df408c6ec9db9b435e Jul 02 13:18:44.486682 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:44.486646 2561 generic.go:356] "Generic (PLEG): container finished" podID="665e50d9-ebb5-463c-b474-c90eca883098" containerID="15c1c927b9c78cc28fb20f028aca09828bf6d81ad91121be33213cb3d5a3294a" exitCode=0 Jul 02 13:18:44.486964 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:44.486736 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"665e50d9-ebb5-463c-b474-c90eca883098","Type":"ContainerDied","Data":"15c1c927b9c78cc28fb20f028aca09828bf6d81ad91121be33213cb3d5a3294a"} Jul 02 13:18:44.486964 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:44.486832 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"665e50d9-ebb5-463c-b474-c90eca883098","Type":"ContainerStarted","Data":"ac3f457048a89b1e5f1a539cbd09d2a8850fcdbbd0ca92df408c6ec9db9b435e"} Jul 02 13:18:45.494228 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:45.494187 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"665e50d9-ebb5-463c-b474-c90eca883098","Type":"ContainerStarted","Data":"91d2ec62780a3db9aa3cac9661ea7ccd9838e7a9d6ef25b4e3d3d66ae766ee54"} Jul 02 13:18:45.494624 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:45.494254 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"665e50d9-ebb5-463c-b474-c90eca883098","Type":"ContainerStarted","Data":"1d5d898eb9c1b9bd4be84119789b49d9a0e84031c6c0808ef0324d2e3c8d05a7"} Jul 02 13:18:45.494624 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:45.494281 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"665e50d9-ebb5-463c-b474-c90eca883098","Type":"ContainerStarted","Data":"2bdd867e48b92d416ab87c41c96dbfb8caffe74b13b28ae763f1a81a006db643"} Jul 02 13:18:45.494624 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:45.494305 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"665e50d9-ebb5-463c-b474-c90eca883098","Type":"ContainerStarted","Data":"e8700588cf371ad7240baddbf0de25e9fa7dbc2892a17907239d7974f434b9dd"} Jul 02 13:18:45.494624 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:45.494329 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"665e50d9-ebb5-463c-b474-c90eca883098","Type":"ContainerStarted","Data":"09c5d3a1af5972af29dad0ebf635e692e4adbf759e979908d7b746ea0c9fb10d"} Jul 02 13:18:45.494624 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:45.494352 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"665e50d9-ebb5-463c-b474-c90eca883098","Type":"ContainerStarted","Data":"c10e8751376c97936dc709c1a8024261c1d1c6d46a1aec4355c4612ec36270fb"} Jul 02 13:18:45.525052 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:45.524975 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.507353734 podStartE2EDuration="2.524953248s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.599514ms" isStatefulPod=false podCreationTimestamp="2026-07-02 13:18:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:18:45.523207079 +0000 UTC m=+202.413517128" watchObservedRunningTime="2026-07-02 13:18:45.524953248 +0000 UTC m=+202.415263296" Jul 02 13:18:48.857600 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:18:48.857559 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:19:43.857387 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:19:43.857342 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:19:43.873195 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:19:43.873167 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:19:44.733774 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:19:44.733701 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:20:23.497860 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:20:23.497824 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:20:23.500927 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:20:23.500899 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 13:20:23.503177 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:20:23.503147 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:25:23.530072 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:25:23.530043 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:25:23.532160 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:25:23.532134 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:30:23.556995 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:30:23.556919 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:30:23.557849 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:30:23.557798 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:35:23.584332 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:35:23.584304 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:35:23.584997 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:35:23.584974 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:40:23.608348 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:40:23.608322 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:40:23.608905 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:40:23.608760 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:43:35.231692 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.231649 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ckq4l/must-gather-mv8tj"] Jul 02 13:43:35.235012 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.234992 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ckq4l/must-gather-mv8tj" Jul 02 13:43:35.237235 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.237209 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ckq4l\"/\"openshift-service-ca.crt\"" Jul 02 13:43:35.238235 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.238213 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ckq4l\"/\"kube-root-ca.crt\"" Jul 02 13:43:35.238330 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.238217 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ckq4l\"/\"default-dockercfg-hw4ls\"" Jul 02 13:43:35.241683 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.241653 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ckq4l/must-gather-mv8tj"] Jul 02 13:43:35.284573 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.284539 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/48a712ef-1067-4064-9c6b-f270ef2defb2-must-gather-output\") pod \"must-gather-mv8tj\" (UID: \"48a712ef-1067-4064-9c6b-f270ef2defb2\") " pod="openshift-must-gather-ckq4l/must-gather-mv8tj" Jul 02 13:43:35.284757 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.284620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89q9w\" (UniqueName: \"kubernetes.io/projected/48a712ef-1067-4064-9c6b-f270ef2defb2-kube-api-access-89q9w\") pod \"must-gather-mv8tj\" (UID: \"48a712ef-1067-4064-9c6b-f270ef2defb2\") " pod="openshift-must-gather-ckq4l/must-gather-mv8tj" Jul 02 13:43:35.385916 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.385874 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89q9w\" (UniqueName: \"kubernetes.io/projected/48a712ef-1067-4064-9c6b-f270ef2defb2-kube-api-access-89q9w\") pod \"must-gather-mv8tj\" (UID: \"48a712ef-1067-4064-9c6b-f270ef2defb2\") " pod="openshift-must-gather-ckq4l/must-gather-mv8tj" Jul 02 13:43:35.386102 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.385930 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/48a712ef-1067-4064-9c6b-f270ef2defb2-must-gather-output\") pod \"must-gather-mv8tj\" (UID: \"48a712ef-1067-4064-9c6b-f270ef2defb2\") " pod="openshift-must-gather-ckq4l/must-gather-mv8tj" Jul 02 13:43:35.386239 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.386222 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/48a712ef-1067-4064-9c6b-f270ef2defb2-must-gather-output\") pod \"must-gather-mv8tj\" (UID: \"48a712ef-1067-4064-9c6b-f270ef2defb2\") " pod="openshift-must-gather-ckq4l/must-gather-mv8tj" Jul 02 13:43:35.394240 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.394192 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89q9w\" (UniqueName: \"kubernetes.io/projected/48a712ef-1067-4064-9c6b-f270ef2defb2-kube-api-access-89q9w\") pod \"must-gather-mv8tj\" (UID: \"48a712ef-1067-4064-9c6b-f270ef2defb2\") " pod="openshift-must-gather-ckq4l/must-gather-mv8tj" Jul 02 13:43:35.545797 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.545695 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ckq4l/must-gather-mv8tj" Jul 02 13:43:35.677684 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.677655 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ckq4l/must-gather-mv8tj"] Jul 02 13:43:35.680096 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:43:35.680066 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48a712ef_1067_4064_9c6b_f270ef2defb2.slice/crio-3f1fcaf6644cfe095251ff9c6d3163b972da11f1fd4c17a07a9ec25b10afada7 WatchSource:0}: Error finding container 3f1fcaf6644cfe095251ff9c6d3163b972da11f1fd4c17a07a9ec25b10afada7: Status 404 returned error can't find the container with id 3f1fcaf6644cfe095251ff9c6d3163b972da11f1fd4c17a07a9ec25b10afada7 Jul 02 13:43:35.681973 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:35.681953 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 13:43:36.126941 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:36.126898 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ckq4l/must-gather-mv8tj" event={"ID":"48a712ef-1067-4064-9c6b-f270ef2defb2","Type":"ContainerStarted","Data":"3f1fcaf6644cfe095251ff9c6d3163b972da11f1fd4c17a07a9ec25b10afada7"} Jul 02 13:43:37.133822 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:37.133769 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ckq4l/must-gather-mv8tj" event={"ID":"48a712ef-1067-4064-9c6b-f270ef2defb2","Type":"ContainerStarted","Data":"d6d916a2b008f09387a7d336aaab71f7be2b440931faa4589422466689a17d22"} Jul 02 13:43:37.134307 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:37.133856 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ckq4l/must-gather-mv8tj" event={"ID":"48a712ef-1067-4064-9c6b-f270ef2defb2","Type":"ContainerStarted","Data":"03ac06910df87984a5e35a21158c87d90c02d49b480f59463e11816654641171"} Jul 02 13:43:37.151641 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:37.151573 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ckq4l/must-gather-mv8tj" podStartSLOduration=1.393631068 podStartE2EDuration="2.151549308s" totalImagesPullingTime="757.91824ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:43:37.148831899 +0000 UTC m=+1694.039141949" watchObservedRunningTime="2026-07-02 13:43:37.151549308 +0000 UTC m=+1694.041859357" Jul 02 13:43:37.993328 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:37.993284 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n4dh5_8a1ec351-fa5c-4063-805b-df1e9c6cc243/global-pull-secret-syncer/0.log" Jul 02 13:43:38.143894 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:38.143865 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-crfrg_5f6a8fbd-dddf-4cbd-bdb9-5106debe7e1c/konnectivity-agent/0.log" Jul 02 13:43:38.229626 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:38.229596 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-111.ec2.internal_0af90d6e33273b8a76167f3f487fd1b0/haproxy/0.log" Jul 02 13:43:42.760337 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:42.760269 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-22627_e43dc355-ca81-4e48-99ad-a6fd1d8d291c/monitoring-plugin/0.log" Jul 02 13:43:42.797497 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:42.797471 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rqxx4_1d73c669-420a-470c-a82d-1bbc68ce32d4/node-exporter/0.log" Jul 02 13:43:42.822169 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:42.822133 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rqxx4_1d73c669-420a-470c-a82d-1bbc68ce32d4/kube-rbac-proxy/0.log" Jul 02 13:43:42.849942 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:42.849884 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rqxx4_1d73c669-420a-470c-a82d-1bbc68ce32d4/init-textfile/0.log" Jul 02 13:43:43.168454 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:43.168425 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_665e50d9-ebb5-463c-b474-c90eca883098/prometheus/0.log" Jul 02 13:43:43.190444 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:43.190405 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_665e50d9-ebb5-463c-b474-c90eca883098/config-reloader/0.log" Jul 02 13:43:43.224516 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:43.224483 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_665e50d9-ebb5-463c-b474-c90eca883098/thanos-sidecar/0.log" Jul 02 13:43:43.256751 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:43.256696 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_665e50d9-ebb5-463c-b474-c90eca883098/kube-rbac-proxy-web/0.log" Jul 02 13:43:43.287181 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:43.287148 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_665e50d9-ebb5-463c-b474-c90eca883098/kube-rbac-proxy/0.log" Jul 02 13:43:43.312294 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:43.312259 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_665e50d9-ebb5-463c-b474-c90eca883098/kube-rbac-proxy-thanos/0.log" Jul 02 13:43:43.341059 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:43.341022 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_665e50d9-ebb5-463c-b474-c90eca883098/init-config-reloader/0.log" Jul 02 13:43:43.541726 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:43.541630 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f8d69bd8-868h7_384cabb5-ca2c-4758-bdcd-2ea7ed382bfa/thanos-query/0.log" Jul 02 13:43:43.569143 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:43.569110 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f8d69bd8-868h7_384cabb5-ca2c-4758-bdcd-2ea7ed382bfa/kube-rbac-proxy-web/0.log" Jul 02 13:43:43.598204 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:43.598164 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f8d69bd8-868h7_384cabb5-ca2c-4758-bdcd-2ea7ed382bfa/kube-rbac-proxy/0.log" Jul 02 13:43:43.623851 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:43.623795 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f8d69bd8-868h7_384cabb5-ca2c-4758-bdcd-2ea7ed382bfa/prom-label-proxy/0.log" Jul 02 13:43:43.651561 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:43.651525 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f8d69bd8-868h7_384cabb5-ca2c-4758-bdcd-2ea7ed382bfa/kube-rbac-proxy-rules/0.log" Jul 02 13:43:43.677127 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:43.677094 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f8d69bd8-868h7_384cabb5-ca2c-4758-bdcd-2ea7ed382bfa/kube-rbac-proxy-metrics/0.log" Jul 02 13:43:46.658171 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.658118 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9"] Jul 02 13:43:46.664450 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.664414 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.672340 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.672305 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9"] Jul 02 13:43:46.795824 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.795769 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb65ca89-2145-4586-8df1-733950ad3d9f-lib-modules\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.796015 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.795842 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb65ca89-2145-4586-8df1-733950ad3d9f-sys\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.796015 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.795880 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb65ca89-2145-4586-8df1-733950ad3d9f-podres\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.796015 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.795966 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb65ca89-2145-4586-8df1-733950ad3d9f-proc\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.796139 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.796031 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctfhf\" (UniqueName: \"kubernetes.io/projected/fb65ca89-2145-4586-8df1-733950ad3d9f-kube-api-access-ctfhf\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.897491 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.897444 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb65ca89-2145-4586-8df1-733950ad3d9f-proc\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.897689 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.897513 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctfhf\" (UniqueName: \"kubernetes.io/projected/fb65ca89-2145-4586-8df1-733950ad3d9f-kube-api-access-ctfhf\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.897689 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.897590 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb65ca89-2145-4586-8df1-733950ad3d9f-lib-modules\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.897689 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.897622 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb65ca89-2145-4586-8df1-733950ad3d9f-sys\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.897689 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.897663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb65ca89-2145-4586-8df1-733950ad3d9f-podres\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.897924 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.897851 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb65ca89-2145-4586-8df1-733950ad3d9f-sys\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.897924 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.897880 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb65ca89-2145-4586-8df1-733950ad3d9f-lib-modules\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.898029 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.897934 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb65ca89-2145-4586-8df1-733950ad3d9f-proc\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.898082 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.898063 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb65ca89-2145-4586-8df1-733950ad3d9f-podres\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.907272 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.907232 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctfhf\" (UniqueName: \"kubernetes.io/projected/fb65ca89-2145-4586-8df1-733950ad3d9f-kube-api-access-ctfhf\") pod \"perf-node-gather-daemonset-tpgs9\" (UID: \"fb65ca89-2145-4586-8df1-733950ad3d9f\") " pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:46.981028 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:46.980924 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:47.160456 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:47.159785 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9"] Jul 02 13:43:47.164495 ip-10-0-133-111 kubenswrapper[2561]: W0702 13:43:47.164459 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfb65ca89_2145_4586_8df1_733950ad3d9f.slice/crio-1f1929ade7692a25d6f660f3a03820927e3bfe93183bca3ea88ce956a2039690 WatchSource:0}: Error finding container 1f1929ade7692a25d6f660f3a03820927e3bfe93183bca3ea88ce956a2039690: Status 404 returned error can't find the container with id 1f1929ade7692a25d6f660f3a03820927e3bfe93183bca3ea88ce956a2039690 Jul 02 13:43:47.191660 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:47.191583 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" event={"ID":"fb65ca89-2145-4586-8df1-733950ad3d9f","Type":"ContainerStarted","Data":"1f1929ade7692a25d6f660f3a03820927e3bfe93183bca3ea88ce956a2039690"} Jul 02 13:43:47.693654 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:47.693625 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6b2xw_366e6fd3-acec-45ee-95eb-e2378409a2d9/dns/0.log" Jul 02 13:43:47.717288 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:47.717259 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6b2xw_366e6fd3-acec-45ee-95eb-e2378409a2d9/kube-rbac-proxy/0.log" Jul 02 13:43:47.830222 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:47.830188 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dxl9g_2bdc1df0-73e3-4547-896b-304714d02833/dns-node-resolver/0.log" Jul 02 13:43:48.199039 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:48.198998 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" event={"ID":"fb65ca89-2145-4586-8df1-733950ad3d9f","Type":"ContainerStarted","Data":"1f3480a2ecb8deae0b706235552703528594027880ec5138cbc1b2a2488c7edc"} Jul 02 13:43:48.199360 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:48.199332 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:48.216408 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:48.216342 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" podStartSLOduration=2.216318845 podStartE2EDuration="2.216318845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:43:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:43:48.214986813 +0000 UTC m=+1705.105296862" watchObservedRunningTime="2026-07-02 13:43:48.216318845 +0000 UTC m=+1705.106628896" Jul 02 13:43:48.406535 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:48.406499 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j8qj5_613767fc-09e6-4b4a-b525-0fff8120e7d7/node-ca/0.log" Jul 02 13:43:49.700314 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:49.700286 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gkvdd_88b698a4-c42a-4a3d-9707-16d60f7e7b42/serve-healthcheck-canary/0.log" Jul 02 13:43:50.133155 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:50.133075 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8bxfs_25477ed5-78a5-45ef-9321-cb1c6b4aa814/kube-rbac-proxy/0.log" Jul 02 13:43:50.158009 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:50.157977 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8bxfs_25477ed5-78a5-45ef-9321-cb1c6b4aa814/exporter/0.log" Jul 02 13:43:50.183762 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:50.183676 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8bxfs_25477ed5-78a5-45ef-9321-cb1c6b4aa814/extractor/0.log" Jul 02 13:43:54.216875 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:54.216844 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ckq4l/perf-node-gather-daemonset-tpgs9" Jul 02 13:43:57.005363 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:57.005333 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-zgsx5_c13a5450-da76-449b-bf9e-28063a29eeb5/migrator/0.log" Jul 02 13:43:57.028751 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:57.028720 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-zgsx5_c13a5450-da76-449b-bf9e-28063a29eeb5/graceful-termination/0.log" Jul 02 13:43:57.353035 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:57.353006 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-wbjr9_c532bcab-a588-49cb-8b64-4a66a3c04558/kube-storage-version-migrator-operator/1.log" Jul 02 13:43:57.355403 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:57.355366 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-wbjr9_c532bcab-a588-49cb-8b64-4a66a3c04558/kube-storage-version-migrator-operator/0.log" Jul 02 13:43:58.393473 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:58.393423 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8dlht_9082e027-f992-4698-8370-a11ad9c4467d/kube-multus/0.log" Jul 02 13:43:58.451765 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:58.451732 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hpn86_e0d8869e-bf53-419d-a309-080a540fc557/kube-multus-additional-cni-plugins/0.log" Jul 02 13:43:58.475969 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:58.475872 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hpn86_e0d8869e-bf53-419d-a309-080a540fc557/egress-router-binary-copy/0.log" Jul 02 13:43:58.499723 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:58.499692 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hpn86_e0d8869e-bf53-419d-a309-080a540fc557/cni-plugins/0.log" Jul 02 13:43:58.525784 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:58.525759 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hpn86_e0d8869e-bf53-419d-a309-080a540fc557/bond-cni-plugin/0.log" Jul 02 13:43:58.566316 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:58.566282 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hpn86_e0d8869e-bf53-419d-a309-080a540fc557/routeoverride-cni/0.log" Jul 02 13:43:58.590859 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:58.590825 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hpn86_e0d8869e-bf53-419d-a309-080a540fc557/whereabouts-cni-bincopy/0.log" Jul 02 13:43:58.615214 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:58.615186 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hpn86_e0d8869e-bf53-419d-a309-080a540fc557/whereabouts-cni/0.log" Jul 02 13:43:59.056183 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:59.056151 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dqx8f_2f1aa242-11f4-4207-86f5-739e590470b1/network-metrics-daemon/0.log" Jul 02 13:43:59.081817 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:59.081785 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dqx8f_2f1aa242-11f4-4207-86f5-739e590470b1/kube-rbac-proxy/0.log" Jul 02 13:43:59.926923 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:59.926881 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-controller/0.log" Jul 02 13:43:59.947284 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:59.947250 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/1.log" Jul 02 13:43:59.947284 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:59.947270 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovn-acl-logging/0.log" Jul 02 13:43:59.969722 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:59.969689 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/kube-rbac-proxy-node/0.log" Jul 02 13:43:59.993386 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:43:59.993355 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 13:44:00.014397 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:44:00.014348 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/northd/0.log" Jul 02 13:44:00.039562 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:44:00.039534 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/nbdb/0.log" Jul 02 13:44:00.063836 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:44:00.063792 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/sbdb/0.log" Jul 02 13:44:00.121756 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:44:00.121716 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4p5pk_b2ddf1fc-da82-425b-9781-890ab6e30d11/ovnkube-controller/0.log" Jul 02 13:44:01.577171 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:44:01.577143 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56499946bc-42xgd_a698b1ab-fe33-470f-889a-b40ed4fea58c/check-endpoints/0.log" Jul 02 13:44:01.654781 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:44:01.654747 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pnkz8_d10166f9-2429-430f-9afa-92cda8651df9/network-check-target-container/0.log" Jul 02 13:44:02.667915 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:44:02.667886 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-klrj5_927b0641-f215-415b-854d-98668f379177/iptables-alerter/0.log" Jul 02 13:44:03.424269 ip-10-0-133-111 kubenswrapper[2561]: I0702 13:44:03.424238 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-xw4f6_c648e181-461c-41a6-9dec-618c0fa65db4/tuned/0.log"