Jul 28 07:44:29.130913 ip-10-0-132-33 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 28 07:44:29.130923 ip-10-0-132-33 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 28 07:44:29.130929 ip-10-0-132-33 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 28 07:44:29.131135 ip-10-0-132-33 systemd[1]: Failed to start Kubernetes Kubelet. Jul 28 07:44:38.566264 ip-10-0-132-33 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 28 07:44:38.566278 ip-10-0-132-33 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8895c4bcf8ae46df856d9b757a1cc10d -- Jul 28 07:46:07.586027 ip-10-0-132-33 systemd[1]: Starting Kubernetes Kubelet... Jul 28 07:46:08.032263 ip-10-0-132-33 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 07:46:08.032263 ip-10-0-132-33 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 07:46:08.032263 ip-10-0-132-33 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 07:46:08.032263 ip-10-0-132-33 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 07:46:08.032263 ip-10-0-132-33 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 07:46:08.032979 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.032324 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 07:46:08.038148 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038130 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 07:46:08.038148 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038147 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038151 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038155 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038158 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038161 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038164 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038166 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038169 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038172 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038175 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038178 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038180 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038183 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038186 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038188 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038191 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038193 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038196 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038198 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038201 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 07:46:08.038220 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038203 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038211 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038214 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038216 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038219 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038221 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038224 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038227 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038230 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038232 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038235 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038237 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038240 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038243 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038246 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038249 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038251 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038260 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038262 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 07:46:08.038717 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038265 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038267 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038271 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038275 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038278 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038281 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038284 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038287 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038289 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038291 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038294 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038297 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038299 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038302 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038304 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038308 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038311 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038313 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038316 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 07:46:08.039165 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038319 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038321 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038324 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038327 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038329 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038332 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038334 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038337 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038340 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038342 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038344 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038347 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038350 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038352 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038355 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038357 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038360 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038363 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038366 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038369 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 07:46:08.039678 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038371 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038374 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038376 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038380 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038383 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038386 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038389 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038392 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038395 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038398 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038401 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038403 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038406 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038408 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038411 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038413 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038416 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038419 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038423 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 07:46:08.040157 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.038426 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039127 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039133 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039136 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039139 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039142 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039145 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039148 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039150 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039153 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039156 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039159 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039162 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039164 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039167 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039170 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039172 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039175 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039178 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039181 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 07:46:08.040626 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039184 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039187 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039200 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039205 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039209 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039212 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039216 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039220 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039223 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039227 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039229 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039232 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039235 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039237 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039240 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039243 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039246 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039248 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039251 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 07:46:08.041121 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039253 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039256 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039258 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039261 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039263 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039266 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039268 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039271 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039274 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039276 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039279 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039281 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039285 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039288 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039292 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039296 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039299 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039302 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039306 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 07:46:08.041570 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039308 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039311 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039314 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039316 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039319 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039322 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039324 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039327 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039329 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039332 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039334 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039337 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039339 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039342 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039344 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039347 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039349 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039352 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039355 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039357 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 07:46:08.042046 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039360 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039362 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039365 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039367 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039370 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039373 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039375 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039380 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039383 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039386 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039389 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039391 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039394 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039396 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039399 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039401 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039404 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039406 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039409 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039411 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 07:46:08.042527 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039414 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039416 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039815 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039820 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039823 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039827 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039829 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039832 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039835 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039837 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039840 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039843 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039846 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039849 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039851 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039854 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039857 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039860 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039863 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 07:46:08.043022 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039865 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039868 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039870 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039873 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039875 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039878 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039880 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039883 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039885 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039888 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039890 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039893 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039895 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039898 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039901 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039903 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039905 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039907 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039910 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 07:46:08.043491 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039913 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039915 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039918 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039920 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039923 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039925 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039930 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039933 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039937 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039940 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039943 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039946 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039948 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039951 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039953 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039956 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039960 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039962 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039965 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039967 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 07:46:08.044000 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039970 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039972 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039975 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039978 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.039996 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040000 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040003 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040007 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040011 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040014 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040018 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040021 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040024 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040027 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040029 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040032 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040034 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040037 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040040 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040042 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 07:46:08.044483 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040045 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040050 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040053 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040059 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040062 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040065 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040068 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040070 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040073 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040075 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040077 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040080 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040082 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040085 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040088 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040090 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040093 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040095 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040098 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040100 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 07:46:08.044974 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040103 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040105 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040107 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040176 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040184 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040190 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040196 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040202 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040207 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040213 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040220 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040225 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040228 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040232 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040235 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040238 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040241 2561 flags.go:64] FLAG: --cgroup-root="" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040244 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040247 2561 flags.go:64] FLAG: --client-ca-file="" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040250 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040253 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040257 2561 flags.go:64] FLAG: --cluster-domain="" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040260 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040263 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 07:46:08.045446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040266 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040269 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040273 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040276 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040279 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040282 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040285 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040288 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040291 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040294 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040297 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040301 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040304 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040306 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040309 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040312 2561 flags.go:64] FLAG: --enable-server="true" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040315 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040319 2561 flags.go:64] FLAG: --event-burst="100" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040322 2561 flags.go:64] FLAG: --event-qps="50" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040325 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040329 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040332 2561 flags.go:64] FLAG: --eviction-hard="" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040335 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040338 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040341 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 07:46:08.046017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040345 2561 flags.go:64] FLAG: --eviction-soft="" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040347 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040350 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040353 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040356 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040359 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040362 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040365 2561 flags.go:64] FLAG: --feature-gates="" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040368 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040371 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040374 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040377 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040380 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040383 2561 flags.go:64] FLAG: --help="false" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040385 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040388 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040391 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040394 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040397 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040401 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040404 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040406 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040409 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 07:46:08.046627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040412 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040414 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040417 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040420 2561 flags.go:64] FLAG: --kube-reserved="" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040423 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040426 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040430 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040433 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040436 2561 flags.go:64] FLAG: --lock-file="" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040452 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040456 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040459 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040465 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040468 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040471 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040473 2561 flags.go:64] FLAG: --logging-format="text" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040476 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040480 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040482 2561 flags.go:64] FLAG: --manifest-url="" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040485 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040489 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040492 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040496 2561 flags.go:64] FLAG: --max-pods="110" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040499 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040502 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 07:46:08.047212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040505 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040508 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040511 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040513 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040516 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040523 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040526 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040529 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040532 2561 flags.go:64] FLAG: --pod-cidr="" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040535 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040541 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040544 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040547 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040550 2561 flags.go:64] FLAG: --port="10250" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040554 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040556 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-086a44899a7e7e6b4" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040559 2561 flags.go:64] FLAG: --qos-reserved="" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040562 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040565 2561 flags.go:64] FLAG: --register-node="true" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040568 2561 flags.go:64] FLAG: --register-with-taints="" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040571 2561 flags.go:64] FLAG: --registry-burst="10" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040574 2561 flags.go:64] FLAG: --registry-qps="5" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040577 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040579 2561 flags.go:64] FLAG: --reserved-memory="" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040583 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 07:46:08.047907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040586 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040589 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040591 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040594 2561 flags.go:64] FLAG: --runonce="false" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040597 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040600 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040602 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040619 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040622 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040625 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040628 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040632 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040634 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040637 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040640 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040643 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040646 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040649 2561 flags.go:64] FLAG: --system-cgroups="" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040652 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040657 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040663 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040666 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040670 2561 flags.go:64] FLAG: --tls-min-version="" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040673 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040676 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 07:46:08.048575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040679 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040681 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040684 2561 flags.go:64] FLAG: --v="2" Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040688 2561 flags.go:64] FLAG: --version="false" Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040692 2561 flags.go:64] FLAG: --vmodule="" Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040696 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.040699 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040819 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040823 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040826 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040830 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040833 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040836 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040838 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040840 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040843 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040845 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040848 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040851 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040853 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040856 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 07:46:08.049207 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040858 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040861 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040864 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040866 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040868 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040871 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040877 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040879 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040886 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040889 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040891 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040894 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040896 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040899 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040901 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040904 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040906 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040909 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040911 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040913 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 07:46:08.049733 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040916 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040918 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040921 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040923 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040926 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040929 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040932 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040934 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040937 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040939 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040941 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040944 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040946 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040949 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040952 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040954 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040956 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040959 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040964 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 07:46:08.050215 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040967 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040971 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040974 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040978 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040980 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040983 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040986 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040988 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040991 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040993 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040995 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.040998 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041001 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041003 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041006 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041009 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041011 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041014 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041016 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041019 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 07:46:08.050684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041021 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041024 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041026 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041028 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041031 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041033 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041036 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041038 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041041 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041043 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041046 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041052 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041054 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041057 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041059 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041062 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041065 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041067 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041070 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041072 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 07:46:08.051166 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041075 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 07:46:08.051666 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041078 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 07:46:08.051666 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041080 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 07:46:08.051666 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041084 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 07:46:08.051666 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041087 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 07:46:08.051666 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.041091 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 07:46:08.051666 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.041933 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 07:46:08.051666 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.049914 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 07:46:08.051666 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.049932 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 07:46:08.051666 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.050989 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 07:46:08.051666 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.050997 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 07:46:08.051666 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051071 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 07:46:08.051666 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051078 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 07:46:08.051666 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051081 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 07:46:08.051666 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051085 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051088 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051090 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051093 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051096 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051099 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051102 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051104 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051106 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051109 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051111 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051114 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051116 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051119 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051121 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051124 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051127 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051129 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051132 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051134 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 07:46:08.052011 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051137 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051139 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051142 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051144 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051147 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051150 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051159 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051162 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051164 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051168 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051172 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051175 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051178 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051181 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051183 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051186 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051188 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051191 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051195 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 07:46:08.052482 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051198 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051201 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051204 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051206 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051209 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051211 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051214 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051216 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051219 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051221 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051223 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051226 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051228 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051231 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051233 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051236 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051238 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051241 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051243 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051246 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 07:46:08.052980 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051254 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051256 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051259 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051261 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051263 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051266 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051269 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051271 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051274 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051276 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051279 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051281 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051284 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051286 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051289 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051291 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051293 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051296 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051298 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051301 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 07:46:08.053447 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051303 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051305 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051308 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051310 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051313 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051315 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051318 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051321 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051323 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051326 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051328 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051330 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051333 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051340 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051344 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051346 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 07:46:08.053943 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051349 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.051354 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051509 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051514 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051517 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051520 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051523 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051526 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051529 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051531 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051534 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051537 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051540 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051542 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051545 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 07:46:08.054342 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051548 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051550 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051552 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051555 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051558 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051560 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051563 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051565 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051568 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051572 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051575 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051578 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051580 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051582 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051585 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051593 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051596 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051599 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051601 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 07:46:08.054772 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051603 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051624 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051627 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051630 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051632 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051635 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051637 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051640 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051642 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051645 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051647 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051649 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051652 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051655 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051657 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051659 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051662 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051665 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051668 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051670 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 07:46:08.055478 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051673 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051676 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051678 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051681 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051683 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051686 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051689 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051691 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051694 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051704 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051706 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051710 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051714 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051717 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051719 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051723 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051726 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051729 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051732 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 07:46:08.056212 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051735 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051738 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051740 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051742 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051745 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051747 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051750 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051752 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051755 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051757 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051760 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051762 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051765 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051767 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051778 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051781 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051783 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051786 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051788 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051791 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 07:46:08.056700 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051793 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 07:46:08.057211 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051795 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 07:46:08.057211 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051798 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 07:46:08.057211 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051806 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 07:46:08.057211 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051808 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 07:46:08.057211 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051811 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 07:46:08.057211 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051813 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 07:46:08.057211 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:08.051816 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 07:46:08.057211 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.051821 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 07:46:08.057211 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.051943 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 07:46:08.057211 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.054184 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 07:46:08.057698 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.057669 2561 server.go:1019] "Starting client certificate rotation" Jul 28 07:46:08.057786 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.057768 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 07:46:08.057823 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.057804 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 07:46:08.061601 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.061587 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 07:46:08.062740 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.062726 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 07:46:08.078595 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.078574 2561 log.go:25] "Validated CRI v1 runtime API" Jul 28 07:46:08.081307 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.081291 2561 log.go:25] "Validated CRI v1 image API" Jul 28 07:46:08.082829 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.082683 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 07:46:08.086178 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.086160 2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 86fef495-5f43-405c-8308-af4abda708de:/dev/nvme0n1p4 e6f36512-ae8f-4163-8977-7af26bdeda42:/dev/nvme0n1p3] Jul 28 07:46:08.086240 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.086178 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 07:46:08.086816 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.086797 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 07:46:08.092076 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.091966 2561 manager.go:216] Machine: {Timestamp:2026-07-28 07:46:08.091481964 +0000 UTC m=+0.373291797 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098487 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2382df58c2b182cbc27538bcb7fcef SystemUUID:ec2382df-58c2-b182-cbc2-7538bcb7fcef BootID:8895c4bc-f8ae-46df-856d-9b757a1cc10d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bf:ba:31:00:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bf:ba:31:00:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:24:4a:59:ac:b0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 07:46:08.092076 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.092073 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 07:46:08.092186 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.092171 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 07:46:08.095580 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.095552 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 07:46:08.095730 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.095583 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-33.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 07:46:08.096376 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.096367 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 07:46:08.096411 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.096379 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 07:46:08.096411 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.096386 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 07:46:08.097241 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.097231 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 07:46:08.099072 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.099062 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 07:46:08.102001 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.101988 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 28 07:46:08.102123 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.102113 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 07:46:08.102166 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.102143 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 28 07:46:08.102166 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.102153 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 07:46:08.102166 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.102166 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 07:46:08.102275 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.102175 2561 kubelet.go:398] "Adding apiserver pod source" Jul 28 07:46:08.102275 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.102183 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 07:46:08.102652 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.102633 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 07:46:08.102710 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.102669 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 07:46:08.106013 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.105988 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 07:46:08.108457 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.108441 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 07:46:08.108514 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.108485 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 07:46:08.110732 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.110720 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 07:46:08.110775 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.110736 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 07:46:08.110775 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.110742 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 07:46:08.110775 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.110748 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 07:46:08.110775 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.110756 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 07:46:08.110775 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.110762 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 07:46:08.110775 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.110770 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 07:46:08.110775 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.110775 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 07:46:08.110946 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.110784 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 07:46:08.110946 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.110791 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 07:46:08.110946 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.110803 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 07:46:08.110946 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.110808 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 07:46:08.111695 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.111682 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 07:46:08.111731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.111699 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 07:46:08.114815 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.114802 2561 server.go:1268] "Started kubelet" Jul 28 07:46:08.114948 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.114917 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 07:46:08.115226 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.114893 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 07:46:08.115226 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.115202 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 07:46:08.115760 ip-10-0-132-33 systemd[1]: Started Kubernetes Kubelet. Jul 28 07:46:08.117687 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.117671 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 28 07:46:08.118282 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.118261 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-33.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 07:46:08.119024 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.118996 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 07:46:08.119127 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.119112 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 07:46:08.119822 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.119805 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 07:46:08.122212 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.122195 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 07:46:08.128298 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.128275 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 07:46:08.128298 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.128291 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 07:46:08.128431 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.128354 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found" Jul 28 07:46:08.129051 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.129012 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 07:46:08.129051 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.129051 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 07:46:08.129182 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.129163 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 28 07:46:08.129182 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.129171 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 28 07:46:08.129253 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.129190 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 07:46:08.129253 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.129244 2561 factory.go:55] Registering systemd factory Jul 28 07:46:08.129346 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.129277 2561 factory.go:223] Registration of the systemd container factory successfully Jul 28 07:46:08.129633 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.129593 2561 factory.go:153] Registering CRI-O factory Jul 28 07:46:08.129633 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.129626 2561 factory.go:223] Registration of the crio container factory successfully Jul 28 07:46:08.129757 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.129679 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 07:46:08.129757 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.129700 2561 factory.go:103] Registering Raw factory Jul 28 07:46:08.129757 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.129717 2561 manager.go:1196] Started watching for new ooms in manager Jul 28 07:46:08.130135 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.130112 2561 manager.go:349] Starting recovery of all containers Jul 28 07:46:08.131057 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.129901 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-33.ec2.internal.18c66477d3b5c696 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-33.ec2.internal,UID:ip-10-0-132-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-33.ec2.internal,},FirstTimestamp:2026-07-28 07:46:08.114771606 +0000 UTC m=+0.396581439,LastTimestamp:2026-07-28 07:46:08.114771606 +0000 UTC m=+0.396581439,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-33.ec2.internal,}" Jul 28 07:46:08.140114 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.140042 2561 manager.go:354] Recovery completed Jul 28 07:46:08.146540 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.146514 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 07:46:08.146642 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.146537 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 07:46:08.146735 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.146722 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 07:46:08.148643 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.148620 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory" Jul 28 07:46:08.148706 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.148658 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 07:46:08.148706 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.148672 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID" Jul 28 07:46:08.149223 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.149197 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 07:46:08.149223 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.149222 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 07:46:08.149309 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.149237 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 28 07:46:08.149309 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.149210 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 07:46:08.149900 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.149886 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory" Jul 28 07:46:08.150026 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.149916 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 07:46:08.150026 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.149932 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID" Jul 28 07:46:08.151197 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.151184 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4rwq8" Jul 28 07:46:08.151981 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.151964 2561 policy_none.go:49] "None policy: Start" Jul 28 07:46:08.151981 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.151984 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 07:46:08.152155 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.151997 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 07:46:08.154014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.154000 2561 policy_none.go:47] "Start" Jul 28 07:46:08.161100 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.161037 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-33.ec2.internal.18c66477d5ba9ed3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-33.ec2.internal,UID:ip-10-0-132-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-33.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-33.ec2.internal,},FirstTimestamp:2026-07-28 07:46:08.148643539 +0000 UTC m=+0.430453372,LastTimestamp:2026-07-28 07:46:08.148643539 +0000 UTC m=+0.430453372,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-33.ec2.internal,}" Jul 28 07:46:08.161481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.161462 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4rwq8" Jul 28 07:46:08.185268 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.185142 2561 manager.go:337] "Starting Device Plugin manager" Jul 28 07:46:08.210860 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.185288 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 07:46:08.210860 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.185302 2561 server.go:87] "Starting device plugin registration server" Jul 28 07:46:08.210860 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.185501 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 07:46:08.210860 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.185511 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 07:46:08.210860 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.185643 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 07:46:08.210860 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.185724 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 07:46:08.210860 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.185733 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 07:46:08.210860 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.186141 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 07:46:08.210860 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.186185 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-33.ec2.internal\" not found" Jul 28 07:46:08.226640 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.226600 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 07:46:08.227872 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.227856 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 07:46:08.227948 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.227898 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 07:46:08.227948 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.227922 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 07:46:08.228038 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.227960 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 07:46:08.231035 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.231019 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 07:46:08.285766 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.285716 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 07:46:08.286523 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.286498 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory" Jul 28 07:46:08.286603 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.286538 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 07:46:08.286603 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.286563 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID" Jul 28 07:46:08.286603 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.286588 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.300860 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.300842 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.300910 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.300864 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-33.ec2.internal\": node \"ip-10-0-132-33.ec2.internal\" not found" Jul 28 07:46:08.328486 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.328465 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"] Jul 28 07:46:08.328579 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.328522 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 07:46:08.329747 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.329732 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory" Jul 28 07:46:08.329814 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.329759 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 07:46:08.329814 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.329770 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID" Jul 28 07:46:08.332031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.332019 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 07:46:08.332160 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.332147 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.332195 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.332176 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 07:46:08.332659 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.332639 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory" Jul 28 07:46:08.332737 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.332674 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 07:46:08.332737 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.332687 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID" Jul 28 07:46:08.332737 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.332640 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory" Jul 28 07:46:08.332836 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.332744 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 07:46:08.332836 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.332754 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID" Jul 28 07:46:08.334866 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.334848 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.334938 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.334870 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 07:46:08.335505 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.335488 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory" Jul 28 07:46:08.335584 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.335519 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 07:46:08.335584 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.335536 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID" Jul 28 07:46:08.352662 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.352641 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found" Jul 28 07:46:08.360203 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.360184 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-33.ec2.internal\" not found" node="ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.364457 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.364440 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-33.ec2.internal\" not found" node="ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.429715 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.429694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4024f16ee72121162c0202a5aa0fcfc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"a4024f16ee72121162c0202a5aa0fcfc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.429831 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.429721 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4024f16ee72121162c0202a5aa0fcfc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"a4024f16ee72121162c0202a5aa0fcfc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.453732 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.453703 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found" Jul 28 07:46:08.530314 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.530291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4024f16ee72121162c0202a5aa0fcfc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"a4024f16ee72121162c0202a5aa0fcfc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.530380 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.530339 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4024f16ee72121162c0202a5aa0fcfc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"a4024f16ee72121162c0202a5aa0fcfc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.530380 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.530364 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4024f16ee72121162c0202a5aa0fcfc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"a4024f16ee72121162c0202a5aa0fcfc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.530445 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.530404 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fcb9bcfc43c07955a28965fcba36e638-config\") pod \"kube-apiserver-proxy-ip-10-0-132-33.ec2.internal\" (UID: \"fcb9bcfc43c07955a28965fcba36e638\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.530476 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.530444 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4024f16ee72121162c0202a5aa0fcfc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"a4024f16ee72121162c0202a5aa0fcfc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.554447 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.554395 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found" Jul 28 07:46:08.631014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.630991 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fcb9bcfc43c07955a28965fcba36e638-config\") pod \"kube-apiserver-proxy-ip-10-0-132-33.ec2.internal\" (UID: \"fcb9bcfc43c07955a28965fcba36e638\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.631086 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.631024 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fcb9bcfc43c07955a28965fcba36e638-config\") pod \"kube-apiserver-proxy-ip-10-0-132-33.ec2.internal\" (UID: \"fcb9bcfc43c07955a28965fcba36e638\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.655136 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.655102 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found" Jul 28 07:46:08.662264 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.662248 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.667215 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.667008 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal" Jul 28 07:46:08.756248 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.756207 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found" Jul 28 07:46:08.856717 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:08.856652 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found" Jul 28 07:46:08.945975 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:08.945947 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 07:46:09.029549 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.029513 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" Jul 28 07:46:09.045190 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.045166 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 07:46:09.047046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.047030 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal" Jul 28 07:46:09.056698 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.056681 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 07:46:09.056776 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.056684 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 07:46:09.056842 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.056819 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 07:46:09.102860 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.102837 2561 apiserver.go:52] "Watching apiserver" Jul 28 07:46:09.112105 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.112065 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 07:46:09.112509 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.112490 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal","openshift-cluster-node-tuning-operator/tuned-jnhb4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal","openshift-network-diagnostics/network-check-target-47rf9","openshift-network-operator/iptables-alerter-49pdt","openshift-ovn-kubernetes/ovnkube-node-wmf27","kube-system/global-pull-secret-syncer-bwskd","kube-system/konnectivity-agent-d5b87","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr","openshift-dns/node-resolver-9g4sg","openshift-image-registry/node-ca-t7gkh","openshift-multus/multus-477cl","openshift-multus/multus-additional-cni-plugins-zhxs5","openshift-multus/network-metrics-daemon-dnr4f"] Jul 28 07:46:09.115310 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.115282 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:09.115406 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.115365 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:09.117579 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.117555 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.119750 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.119730 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:09.119827 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.119806 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:09.120313 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.120293 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 07:46:09.120900 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.120756 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 07:46:09.120900 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.120796 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 07:46:09.120900 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.120801 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 07:46:09.120900 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.120808 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 07:46:09.120900 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.120836 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ckhxn\"" Jul 28 07:46:09.121850 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.121834 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:09.121940 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.121885 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:09.123977 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.123956 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-49pdt" Jul 28 07:46:09.126107 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.126088 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.128281 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.128265 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 07:46:09.128407 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.128265 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 07:46:09.128407 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.128378 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 07:46:09.128407 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.128398 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.129043 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.129027 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 07:46:09.129119 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.129039 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 07:46:09.129119 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.129031 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 07:46:09.129878 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.129862 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 07:46:09.129974 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.129893 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 07:46:09.129974 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.129903 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bhshg\"" Jul 28 07:46:09.129974 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.129957 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 07:46:09.130130 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.129896 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 07:46:09.130244 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.130229 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dkcfq\"" Jul 28 07:46:09.130755 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.130738 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d5b87" Jul 28 07:46:09.131329 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.131312 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 07:46:09.131667 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.131654 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 07:46:09.132636 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.132450 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rxhhk\"" Jul 28 07:46:09.133029 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.133008 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.134393 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134373 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/685a74dc-0091-47e0-9a6a-0eab75ab6c43-env-overrides\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.134500 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b2cd0036-f48f-420a-a174-ef97de31aede-agent-certs\") pod \"konnectivity-agent-d5b87\" (UID: \"b2cd0036-f48f-420a-a174-ef97de31aede\") " pod="kube-system/konnectivity-agent-d5b87" Jul 28 07:46:09.134500 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134429 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b04c48a0-8584-41c2-988e-c44e79c4a7a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.134500 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134453 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pkzk\" (UniqueName: \"kubernetes.io/projected/c79dbe4b-fc12-4534-9cc4-be27338b0967-kube-api-access-8pkzk\") pod \"network-metrics-daemon-dnr4f\" (UID: \"c79dbe4b-fc12-4534-9cc4-be27338b0967\") " pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:09.134500 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134479 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-var-lib-openvswitch\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.134729 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134507 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 07:46:09.134729 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134509 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-etc-openvswitch\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.134729 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134565 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 07:46:09.134729 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134574 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-run-ovn\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.134729 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134572 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t2kws\"" Jul 28 07:46:09.134729 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134600 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.134729 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134642 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-registration-dir\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.134729 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134665 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-etc-selinux\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.134729 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134688 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b04c48a0-8584-41c2-988e-c44e79c4a7a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.134729 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134715 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-run-netns\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.134729 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134695 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134739 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/685a74dc-0091-47e0-9a6a-0eab75ab6c43-ovnkube-config\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134799 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/764467bb-de90-44d5-bbe3-5a1bfc57a04a-kubelet-config\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134840 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/764467bb-de90-44d5-bbe3-5a1bfc57a04a-dbus\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134867 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134899 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhv4s\" (UniqueName: \"kubernetes.io/projected/b04c48a0-8584-41c2-988e-c44e79c4a7a5-kube-api-access-hhv4s\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpbxx\" (UniqueName: \"kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx\") pod \"network-check-target-47rf9\" (UID: \"c00766d2-de01-45bb-a127-7ace967dbbc5\") " pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134942 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxthz\" (UniqueName: \"kubernetes.io/projected/bf6d0d35-3f02-44f3-9e18-845a18c19b4b-kube-api-access-gxthz\") pod \"iptables-alerter-49pdt\" (UID: \"bf6d0d35-3f02-44f3-9e18-845a18c19b4b\") " pod="openshift-network-operator/iptables-alerter-49pdt" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.134998 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-kubelet\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-node-log\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135051 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-socket-dir\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135077 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b04c48a0-8584-41c2-988e-c44e79c4a7a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135109 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-run-openvswitch\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135147 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhnpg\" (UniqueName: \"kubernetes.io/projected/685a74dc-0091-47e0-9a6a-0eab75ab6c43-kube-api-access-jhnpg\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135168 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvbzc\" (UniqueName: \"kubernetes.io/projected/b19241fe-e222-4a3f-b604-0ac288158399-kube-api-access-xvbzc\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.135227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135198 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs\") pod \"network-metrics-daemon-dnr4f\" (UID: \"c79dbe4b-fc12-4534-9cc4-be27338b0967\") " pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135221 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-systemd-units\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135236 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-slash\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135255 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/685a74dc-0091-47e0-9a6a-0eab75ab6c43-ovn-node-metrics-cert\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135269 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/685a74dc-0091-47e0-9a6a-0eab75ab6c43-ovnkube-script-lib\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135304 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b04c48a0-8584-41c2-988e-c44e79c4a7a5-system-cni-dir\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-cni-netd\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135339 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9g4sg" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135370 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b2cd0036-f48f-420a-a174-ef97de31aede-konnectivity-ca\") pod \"konnectivity-agent-d5b87\" (UID: \"b2cd0036-f48f-420a-a174-ef97de31aede\") " pod="kube-system/konnectivity-agent-d5b87" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135402 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-device-dir\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-sys-fs\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135501 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135512 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b04c48a0-8584-41c2-988e-c44e79c4a7a5-cnibin\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135535 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b04c48a0-8584-41c2-988e-c44e79c4a7a5-os-release\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135548 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135583 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bf6d0d35-3f02-44f3-9e18-845a18c19b4b-iptables-alerter-script\") pod \"iptables-alerter-49pdt\" (UID: \"bf6d0d35-3f02-44f3-9e18-845a18c19b4b\") " pod="openshift-network-operator/iptables-alerter-49pdt" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135507 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dxl8m\"" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf6d0d35-3f02-44f3-9e18-845a18c19b4b-host-slash\") pod \"iptables-alerter-49pdt\" (UID: \"bf6d0d35-3f02-44f3-9e18-845a18c19b4b\") " pod="openshift-network-operator/iptables-alerter-49pdt" Jul 28 07:46:09.135994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-run-systemd\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.137008 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135719 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b04c48a0-8584-41c2-988e-c44e79c4a7a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.137008 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135754 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-log-socket\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.137008 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135784 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-run-ovn-kubernetes\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.137008 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.135811 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-cni-bin\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.137543 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.137527 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 07:46:09.137693 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.137676 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 07:46:09.137693 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.137685 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2sh24\"" Jul 28 07:46:09.137815 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.137675 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t7gkh" Jul 28 07:46:09.139960 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.139945 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 07:46:09.140370 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.140350 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-477cl" Jul 28 07:46:09.140468 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.140454 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 07:46:09.141177 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.141157 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vtp7l\"" Jul 28 07:46:09.141263 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.141228 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 07:46:09.142836 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.142818 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 07:46:09.142985 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.142971 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hj98f\"" Jul 28 07:46:09.144239 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.144224 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 07:46:09.167357 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.167304 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 07:41:09 +0000 UTC" deadline="2028-03-05 23:37:00.548825488 +0000 UTC" Jul 28 07:46:09.167357 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.167356 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14079h50m51.381473502s" Jul 28 07:46:09.170466 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.170449 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k6g5c" Jul 28 07:46:09.179908 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.179889 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k6g5c" Jul 28 07:46:09.229927 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.229842 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 07:46:09.236003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.235982 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs\") pod \"network-metrics-daemon-dnr4f\" (UID: \"c79dbe4b-fc12-4534-9cc4-be27338b0967\") " pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:09.236097 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236014 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/685a74dc-0091-47e0-9a6a-0eab75ab6c43-ovnkube-script-lib\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.236097 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236043 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-run-netns\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.236199 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.236147 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 07:46:09.236199 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236153 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b04c48a0-8584-41c2-988e-c44e79c4a7a5-system-cni-dir\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.236199 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236181 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b2cd0036-f48f-420a-a174-ef97de31aede-konnectivity-ca\") pod \"konnectivity-agent-d5b87\" (UID: \"b2cd0036-f48f-420a-a174-ef97de31aede\") " pod="kube-system/konnectivity-agent-d5b87" Jul 28 07:46:09.236336 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236205 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-modprobe-d\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.236336 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236228 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b04c48a0-8584-41c2-988e-c44e79c4a7a5-system-cni-dir\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.236336 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236232 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f7f6e438-4728-48e0-8506-c771771bcb7b-hosts-file\") pod \"node-resolver-9g4sg\" (UID: \"f7f6e438-4728-48e0-8506-c771771bcb7b\") " pod="openshift-dns/node-resolver-9g4sg" Jul 28 07:46:09.236336 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.236267 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs podName:c79dbe4b-fc12-4534-9cc4-be27338b0967 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:09.736245207 +0000 UTC m=+2.018055040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs") pod "network-metrics-daemon-dnr4f" (UID: "c79dbe4b-fc12-4534-9cc4-be27338b0967") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 07:46:09.236336 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236315 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-var-lib-cni-multus\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.236571 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236345 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-device-dir\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.236571 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236388 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-sys-fs\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.236571 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b04c48a0-8584-41c2-988e-c44e79c4a7a5-cnibin\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.236571 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236423 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-device-dir\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.236571 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236433 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b04c48a0-8584-41c2-988e-c44e79c4a7a5-os-release\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.236571 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236471 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b04c48a0-8584-41c2-988e-c44e79c4a7a5-cnibin\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.236571 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236492 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-sys-fs\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.236571 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236501 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/685a74dc-0091-47e0-9a6a-0eab75ab6c43-env-overrides\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.236571 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236536 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-kubernetes\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.236571 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-tuned\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236587 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9a3c30e-bec9-4339-bb7a-caecdd1b0684-host\") pod \"node-ca-t7gkh\" (UID: \"c9a3c30e-bec9-4339-bb7a-caecdd1b0684\") " pod="openshift-image-registry/node-ca-t7gkh" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236589 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b04c48a0-8584-41c2-988e-c44e79c4a7a5-os-release\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236631 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/685a74dc-0091-47e0-9a6a-0eab75ab6c43-ovnkube-script-lib\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b04c48a0-8584-41c2-988e-c44e79c4a7a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236677 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-cni-bin\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236736 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-host\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236774 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-os-release\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236763 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-cni-bin\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236795 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-multus-socket-dir-parent\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236812 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b04c48a0-8584-41c2-988e-c44e79c4a7a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236836 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b04c48a0-8584-41c2-988e-c44e79c4a7a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236872 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-run-ovn\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-sysconfig\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236911 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/685a74dc-0091-47e0-9a6a-0eab75ab6c43-env-overrides\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-sysctl-conf\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236957 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-multus-conf-dir\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.237031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236971 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-run-ovn\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.236988 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-registration-dir\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237041 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b04c48a0-8584-41c2-988e-c44e79c4a7a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237067 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237088 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-registration-dir\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237068 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-run-netns\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237133 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-run-netns\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237131 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237165 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/685a74dc-0091-47e0-9a6a-0eab75ab6c43-ovnkube-config\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237199 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-lib-modules\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237221 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-tmp\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237309 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b04c48a0-8584-41c2-988e-c44e79c4a7a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237454 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/764467bb-de90-44d5-bbe3-5a1bfc57a04a-kubelet-config\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237545 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/764467bb-de90-44d5-bbe3-5a1bfc57a04a-kubelet-config\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:09.237787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237564 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b04c48a0-8584-41c2-988e-c44e79c4a7a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237576 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b2cd0036-f48f-420a-a174-ef97de31aede-konnectivity-ca\") pod \"konnectivity-agent-d5b87\" (UID: \"b2cd0036-f48f-420a-a174-ef97de31aede\") " pod="kube-system/konnectivity-agent-d5b87" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237583 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhv4s\" (UniqueName: \"kubernetes.io/projected/b04c48a0-8584-41c2-988e-c44e79c4a7a5-kube-api-access-hhv4s\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.237690 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237709 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxthz\" (UniqueName: \"kubernetes.io/projected/bf6d0d35-3f02-44f3-9e18-845a18c19b4b-kube-api-access-gxthz\") pod \"iptables-alerter-49pdt\" (UID: \"bf6d0d35-3f02-44f3-9e18-845a18c19b4b\") " pod="openshift-network-operator/iptables-alerter-49pdt" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237727 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/685a74dc-0091-47e0-9a6a-0eab75ab6c43-ovnkube-config\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237732 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-node-log\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.237750 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret podName:764467bb-de90-44d5-bbe3-5a1bfc57a04a nodeName:}" failed. No retries permitted until 2026-07-28 07:46:09.737734289 +0000 UTC m=+2.019544108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret") pod "global-pull-secret-syncer-bwskd" (UID: "764467bb-de90-44d5-bbe3-5a1bfc57a04a") : object "kube-system"/"original-pull-secret" not registered Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237774 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-node-log\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-systemd\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237808 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7f6e438-4728-48e0-8506-c771771bcb7b-tmp-dir\") pod \"node-resolver-9g4sg\" (UID: \"f7f6e438-4728-48e0-8506-c771771bcb7b\") " pod="openshift-dns/node-resolver-9g4sg" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237831 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7xv8\" (UniqueName: \"kubernetes.io/projected/c9a3c30e-bec9-4339-bb7a-caecdd1b0684-kube-api-access-d7xv8\") pod \"node-ca-t7gkh\" (UID: \"c9a3c30e-bec9-4339-bb7a-caecdd1b0684\") " pod="openshift-image-registry/node-ca-t7gkh" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-socket-dir\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b04c48a0-8584-41c2-988e-c44e79c4a7a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237914 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-run-openvswitch\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237935 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2861be1-fa8c-43ca-b153-958d17cba737-cni-binary-copy\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.238412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237957 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-run-k8s-cni-cncf-io\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237968 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-socket-dir\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237984 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-hostroot\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.237999 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-run-openvswitch\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8n6g\" (UniqueName: \"kubernetes.io/projected/e2861be1-fa8c-43ca-b153-958d17cba737-kube-api-access-s8n6g\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238036 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvbzc\" (UniqueName: \"kubernetes.io/projected/b19241fe-e222-4a3f-b604-0ac288158399-kube-api-access-xvbzc\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-systemd-units\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238110 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-systemd-units\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238158 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-slash\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/685a74dc-0091-47e0-9a6a-0eab75ab6c43-ovn-node-metrics-cert\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238217 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-slash\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-var-lib-kubelet\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238246 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-system-cni-dir\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-multus-cni-dir\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238289 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-cnibin\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238314 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-cni-netd\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bf6d0d35-3f02-44f3-9e18-845a18c19b4b-iptables-alerter-script\") pod \"iptables-alerter-49pdt\" (UID: \"bf6d0d35-3f02-44f3-9e18-845a18c19b4b\") " pod="openshift-network-operator/iptables-alerter-49pdt" Jul 28 07:46:09.239227 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238365 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf6d0d35-3f02-44f3-9e18-845a18c19b4b-host-slash\") pod \"iptables-alerter-49pdt\" (UID: \"bf6d0d35-3f02-44f3-9e18-845a18c19b4b\") " pod="openshift-network-operator/iptables-alerter-49pdt" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238371 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b04c48a0-8584-41c2-988e-c44e79c4a7a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238388 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-run-systemd\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238430 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-cni-netd\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238437 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-run-systemd\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238462 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-log-socket\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238480 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf6d0d35-3f02-44f3-9e18-845a18c19b4b-host-slash\") pod \"iptables-alerter-49pdt\" (UID: \"bf6d0d35-3f02-44f3-9e18-845a18c19b4b\") " pod="openshift-network-operator/iptables-alerter-49pdt" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238489 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-run-ovn-kubernetes\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238500 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b2cd0036-f48f-420a-a174-ef97de31aede-agent-certs\") pod \"konnectivity-agent-d5b87\" (UID: \"b2cd0036-f48f-420a-a174-ef97de31aede\") " pod="kube-system/konnectivity-agent-d5b87" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238517 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-log-socket\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238540 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c9a3c30e-bec9-4339-bb7a-caecdd1b0684-serviceca\") pod \"node-ca-t7gkh\" (UID: \"c9a3c30e-bec9-4339-bb7a-caecdd1b0684\") " pod="openshift-image-registry/node-ca-t7gkh" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238583 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-etc-kubernetes\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pkzk\" (UniqueName: \"kubernetes.io/projected/c79dbe4b-fc12-4534-9cc4-be27338b0967-kube-api-access-8pkzk\") pod \"network-metrics-daemon-dnr4f\" (UID: \"c79dbe4b-fc12-4534-9cc4-be27338b0967\") " pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-var-lib-openvswitch\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238680 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-etc-openvswitch\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-run\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238741 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-sys\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.240068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238765 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4vzn\" (UniqueName: \"kubernetes.io/projected/f7f6e438-4728-48e0-8506-c771771bcb7b-kube-api-access-h4vzn\") pod \"node-resolver-9g4sg\" (UID: \"f7f6e438-4728-48e0-8506-c771771bcb7b\") " pod="openshift-dns/node-resolver-9g4sg" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-etc-selinux\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nbgq\" (UniqueName: \"kubernetes.io/projected/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-kube-api-access-5nbgq\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/764467bb-de90-44d5-bbe3-5a1bfc57a04a-dbus\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238895 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bf6d0d35-3f02-44f3-9e18-845a18c19b4b-iptables-alerter-script\") pod \"iptables-alerter-49pdt\" (UID: \"bf6d0d35-3f02-44f3-9e18-845a18c19b4b\") " pod="openshift-network-operator/iptables-alerter-49pdt" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238951 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-run-ovn-kubernetes\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238974 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-var-lib-openvswitch\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.238994 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-etc-openvswitch\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.239028 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b19241fe-e222-4a3f-b604-0ac288158399-etc-selinux\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.239065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbxx\" (UniqueName: \"kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx\") pod \"network-check-target-47rf9\" (UID: \"c00766d2-de01-45bb-a127-7ace967dbbc5\") " pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.239087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-kubelet\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.239117 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhnpg\" (UniqueName: \"kubernetes.io/projected/685a74dc-0091-47e0-9a6a-0eab75ab6c43-kube-api-access-jhnpg\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.239139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-sysctl-d\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.239161 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-var-lib-kubelet\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.239182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-var-lib-cni-bin\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.239215 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e2861be1-fa8c-43ca-b153-958d17cba737-multus-daemon-config\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.239214 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/764467bb-de90-44d5-bbe3-5a1bfc57a04a-dbus\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:09.241003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.239251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-run-multus-certs\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.241832 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.239370 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/685a74dc-0091-47e0-9a6a-0eab75ab6c43-host-kubelet\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.241832 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.241753 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/685a74dc-0091-47e0-9a6a-0eab75ab6c43-ovn-node-metrics-cert\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.241936 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.241890 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b2cd0036-f48f-420a-a174-ef97de31aede-agent-certs\") pod \"konnectivity-agent-d5b87\" (UID: \"b2cd0036-f48f-420a-a174-ef97de31aede\") " pod="kube-system/konnectivity-agent-d5b87" Jul 28 07:46:09.243410 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:09.243386 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb9bcfc43c07955a28965fcba36e638.slice/crio-6e01326f649ef8c4a86e02984abe5dbaaebb96dcae59039345a1554a8ac1a082 WatchSource:0}: Error finding container 6e01326f649ef8c4a86e02984abe5dbaaebb96dcae59039345a1554a8ac1a082: Status 404 returned error can't find the container with id 6e01326f649ef8c4a86e02984abe5dbaaebb96dcae59039345a1554a8ac1a082 Jul 28 07:46:09.243744 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:09.243721 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4024f16ee72121162c0202a5aa0fcfc.slice/crio-26c9b9439b0c2219071d231bf6c447aaedac3d4cdc39d0a9e8a28f4dda4ee2e5 WatchSource:0}: Error finding container 26c9b9439b0c2219071d231bf6c447aaedac3d4cdc39d0a9e8a28f4dda4ee2e5: Status 404 returned error can't find the container with id 26c9b9439b0c2219071d231bf6c447aaedac3d4cdc39d0a9e8a28f4dda4ee2e5 Jul 28 07:46:09.248940 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.248923 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 07:46:09.252368 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.252340 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 07:46:09.252368 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.252362 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 07:46:09.252519 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.252377 2561 projected.go:196] Error preparing data for projected volume kube-api-access-cpbxx for pod openshift-network-diagnostics/network-check-target-47rf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 07:46:09.252519 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.252425 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx podName:c00766d2-de01-45bb-a127-7ace967dbbc5 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:09.752406968 +0000 UTC m=+2.034216798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cpbxx" (UniqueName: "kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx") pod "network-check-target-47rf9" (UID: "c00766d2-de01-45bb-a127-7ace967dbbc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 07:46:09.254992 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.254968 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxthz\" (UniqueName: \"kubernetes.io/projected/bf6d0d35-3f02-44f3-9e18-845a18c19b4b-kube-api-access-gxthz\") pod \"iptables-alerter-49pdt\" (UID: \"bf6d0d35-3f02-44f3-9e18-845a18c19b4b\") " pod="openshift-network-operator/iptables-alerter-49pdt" Jul 28 07:46:09.255166 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.255140 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvbzc\" (UniqueName: \"kubernetes.io/projected/b19241fe-e222-4a3f-b604-0ac288158399-kube-api-access-xvbzc\") pod \"aws-ebs-csi-driver-node-zfjcr\" (UID: \"b19241fe-e222-4a3f-b604-0ac288158399\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.255685 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.255666 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhv4s\" (UniqueName: \"kubernetes.io/projected/b04c48a0-8584-41c2-988e-c44e79c4a7a5-kube-api-access-hhv4s\") pod \"multus-additional-cni-plugins-zhxs5\" (UID: \"b04c48a0-8584-41c2-988e-c44e79c4a7a5\") " pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.255846 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.255826 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pkzk\" (UniqueName: \"kubernetes.io/projected/c79dbe4b-fc12-4534-9cc4-be27338b0967-kube-api-access-8pkzk\") pod \"network-metrics-daemon-dnr4f\" (UID: \"c79dbe4b-fc12-4534-9cc4-be27338b0967\") " pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:09.255967 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.255952 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhnpg\" (UniqueName: \"kubernetes.io/projected/685a74dc-0091-47e0-9a6a-0eab75ab6c43-kube-api-access-jhnpg\") pod \"ovnkube-node-wmf27\" (UID: \"685a74dc-0091-47e0-9a6a-0eab75ab6c43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.340142 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340108 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-sysctl-d\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.340142 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340143 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-var-lib-kubelet\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.340324 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-var-lib-cni-bin\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.340324 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340211 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-var-lib-cni-bin\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.340324 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340228 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-var-lib-kubelet\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.340324 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340240 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e2861be1-fa8c-43ca-b153-958d17cba737-multus-daemon-config\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.340324 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340266 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-sysctl-d\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.340324 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340280 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-run-multus-certs\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.340324 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340313 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-run-netns\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340339 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-modprobe-d\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340355 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-run-multus-certs\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340377 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-run-netns\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340364 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f7f6e438-4728-48e0-8506-c771771bcb7b-hosts-file\") pod \"node-resolver-9g4sg\" (UID: \"f7f6e438-4728-48e0-8506-c771771bcb7b\") " pod="openshift-dns/node-resolver-9g4sg" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340407 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f7f6e438-4728-48e0-8506-c771771bcb7b-hosts-file\") pod \"node-resolver-9g4sg\" (UID: \"f7f6e438-4728-48e0-8506-c771771bcb7b\") " pod="openshift-dns/node-resolver-9g4sg" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-var-lib-cni-multus\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340439 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-modprobe-d\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-kubernetes\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340464 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-var-lib-cni-multus\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340478 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-kubernetes\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340483 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-tuned\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9a3c30e-bec9-4339-bb7a-caecdd1b0684-host\") pod \"node-ca-t7gkh\" (UID: \"c9a3c30e-bec9-4339-bb7a-caecdd1b0684\") " pod="openshift-image-registry/node-ca-t7gkh" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340528 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-host\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340550 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-os-release\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340570 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-multus-socket-dir-parent\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340579 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9a3c30e-bec9-4339-bb7a-caecdd1b0684-host\") pod \"node-ca-t7gkh\" (UID: \"c9a3c30e-bec9-4339-bb7a-caecdd1b0684\") " pod="openshift-image-registry/node-ca-t7gkh" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-sysconfig\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.340731 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340597 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-host\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340643 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-sysctl-conf\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340658 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-os-release\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340670 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-multus-conf-dir\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340646 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-multus-socket-dir-parent\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340666 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-sysconfig\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340709 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-multus-conf-dir\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340723 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-lib-modules\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340746 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-tmp\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340760 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-sysctl-conf\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-systemd\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340808 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7f6e438-4728-48e0-8506-c771771bcb7b-tmp-dir\") pod \"node-resolver-9g4sg\" (UID: \"f7f6e438-4728-48e0-8506-c771771bcb7b\") " pod="openshift-dns/node-resolver-9g4sg" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340827 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-lib-modules\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7xv8\" (UniqueName: \"kubernetes.io/projected/c9a3c30e-bec9-4339-bb7a-caecdd1b0684-kube-api-access-d7xv8\") pod \"node-ca-t7gkh\" (UID: \"c9a3c30e-bec9-4339-bb7a-caecdd1b0684\") " pod="openshift-image-registry/node-ca-t7gkh" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340848 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e2861be1-fa8c-43ca-b153-958d17cba737-multus-daemon-config\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340874 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2861be1-fa8c-43ca-b153-958d17cba737-cni-binary-copy\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340875 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-systemd\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-run-k8s-cni-cncf-io\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.341510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340924 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-hostroot\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8n6g\" (UniqueName: \"kubernetes.io/projected/e2861be1-fa8c-43ca-b153-958d17cba737-kube-api-access-s8n6g\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340971 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-var-lib-kubelet\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.340995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-system-cni-dir\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341028 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-multus-cni-dir\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341049 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-cnibin\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341079 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c9a3c30e-bec9-4339-bb7a-caecdd1b0684-serviceca\") pod \"node-ca-t7gkh\" (UID: \"c9a3c30e-bec9-4339-bb7a-caecdd1b0684\") " pod="openshift-image-registry/node-ca-t7gkh" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341087 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-var-lib-kubelet\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341104 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-etc-kubernetes\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341022 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-hostroot\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341140 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-run\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341162 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-sys\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341183 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-system-cni-dir\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4vzn\" (UniqueName: \"kubernetes.io/projected/f7f6e438-4728-48e0-8506-c771771bcb7b-kube-api-access-h4vzn\") pod \"node-resolver-9g4sg\" (UID: \"f7f6e438-4728-48e0-8506-c771771bcb7b\") " pod="openshift-dns/node-resolver-9g4sg" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nbgq\" (UniqueName: \"kubernetes.io/projected/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-kube-api-access-5nbgq\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341246 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-multus-cni-dir\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341263 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7f6e438-4728-48e0-8506-c771771bcb7b-tmp-dir\") pod \"node-resolver-9g4sg\" (UID: \"f7f6e438-4728-48e0-8506-c771771bcb7b\") " pod="openshift-dns/node-resolver-9g4sg" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341302 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-run\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.342046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341332 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2861be1-fa8c-43ca-b153-958d17cba737-cni-binary-copy\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.342553 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341366 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-sys\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.342553 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341368 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-cnibin\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.342553 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341404 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-etc-kubernetes\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.342553 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341493 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e2861be1-fa8c-43ca-b153-958d17cba737-host-run-k8s-cni-cncf-io\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.342553 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.341715 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c9a3c30e-bec9-4339-bb7a-caecdd1b0684-serviceca\") pod \"node-ca-t7gkh\" (UID: \"c9a3c30e-bec9-4339-bb7a-caecdd1b0684\") " pod="openshift-image-registry/node-ca-t7gkh" Jul 28 07:46:09.342709 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.342668 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-etc-tuned\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.342816 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.342801 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-tmp\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.351476 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.351452 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7xv8\" (UniqueName: \"kubernetes.io/projected/c9a3c30e-bec9-4339-bb7a-caecdd1b0684-kube-api-access-d7xv8\") pod \"node-ca-t7gkh\" (UID: \"c9a3c30e-bec9-4339-bb7a-caecdd1b0684\") " pod="openshift-image-registry/node-ca-t7gkh" Jul 28 07:46:09.351641 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.351599 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4vzn\" (UniqueName: \"kubernetes.io/projected/f7f6e438-4728-48e0-8506-c771771bcb7b-kube-api-access-h4vzn\") pod \"node-resolver-9g4sg\" (UID: \"f7f6e438-4728-48e0-8506-c771771bcb7b\") " pod="openshift-dns/node-resolver-9g4sg" Jul 28 07:46:09.353431 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.353411 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nbgq\" (UniqueName: \"kubernetes.io/projected/ed93c8db-9165-4dce-a0cd-5f1c589ac5cf-kube-api-access-5nbgq\") pod \"tuned-jnhb4\" (UID: \"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf\") " pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.353597 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.353581 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8n6g\" (UniqueName: \"kubernetes.io/projected/e2861be1-fa8c-43ca-b153-958d17cba737-kube-api-access-s8n6g\") pod \"multus-477cl\" (UID: \"e2861be1-fa8c-43ca-b153-958d17cba737\") " pod="openshift-multus/multus-477cl" Jul 28 07:46:09.405800 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.405754 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 07:46:09.449497 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.449482 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zhxs5" Jul 28 07:46:09.459218 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:09.459199 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04c48a0_8584_41c2_988e_c44e79c4a7a5.slice/crio-0733eb3102a23b9f33ee895d245afe3f9b88e7e2b3a5f79a15d53df2e26147c2 WatchSource:0}: Error finding container 0733eb3102a23b9f33ee895d245afe3f9b88e7e2b3a5f79a15d53df2e26147c2: Status 404 returned error can't find the container with id 0733eb3102a23b9f33ee895d245afe3f9b88e7e2b3a5f79a15d53df2e26147c2 Jul 28 07:46:09.465638 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.465600 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-49pdt" Jul 28 07:46:09.474268 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:09.474247 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6d0d35_3f02_44f3_9e18_845a18c19b4b.slice/crio-1db2356046eff0a26fec111541614bd5458a38c53ac0d533da1533b0d0656668 WatchSource:0}: Error finding container 1db2356046eff0a26fec111541614bd5458a38c53ac0d533da1533b0d0656668: Status 404 returned error can't find the container with id 1db2356046eff0a26fec111541614bd5458a38c53ac0d533da1533b0d0656668 Jul 28 07:46:09.484566 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.484539 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:09.493492 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:09.493469 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685a74dc_0091_47e0_9a6a_0eab75ab6c43.slice/crio-e62b831193829853f87e713a4baf5b837161d92449850b1a9edfb1c4277f22b7 WatchSource:0}: Error finding container e62b831193829853f87e713a4baf5b837161d92449850b1a9edfb1c4277f22b7: Status 404 returned error can't find the container with id e62b831193829853f87e713a4baf5b837161d92449850b1a9edfb1c4277f22b7 Jul 28 07:46:09.503852 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.503832 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" Jul 28 07:46:09.510091 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.510073 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 07:46:09.511279 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:09.511261 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19241fe_e222_4a3f_b604_0ac288158399.slice/crio-1e6dc6ea6d27cf638a726d4672ccb7bcb1968302cdc63ea61f5b1c0e2339a1e4 WatchSource:0}: Error finding container 1e6dc6ea6d27cf638a726d4672ccb7bcb1968302cdc63ea61f5b1c0e2339a1e4: Status 404 returned error can't find the container with id 1e6dc6ea6d27cf638a726d4672ccb7bcb1968302cdc63ea61f5b1c0e2339a1e4 Jul 28 07:46:09.520064 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.520048 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d5b87" Jul 28 07:46:09.527365 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:09.527345 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2cd0036_f48f_420a_a174_ef97de31aede.slice/crio-7e628ba1596a65695b7b6b51ec13a60f0f51242ebf9fb91d9285b75bb3b2c24b WatchSource:0}: Error finding container 7e628ba1596a65695b7b6b51ec13a60f0f51242ebf9fb91d9285b75bb3b2c24b: Status 404 returned error can't find the container with id 7e628ba1596a65695b7b6b51ec13a60f0f51242ebf9fb91d9285b75bb3b2c24b Jul 28 07:46:09.536675 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.536659 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" Jul 28 07:46:09.544038 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:09.544013 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded93c8db_9165_4dce_a0cd_5f1c589ac5cf.slice/crio-1e749a80fb8ea006e7e6a995dff067991f1fe996c0f4f598b54e0ad2a8767cb6 WatchSource:0}: Error finding container 1e749a80fb8ea006e7e6a995dff067991f1fe996c0f4f598b54e0ad2a8767cb6: Status 404 returned error can't find the container with id 1e749a80fb8ea006e7e6a995dff067991f1fe996c0f4f598b54e0ad2a8767cb6 Jul 28 07:46:09.552567 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.552545 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9g4sg" Jul 28 07:46:09.559908 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:09.559889 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f6e438_4728_48e0_8506_c771771bcb7b.slice/crio-d88de5ae84ade90c9d1224d183853fe2646f10ad161b0d736111a32beb6d67c9 WatchSource:0}: Error finding container d88de5ae84ade90c9d1224d183853fe2646f10ad161b0d736111a32beb6d67c9: Status 404 returned error can't find the container with id d88de5ae84ade90c9d1224d183853fe2646f10ad161b0d736111a32beb6d67c9 Jul 28 07:46:09.566770 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.566748 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t7gkh" Jul 28 07:46:09.570364 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.570343 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-477cl" Jul 28 07:46:09.574561 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:09.574528 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9a3c30e_bec9_4339_bb7a_caecdd1b0684.slice/crio-09032cb7ae67e33e0fa52469adef732d256ec8d2f3e31a8f0c5d8fee5259796a WatchSource:0}: Error finding container 09032cb7ae67e33e0fa52469adef732d256ec8d2f3e31a8f0c5d8fee5259796a: Status 404 returned error can't find the container with id 09032cb7ae67e33e0fa52469adef732d256ec8d2f3e31a8f0c5d8fee5259796a Jul 28 07:46:09.577996 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:46:09.577974 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2861be1_fa8c_43ca_b153_958d17cba737.slice/crio-6f942bf0c048a7dc67d4a69d485ef8162b72f1d2ec4214d0c86512af054d915a WatchSource:0}: Error finding container 6f942bf0c048a7dc67d4a69d485ef8162b72f1d2ec4214d0c86512af054d915a: Status 404 returned error can't find the container with id 6f942bf0c048a7dc67d4a69d485ef8162b72f1d2ec4214d0c86512af054d915a Jul 28 07:46:09.743407 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.743327 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs\") pod \"network-metrics-daemon-dnr4f\" (UID: \"c79dbe4b-fc12-4534-9cc4-be27338b0967\") " pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:09.743407 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.743372 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:09.743647 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.743497 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 07:46:09.743647 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.743552 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret podName:764467bb-de90-44d5-bbe3-5a1bfc57a04a nodeName:}" failed. No retries permitted until 2026-07-28 07:46:10.743533248 +0000 UTC m=+3.025343068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret") pod "global-pull-secret-syncer-bwskd" (UID: "764467bb-de90-44d5-bbe3-5a1bfc57a04a") : object "kube-system"/"original-pull-secret" not registered Jul 28 07:46:09.743814 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.743795 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 07:46:09.743886 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.743864 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs podName:c79dbe4b-fc12-4534-9cc4-be27338b0967 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:10.743846719 +0000 UTC m=+3.025656549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs") pod "network-metrics-daemon-dnr4f" (UID: "c79dbe4b-fc12-4534-9cc4-be27338b0967") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 07:46:09.844358 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:09.844319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbxx\" (UniqueName: \"kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx\") pod \"network-check-target-47rf9\" (UID: \"c00766d2-de01-45bb-a127-7ace967dbbc5\") " pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:09.844521 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.844507 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 07:46:09.844566 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.844528 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 07:46:09.844566 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.844538 2561 projected.go:196] Error preparing data for projected volume kube-api-access-cpbxx for pod openshift-network-diagnostics/network-check-target-47rf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 07:46:09.844723 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:09.844587 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx podName:c00766d2-de01-45bb-a127-7ace967dbbc5 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:10.844571963 +0000 UTC m=+3.126381782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cpbxx" (UniqueName: "kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx") pod "network-check-target-47rf9" (UID: "c00766d2-de01-45bb-a127-7ace967dbbc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 07:46:10.151243 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:10.151166 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 07:46:11.223098 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.223055 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 07:41:10 +0000 UTC" deadline="2028-04-22 11:06:31.018474056 +0000 UTC" Jul 28 07:46:11.223098 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.223099 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15219h20m19.795380765s" Jul 28 07:46:11.288206 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.288149 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-477cl" event={"ID":"e2861be1-fa8c-43ca-b153-958d17cba737","Type":"ContainerStarted","Data":"6f942bf0c048a7dc67d4a69d485ef8162b72f1d2ec4214d0c86512af054d915a"} Jul 28 07:46:11.297023 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.296949 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9g4sg" event={"ID":"f7f6e438-4728-48e0-8506-c771771bcb7b","Type":"ContainerStarted","Data":"d88de5ae84ade90c9d1224d183853fe2646f10ad161b0d736111a32beb6d67c9"} Jul 28 07:46:11.301312 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.301222 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" event={"ID":"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf","Type":"ContainerStarted","Data":"1e749a80fb8ea006e7e6a995dff067991f1fe996c0f4f598b54e0ad2a8767cb6"} Jul 28 07:46:11.313843 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.313725 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d5b87" event={"ID":"b2cd0036-f48f-420a-a174-ef97de31aede","Type":"ContainerStarted","Data":"7e628ba1596a65695b7b6b51ec13a60f0f51242ebf9fb91d9285b75bb3b2c24b"} Jul 28 07:46:11.339437 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.339344 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" event={"ID":"685a74dc-0091-47e0-9a6a-0eab75ab6c43","Type":"ContainerStarted","Data":"e62b831193829853f87e713a4baf5b837161d92449850b1a9edfb1c4277f22b7"} Jul 28 07:46:11.359070 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.359042 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhxs5" event={"ID":"b04c48a0-8584-41c2-988e-c44e79c4a7a5","Type":"ContainerStarted","Data":"0733eb3102a23b9f33ee895d245afe3f9b88e7e2b3a5f79a15d53df2e26147c2"} Jul 28 07:46:11.376814 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.376785 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t7gkh" event={"ID":"c9a3c30e-bec9-4339-bb7a-caecdd1b0684","Type":"ContainerStarted","Data":"09032cb7ae67e33e0fa52469adef732d256ec8d2f3e31a8f0c5d8fee5259796a"} Jul 28 07:46:11.391382 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.391349 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" event={"ID":"b19241fe-e222-4a3f-b604-0ac288158399","Type":"ContainerStarted","Data":"1e6dc6ea6d27cf638a726d4672ccb7bcb1968302cdc63ea61f5b1c0e2339a1e4"} Jul 28 07:46:11.395082 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.395059 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-49pdt" event={"ID":"bf6d0d35-3f02-44f3-9e18-845a18c19b4b","Type":"ContainerStarted","Data":"1db2356046eff0a26fec111541614bd5458a38c53ac0d533da1533b0d0656668"} Jul 28 07:46:11.414752 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.414687 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" event={"ID":"a4024f16ee72121162c0202a5aa0fcfc","Type":"ContainerStarted","Data":"26c9b9439b0c2219071d231bf6c447aaedac3d4cdc39d0a9e8a28f4dda4ee2e5"} Jul 28 07:46:11.429033 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.429000 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal" event={"ID":"fcb9bcfc43c07955a28965fcba36e638","Type":"ContainerStarted","Data":"6e01326f649ef8c4a86e02984abe5dbaaebb96dcae59039345a1554a8ac1a082"} Jul 28 07:46:11.793448 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.793407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:11.793639 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.793497 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs\") pod \"network-metrics-daemon-dnr4f\" (UID: \"c79dbe4b-fc12-4534-9cc4-be27338b0967\") " pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:11.793712 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:11.793651 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 07:46:11.793766 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:11.793711 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs podName:c79dbe4b-fc12-4534-9cc4-be27338b0967 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:13.793692384 +0000 UTC m=+5.034880199 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs") pod "network-metrics-daemon-dnr4f" (UID: "c79dbe4b-fc12-4534-9cc4-be27338b0967") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 07:46:11.794134 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:11.794115 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 07:46:11.794210 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:11.794168 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret podName:764467bb-de90-44d5-bbe3-5a1bfc57a04a nodeName:}" failed. No retries permitted until 2026-07-28 07:46:13.794152551 +0000 UTC m=+5.035340368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret") pod "global-pull-secret-syncer-bwskd" (UID: "764467bb-de90-44d5-bbe3-5a1bfc57a04a") : object "kube-system"/"original-pull-secret" not registered Jul 28 07:46:11.894628 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:11.894589 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbxx\" (UniqueName: \"kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx\") pod \"network-check-target-47rf9\" (UID: \"c00766d2-de01-45bb-a127-7ace967dbbc5\") " pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:11.894814 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:11.894777 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 07:46:11.894814 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:11.894798 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 07:46:11.894814 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:11.894812 2561 projected.go:196] Error preparing data for projected volume kube-api-access-cpbxx for pod openshift-network-diagnostics/network-check-target-47rf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 07:46:11.894964 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:11.894869 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx podName:c00766d2-de01-45bb-a127-7ace967dbbc5 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:13.894851061 +0000 UTC m=+5.136038877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cpbxx" (UniqueName: "kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx") pod "network-check-target-47rf9" (UID: "c00766d2-de01-45bb-a127-7ace967dbbc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 07:46:12.223697 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:12.223585 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 07:41:10 +0000 UTC" deadline="2028-01-26 05:05:08.431262988 +0000 UTC" Jul 28 07:46:12.224316 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:12.223703 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13125h18m56.207618638s" Jul 28 07:46:12.269023 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:12.268992 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:12.269202 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:12.269120 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:12.269554 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:12.269534 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:12.269664 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:12.269629 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:12.269732 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:12.269692 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:12.269782 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:12.269767 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:13.810585 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:13.810506 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:13.811012 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:13.810613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs\") pod \"network-metrics-daemon-dnr4f\" (UID: \"c79dbe4b-fc12-4534-9cc4-be27338b0967\") " pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:13.811012 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:13.810750 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 07:46:13.811012 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:13.810810 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs podName:c79dbe4b-fc12-4534-9cc4-be27338b0967 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:17.810792707 +0000 UTC m=+9.051980525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs") pod "network-metrics-daemon-dnr4f" (UID: "c79dbe4b-fc12-4534-9cc4-be27338b0967") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 07:46:13.811216 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:13.811195 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 07:46:13.811301 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:13.811271 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret podName:764467bb-de90-44d5-bbe3-5a1bfc57a04a nodeName:}" failed. No retries permitted until 2026-07-28 07:46:17.811254789 +0000 UTC m=+9.052442602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret") pod "global-pull-secret-syncer-bwskd" (UID: "764467bb-de90-44d5-bbe3-5a1bfc57a04a") : object "kube-system"/"original-pull-secret" not registered Jul 28 07:46:13.911928 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:13.911266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbxx\" (UniqueName: \"kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx\") pod \"network-check-target-47rf9\" (UID: \"c00766d2-de01-45bb-a127-7ace967dbbc5\") " pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:13.911928 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:13.911440 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 07:46:13.911928 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:13.911462 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 07:46:13.911928 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:13.911477 2561 projected.go:196] Error preparing data for projected volume kube-api-access-cpbxx for pod openshift-network-diagnostics/network-check-target-47rf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 07:46:13.911928 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:13.911547 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx podName:c00766d2-de01-45bb-a127-7ace967dbbc5 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:17.911528604 +0000 UTC m=+9.152716420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cpbxx" (UniqueName: "kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx") pod "network-check-target-47rf9" (UID: "c00766d2-de01-45bb-a127-7ace967dbbc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 07:46:14.269497 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:14.269376 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:14.269497 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:14.269392 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:14.269497 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:14.269412 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:14.269897 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:14.269513 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:14.269897 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:14.269647 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:14.269897 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:14.269753 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:16.269911 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:16.269115 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:16.269911 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:16.269289 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:16.269911 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:16.269653 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:16.269911 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:16.269743 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:16.269911 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:16.269787 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:16.269911 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:16.269854 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:17.849874 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:17.849836 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs\") pod \"network-metrics-daemon-dnr4f\" (UID: \"c79dbe4b-fc12-4534-9cc4-be27338b0967\") " pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:17.850355 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:17.849909 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:17.850355 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:17.849972 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 07:46:17.850355 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:17.850022 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 07:46:17.850355 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:17.850052 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs podName:c79dbe4b-fc12-4534-9cc4-be27338b0967 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:25.850030257 +0000 UTC m=+17.091218072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs") pod "network-metrics-daemon-dnr4f" (UID: "c79dbe4b-fc12-4534-9cc4-be27338b0967") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 07:46:17.850355 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:17.850076 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret podName:764467bb-de90-44d5-bbe3-5a1bfc57a04a nodeName:}" failed. No retries permitted until 2026-07-28 07:46:25.850059728 +0000 UTC m=+17.091247563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret") pod "global-pull-secret-syncer-bwskd" (UID: "764467bb-de90-44d5-bbe3-5a1bfc57a04a") : object "kube-system"/"original-pull-secret" not registered Jul 28 07:46:17.951624 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:17.951022 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbxx\" (UniqueName: \"kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx\") pod \"network-check-target-47rf9\" (UID: \"c00766d2-de01-45bb-a127-7ace967dbbc5\") " pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:17.951624 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:17.951196 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 07:46:17.951624 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:17.951216 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 07:46:17.951624 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:17.951244 2561 projected.go:196] Error preparing data for projected volume kube-api-access-cpbxx for pod openshift-network-diagnostics/network-check-target-47rf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 07:46:17.951624 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:17.951298 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx podName:c00766d2-de01-45bb-a127-7ace967dbbc5 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:25.951280528 +0000 UTC m=+17.192468345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cpbxx" (UniqueName: "kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx") pod "network-check-target-47rf9" (UID: "c00766d2-de01-45bb-a127-7ace967dbbc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 07:46:18.269647 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:18.269617 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:18.269819 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:18.269730 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:18.270132 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:18.270116 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:18.270244 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:18.270213 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:18.270298 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:18.270283 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:18.270355 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:18.270338 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:20.269979 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:20.269479 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:20.269979 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:20.269514 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:20.269979 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:20.269525 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:20.269979 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:20.269614 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:20.269979 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:20.269742 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:20.269979 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:20.269828 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:22.268782 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:22.268749 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:22.269170 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:22.268799 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:22.269170 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:22.268885 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:22.269170 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:22.268903 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:22.269170 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:22.269031 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:22.269170 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:22.269124 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:24.268866 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:24.268835 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:24.269317 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:24.268880 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:24.269317 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:24.268932 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:24.269317 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:24.268948 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:24.269317 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:24.269042 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:24.269317 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:24.269130 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:25.909354 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:25.909318 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:25.909755 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:25.909393 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs\") pod \"network-metrics-daemon-dnr4f\" (UID: \"c79dbe4b-fc12-4534-9cc4-be27338b0967\") " pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:25.909755 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:25.909492 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 07:46:25.909755 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:25.909529 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 07:46:25.909755 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:25.909551 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret podName:764467bb-de90-44d5-bbe3-5a1bfc57a04a nodeName:}" failed. No retries permitted until 2026-07-28 07:46:41.909536713 +0000 UTC m=+33.150724530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret") pod "global-pull-secret-syncer-bwskd" (UID: "764467bb-de90-44d5-bbe3-5a1bfc57a04a") : object "kube-system"/"original-pull-secret" not registered Jul 28 07:46:25.909755 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:25.909577 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs podName:c79dbe4b-fc12-4534-9cc4-be27338b0967 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:41.90956319 +0000 UTC m=+33.150751004 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs") pod "network-metrics-daemon-dnr4f" (UID: "c79dbe4b-fc12-4534-9cc4-be27338b0967") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 07:46:26.010528 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:26.010506 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbxx\" (UniqueName: \"kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx\") pod \"network-check-target-47rf9\" (UID: \"c00766d2-de01-45bb-a127-7ace967dbbc5\") " pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:26.010638 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:26.010626 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 07:46:26.010679 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:26.010644 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 07:46:26.010679 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:26.010653 2561 projected.go:196] Error preparing data for projected volume kube-api-access-cpbxx for pod openshift-network-diagnostics/network-check-target-47rf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 07:46:26.010734 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:26.010696 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx podName:c00766d2-de01-45bb-a127-7ace967dbbc5 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:42.010684251 +0000 UTC m=+33.251872064 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cpbxx" (UniqueName: "kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx") pod "network-check-target-47rf9" (UID: "c00766d2-de01-45bb-a127-7ace967dbbc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 07:46:26.269044 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:26.268768 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:26.269044 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:26.268813 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:26.269213 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:26.269090 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:26.269213 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:26.268813 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:26.269213 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:26.269146 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:26.269213 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:26.269204 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:28.269469 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:28.269428 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:28.269469 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:28.269439 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:28.269942 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:28.269459 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:28.269942 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:28.269581 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:28.269942 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:28.269627 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:28.269942 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:28.269727 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:30.268942 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:30.268913 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:30.269345 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:30.269011 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:30.269345 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:30.268919 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:30.269345 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:30.269052 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:30.269345 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:30.269187 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:30.269345 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:30.269292 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:31.486334 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.486068 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-477cl" event={"ID":"e2861be1-fa8c-43ca-b153-958d17cba737","Type":"ContainerStarted","Data":"829fc976e8a1ab19644c5f78c56b394fb54967acccaa912bac4a89936500668d"} Jul 28 07:46:31.487559 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.487537 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9g4sg" event={"ID":"f7f6e438-4728-48e0-8506-c771771bcb7b","Type":"ContainerStarted","Data":"089ce1a49a7aa45f6387124e933dcf0c4539a5723a8911aad85d5d021c2f71d3"} Jul 28 07:46:31.488921 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.488901 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" event={"ID":"ed93c8db-9165-4dce-a0cd-5f1c589ac5cf","Type":"ContainerStarted","Data":"fb9602ae8cb6b3e1a7ff741f3657415cb296b1fb2598b3bf839986f21b71b936"} Jul 28 07:46:31.490301 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.490278 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d5b87" event={"ID":"b2cd0036-f48f-420a-a174-ef97de31aede","Type":"ContainerStarted","Data":"33856f551054b523a4241a240993f3bb28573df6924815a94eaef8fff788c858"} Jul 28 07:46:31.492698 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.492681 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/ovn-acl-logging/0.log" Jul 28 07:46:31.492980 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.492963 2561 generic.go:356] "Generic (PLEG): container finished" podID="685a74dc-0091-47e0-9a6a-0eab75ab6c43" containerID="bef6d2d6f4692e2d4465fde8cbdd735c34474254e79f6b61f69f3690c8410b49" exitCode=1 Jul 28 07:46:31.493037 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.493014 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" event={"ID":"685a74dc-0091-47e0-9a6a-0eab75ab6c43","Type":"ContainerStarted","Data":"dba92322148b1709b6de9c6a3f3ebba1ecf453fcfeff2ed14dbfc694c7620fff"} Jul 28 07:46:31.493096 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.493058 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" event={"ID":"685a74dc-0091-47e0-9a6a-0eab75ab6c43","Type":"ContainerStarted","Data":"f104079426f6a0d86780dc06714237cc271d8cf57fb04040fd69b5a5f3c5bcb0"} Jul 28 07:46:31.493096 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.493087 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" event={"ID":"685a74dc-0091-47e0-9a6a-0eab75ab6c43","Type":"ContainerStarted","Data":"88be63f8d0073ab7b09269ca5491c2c822f969de3c9ac3abeecbe4223fc2b147"} Jul 28 07:46:31.493192 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.493116 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" event={"ID":"685a74dc-0091-47e0-9a6a-0eab75ab6c43","Type":"ContainerStarted","Data":"3b43fa579bec62d212718a7497ebc72f7de9815e04399a441ddd0b1ac0164b92"} Jul 28 07:46:31.493192 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.493154 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" event={"ID":"685a74dc-0091-47e0-9a6a-0eab75ab6c43","Type":"ContainerDied","Data":"bef6d2d6f4692e2d4465fde8cbdd735c34474254e79f6b61f69f3690c8410b49"} Jul 28 07:46:31.493192 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.493183 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" event={"ID":"685a74dc-0091-47e0-9a6a-0eab75ab6c43","Type":"ContainerStarted","Data":"21da80e627471e41dc4143389664a089ae4042e550d37ff0ffa72e051c9d9a9d"} Jul 28 07:46:31.494437 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.494417 2561 generic.go:356] "Generic (PLEG): container finished" podID="b04c48a0-8584-41c2-988e-c44e79c4a7a5" containerID="0034a40cc924a39f7b210c8e3aaaa5015233b8258620da69b6019a379c56078f" exitCode=0 Jul 28 07:46:31.494524 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.494477 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhxs5" event={"ID":"b04c48a0-8584-41c2-988e-c44e79c4a7a5","Type":"ContainerDied","Data":"0034a40cc924a39f7b210c8e3aaaa5015233b8258620da69b6019a379c56078f"} Jul 28 07:46:31.495943 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.495921 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t7gkh" event={"ID":"c9a3c30e-bec9-4339-bb7a-caecdd1b0684","Type":"ContainerStarted","Data":"bbf34f944afff7ef8b9b923d055c94d621cb6f4bd8075af01e760d1fd5a5389f"} Jul 28 07:46:31.497383 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.497365 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" event={"ID":"b19241fe-e222-4a3f-b604-0ac288158399","Type":"ContainerStarted","Data":"76982352bdb3781fdca3b2d157aa79958eaf9f49a60e05fcfea35710774b2573"} Jul 28 07:46:31.498893 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.498875 2561 generic.go:356] "Generic (PLEG): container finished" podID="a4024f16ee72121162c0202a5aa0fcfc" containerID="6d0a8cd5b9c9c3eedaf2d34743227e28facd30462c65ce1d0c5c195ce7203fa4" exitCode=0 Jul 28 07:46:31.498971 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.498944 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" event={"ID":"a4024f16ee72121162c0202a5aa0fcfc","Type":"ContainerDied","Data":"6d0a8cd5b9c9c3eedaf2d34743227e28facd30462c65ce1d0c5c195ce7203fa4"} Jul 28 07:46:31.500144 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.500122 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal" event={"ID":"fcb9bcfc43c07955a28965fcba36e638","Type":"ContainerStarted","Data":"f4f5b81206d7806184899da2ab073c65843d15cfb2ab57bf96b42d8db8878ff7"} Jul 28 07:46:31.525957 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.525919 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-477cl" podStartSLOduration=2.384288349 podStartE2EDuration="22.52590706s" totalImagesPullingTime="20.141618711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:46:31.508171106 +0000 UTC m=+22.749358952" watchObservedRunningTime="2026-07-28 07:46:31.52590706 +0000 UTC m=+22.767094897" Jul 28 07:46:31.545026 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.544993 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d5b87" podStartSLOduration=3.076623201 podStartE2EDuration="22.544982351s" totalImagesPullingTime="19.46835915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:46:31.525866704 +0000 UTC m=+22.767054538" watchObservedRunningTime="2026-07-28 07:46:31.544982351 +0000 UTC m=+22.786170185" Jul 28 07:46:31.545348 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.545326 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jnhb4" podStartSLOduration=2.70012967 podStartE2EDuration="22.545319896s" totalImagesPullingTime="19.845190226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:46:31.545100144 +0000 UTC m=+22.786287958" watchObservedRunningTime="2026-07-28 07:46:31.545319896 +0000 UTC m=+22.786507749" Jul 28 07:46:31.560414 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.560372 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal" podStartSLOduration=21.560362854 podStartE2EDuration="21.560362854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:46:31.560180397 +0000 UTC m=+22.801368226" watchObservedRunningTime="2026-07-28 07:46:31.560362854 +0000 UTC m=+22.801550686" Jul 28 07:46:31.622337 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:31.622291 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9g4sg" podStartSLOduration=3.186341681 podStartE2EDuration="22.622279056s" totalImagesPullingTime="19.435937375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:46:31.622049237 +0000 UTC m=+22.863237093" watchObservedRunningTime="2026-07-28 07:46:31.622279056 +0000 UTC m=+22.863466892" Jul 28 07:46:32.269665 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:32.269436 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:32.269916 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:32.269471 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:32.269916 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:32.269682 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:32.269916 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:32.269503 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:32.269916 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:32.269753 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:32.269916 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:32.269844 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:32.504175 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:32.504145 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-49pdt" event={"ID":"bf6d0d35-3f02-44f3-9e18-845a18c19b4b","Type":"ContainerStarted","Data":"67746474cfc0e433e2b33b29ab2762a30c2210da49c785f41fd3e00604d2f733"} Jul 28 07:46:32.536566 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:32.536516 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t7gkh" podStartSLOduration=4.1154818970000004 podStartE2EDuration="23.536494949s" totalImagesPullingTime="19.421013052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:46:31.660381723 +0000 UTC m=+22.901569558" watchObservedRunningTime="2026-07-28 07:46:32.536494949 +0000 UTC m=+23.777682786" Jul 28 07:46:32.550951 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:32.550924 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 07:46:32.562873 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:32.562821 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-49pdt" podStartSLOduration=3.6474401800000003 podStartE2EDuration="23.562800768s" totalImagesPullingTime="19.915360588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:46:32.562371016 +0000 UTC m=+23.803558863" watchObservedRunningTime="2026-07-28 07:46:32.562800768 +0000 UTC m=+23.803988604" Jul 28 07:46:32.833959 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:32.833878 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d5b87" Jul 28 07:46:32.834647 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:32.834630 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d5b87" Jul 28 07:46:33.240310 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:33.240218 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T07:46:32.550946281Z","UUID":"d1f15004-7ef1-482b-8f06-0b6296fb7009","Handler":null,"Name":"","Endpoint":""} Jul 28 07:46:33.241714 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:33.241693 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 07:46:33.241825 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:33.241737 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 07:46:33.507872 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:33.507790 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" event={"ID":"a4024f16ee72121162c0202a5aa0fcfc","Type":"ContainerStarted","Data":"d195784dc2c66f356ceb615d4a1c3617164ad72a799fc8615a50cad7dc1b8a53"} Jul 28 07:46:33.511497 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:33.511478 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/ovn-acl-logging/0.log" Jul 28 07:46:33.512027 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:33.512002 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" event={"ID":"685a74dc-0091-47e0-9a6a-0eab75ab6c43","Type":"ContainerStarted","Data":"5b5d0c9e195f813474a807d2a278f4fa61f17043dcc4898f2d1a63e79e5bdeb5"} Jul 28 07:46:33.517300 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:33.517276 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" event={"ID":"b19241fe-e222-4a3f-b604-0ac288158399","Type":"ContainerStarted","Data":"417d6791381239596848344701eeb2e589bbed4416364026f36ea503416ef541"} Jul 28 07:46:34.269282 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:34.269249 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:34.269282 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:34.269278 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:34.269487 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:34.269278 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:34.269487 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:34.269359 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:34.269487 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:34.269474 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:34.269603 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:34.269542 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:34.522146 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:34.522063 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 07:46:34.522146 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:34.522075 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" event={"ID":"b19241fe-e222-4a3f-b604-0ac288158399","Type":"ContainerStarted","Data":"c9d37ec7b5677fccedcb5c63dbaaa09948d394c6860a26cdc377b94709374197"} Jul 28 07:46:34.552471 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:34.552418 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" podStartSLOduration=24.552398705 podStartE2EDuration="24.552398705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:46:33.524085983 +0000 UTC m=+24.765273822" watchObservedRunningTime="2026-07-28 07:46:34.552398705 +0000 UTC m=+25.793586544" Jul 28 07:46:34.552763 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:34.552737 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfjcr" podStartSLOduration=2.859746512 podStartE2EDuration="25.552729049s" totalImagesPullingTime="22.692982537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:46:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:46:34.552551027 +0000 UTC m=+25.793738856" watchObservedRunningTime="2026-07-28 07:46:34.552729049 +0000 UTC m=+25.793916883" Jul 28 07:46:36.269654 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:36.269502 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:36.270191 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:36.269501 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:36.270191 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:36.269760 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:36.270191 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:36.269502 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:36.270191 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:36.269836 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:36.270191 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:36.269879 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:36.468002 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:36.467968 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d5b87" Jul 28 07:46:36.468159 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:36.468068 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 07:46:36.468545 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:36.468525 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d5b87" Jul 28 07:46:36.529500 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:36.529434 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/ovn-acl-logging/0.log" Jul 28 07:46:36.529822 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:36.529802 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" event={"ID":"685a74dc-0091-47e0-9a6a-0eab75ab6c43","Type":"ContainerStarted","Data":"7f861231c4f1a8b4f1048b6d59c8f69d4bc73dc1fa0b8b005d036402b3ed81ff"} Jul 28 07:46:36.530066 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:36.530049 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:36.530293 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:36.530276 2561 scope.go:117] "RemoveContainer" containerID="bef6d2d6f4692e2d4465fde8cbdd735c34474254e79f6b61f69f3690c8410b49" Jul 28 07:46:36.531778 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:36.531754 2561 generic.go:356] "Generic (PLEG): container finished" podID="b04c48a0-8584-41c2-988e-c44e79c4a7a5" containerID="464a23e418450109570ce933ec82de28be25d2e8975456e669fa41aa5aeae6d5" exitCode=0 Jul 28 07:46:36.531885 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:36.531845 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhxs5" event={"ID":"b04c48a0-8584-41c2-988e-c44e79c4a7a5","Type":"ContainerDied","Data":"464a23e418450109570ce933ec82de28be25d2e8975456e669fa41aa5aeae6d5"} Jul 28 07:46:36.547461 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:36.547438 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:37.537479 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:37.537452 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/ovn-acl-logging/0.log" Jul 28 07:46:37.538173 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:37.537777 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" event={"ID":"685a74dc-0091-47e0-9a6a-0eab75ab6c43","Type":"ContainerStarted","Data":"7610a49e3592fdbcd489f249a921fa10e2d82a1cb2407e92f1840da739048371"} Jul 28 07:46:37.538173 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:37.538064 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:37.538173 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:37.538107 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:37.553455 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:37.553430 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:46:37.573081 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:37.573032 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" podStartSLOduration=8.638178397 podStartE2EDuration="28.573019182s" totalImagesPullingTime="19.934840785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:46:37.572555145 +0000 UTC m=+28.813742979" watchObservedRunningTime="2026-07-28 07:46:37.573019182 +0000 UTC m=+28.814207017" Jul 28 07:46:38.269333 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:38.269094 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:38.269474 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:38.269156 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:38.269474 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:38.269157 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:38.269474 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:38.269335 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:38.269474 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:38.269436 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:38.269643 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:38.269515 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:38.329769 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:38.329693 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bwskd"] Jul 28 07:46:38.330985 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:38.330962 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-47rf9"] Jul 28 07:46:38.335436 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:38.335418 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dnr4f"] Jul 28 07:46:38.541504 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:38.541433 2561 generic.go:356] "Generic (PLEG): container finished" podID="b04c48a0-8584-41c2-988e-c44e79c4a7a5" containerID="477ee77625c7f2e76eda737bb9467bbc67b0c26d5c3bc84ba94bec5fc69974f8" exitCode=0 Jul 28 07:46:38.541840 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:38.541526 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhxs5" event={"ID":"b04c48a0-8584-41c2-988e-c44e79c4a7a5","Type":"ContainerDied","Data":"477ee77625c7f2e76eda737bb9467bbc67b0c26d5c3bc84ba94bec5fc69974f8"} Jul 28 07:46:38.541840 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:38.541565 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:38.541840 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:38.541728 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:38.541840 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:38.541744 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:38.541840 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:38.541803 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:38.541840 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:38.541802 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:38.542095 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:38.541863 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:40.269508 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:40.269469 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:40.269508 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:40.269500 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:40.269900 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:40.269490 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:40.269900 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:40.269585 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:40.269900 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:40.269645 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:40.269900 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:40.269715 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:40.548934 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:40.548857 2561 generic.go:356] "Generic (PLEG): container finished" podID="b04c48a0-8584-41c2-988e-c44e79c4a7a5" containerID="f32b75546317e2e68b5b3deb4d94c3cbc1866d4c60e7355b9e945aa956dd8d65" exitCode=0 Jul 28 07:46:40.548934 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:40.548905 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhxs5" event={"ID":"b04c48a0-8584-41c2-988e-c44e79c4a7a5","Type":"ContainerDied","Data":"f32b75546317e2e68b5b3deb4d94c3cbc1866d4c60e7355b9e945aa956dd8d65"} Jul 28 07:46:41.935864 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:41.935826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:41.936322 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:41.935928 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs\") pod \"network-metrics-daemon-dnr4f\" (UID: \"c79dbe4b-fc12-4534-9cc4-be27338b0967\") " pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:41.936322 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:41.935974 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 07:46:41.936322 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:41.936039 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret podName:764467bb-de90-44d5-bbe3-5a1bfc57a04a nodeName:}" failed. No retries permitted until 2026-07-28 07:47:13.936023785 +0000 UTC m=+65.177211601 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret") pod "global-pull-secret-syncer-bwskd" (UID: "764467bb-de90-44d5-bbe3-5a1bfc57a04a") : object "kube-system"/"original-pull-secret" not registered Jul 28 07:46:41.936322 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:41.936045 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 07:46:41.936322 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:41.936084 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs podName:c79dbe4b-fc12-4534-9cc4-be27338b0967 nodeName:}" failed. No retries permitted until 2026-07-28 07:47:13.936070977 +0000 UTC m=+65.177258790 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs") pod "network-metrics-daemon-dnr4f" (UID: "c79dbe4b-fc12-4534-9cc4-be27338b0967") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 07:46:42.036599 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.036563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbxx\" (UniqueName: \"kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx\") pod \"network-check-target-47rf9\" (UID: \"c00766d2-de01-45bb-a127-7ace967dbbc5\") " pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:42.036776 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:42.036718 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 07:46:42.036776 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:42.036739 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 07:46:42.036776 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:42.036751 2561 projected.go:196] Error preparing data for projected volume kube-api-access-cpbxx for pod openshift-network-diagnostics/network-check-target-47rf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 07:46:42.036900 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:42.036815 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx podName:c00766d2-de01-45bb-a127-7ace967dbbc5 nodeName:}" failed. No retries permitted until 2026-07-28 07:47:14.036793215 +0000 UTC m=+65.277981031 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cpbxx" (UniqueName: "kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx") pod "network-check-target-47rf9" (UID: "c00766d2-de01-45bb-a127-7ace967dbbc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 07:46:42.269569 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.269533 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:42.269736 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.269583 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:42.269736 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.269637 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:42.269736 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:42.269655 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47rf9" podUID="c00766d2-de01-45bb-a127-7ace967dbbc5" Jul 28 07:46:42.269892 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:42.269747 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnr4f" podUID="c79dbe4b-fc12-4534-9cc4-be27338b0967" Jul 28 07:46:42.269892 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:42.269836 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwskd" podUID="764467bb-de90-44d5-bbe3-5a1bfc57a04a" Jul 28 07:46:42.528785 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.528713 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeReady" Jul 28 07:46:42.528945 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.528850 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 07:46:42.566910 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.566884 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-646d78b7d9-mcdkh"] Jul 28 07:46:42.570218 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.570196 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.573597 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.572869 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 07:46:42.573597 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.573151 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7rpxm\"" Jul 28 07:46:42.573597 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.573420 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 07:46:42.573597 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.573451 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 07:46:42.578991 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.578963 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 07:46:42.583928 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.582986 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-646d78b7d9-mcdkh"] Jul 28 07:46:42.586067 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.586045 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g984h"] Jul 28 07:46:42.590631 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.590612 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cx6cm"] Jul 28 07:46:42.590786 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.590747 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g984h" Jul 28 07:46:42.593503 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.593480 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 07:46:42.593602 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.593493 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 07:46:42.593602 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.593541 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qn72b\"" Jul 28 07:46:42.594415 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.594398 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cx6cm" Jul 28 07:46:42.597028 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.597001 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hd277\"" Jul 28 07:46:42.597131 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.597095 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 07:46:42.597190 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.597129 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 07:46:42.597496 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.597477 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 07:46:42.600212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.600185 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cx6cm"] Jul 28 07:46:42.600804 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.600775 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g984h"] Jul 28 07:46:42.719627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.719590 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:42.742461 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.742434 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-856j4\" (UniqueName: \"kubernetes.io/projected/7dd19cbf-97b2-4f8e-998a-d61582de2d3a-kube-api-access-856j4\") pod \"ingress-canary-cx6cm\" (UID: \"7dd19cbf-97b2-4f8e-998a-d61582de2d3a\") " pod="openshift-ingress-canary/ingress-canary-cx6cm" Jul 28 07:46:42.742597 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.742464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a69695cd-a960-4820-914f-d3c83005ccc0-trusted-ca\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.742597 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.742494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63340f7d-b861-410c-99a0-b693430a7661-tmp-dir\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:42.742597 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.742525 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx69t\" (UniqueName: \"kubernetes.io/projected/63340f7d-b861-410c-99a0-b693430a7661-kube-api-access-gx69t\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:42.742716 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.742604 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-bound-sa-token\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.742716 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.742637 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdrk\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-kube-api-access-2cdrk\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.742716 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.742688 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63340f7d-b861-410c-99a0-b693430a7661-config-volume\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:42.742855 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.742715 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:42.742855 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.742767 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7dd19cbf-97b2-4f8e-998a-d61582de2d3a-cert\") pod \"ingress-canary-cx6cm\" (UID: \"7dd19cbf-97b2-4f8e-998a-d61582de2d3a\") " pod="openshift-ingress-canary/ingress-canary-cx6cm" Jul 28 07:46:42.742855 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.742820 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.742855 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.742847 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a69695cd-a960-4820-914f-d3c83005ccc0-ca-trust-extracted\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.743017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.742871 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a69695cd-a960-4820-914f-d3c83005ccc0-registry-certificates\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.743017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.742897 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a69695cd-a960-4820-914f-d3c83005ccc0-installation-pull-secrets\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.743017 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.742948 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a69695cd-a960-4820-914f-d3c83005ccc0-image-registry-private-configuration\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.811137 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.811051 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:42.844207 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844177 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.844207 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844214 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a69695cd-a960-4820-914f-d3c83005ccc0-ca-trust-extracted\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.844441 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844252 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a69695cd-a960-4820-914f-d3c83005ccc0-registry-certificates\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.844441 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844275 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a69695cd-a960-4820-914f-d3c83005ccc0-installation-pull-secrets\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.844441 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a69695cd-a960-4820-914f-d3c83005ccc0-image-registry-private-configuration\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.844441 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:42.844352 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 07:46:42.844441 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:42.844369 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646d78b7d9-mcdkh: secret "image-registry-tls" not found Jul 28 07:46:42.844441 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:42.844440 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls podName:a69695cd-a960-4820-914f-d3c83005ccc0 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:43.344418924 +0000 UTC m=+34.585606739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls") pod "image-registry-646d78b7d9-mcdkh" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0") : secret "image-registry-tls" not found Jul 28 07:46:42.844708 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844368 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-856j4\" (UniqueName: \"kubernetes.io/projected/7dd19cbf-97b2-4f8e-998a-d61582de2d3a-kube-api-access-856j4\") pod \"ingress-canary-cx6cm\" (UID: \"7dd19cbf-97b2-4f8e-998a-d61582de2d3a\") " pod="openshift-ingress-canary/ingress-canary-cx6cm" Jul 28 07:46:42.844708 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a69695cd-a960-4820-914f-d3c83005ccc0-trusted-ca\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.844708 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844637 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a69695cd-a960-4820-914f-d3c83005ccc0-ca-trust-extracted\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.844708 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844647 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63340f7d-b861-410c-99a0-b693430a7661-tmp-dir\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:42.844708 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844670 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx69t\" (UniqueName: \"kubernetes.io/projected/63340f7d-b861-410c-99a0-b693430a7661-kube-api-access-gx69t\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:42.844708 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844699 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-bound-sa-token\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.844937 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdrk\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-kube-api-access-2cdrk\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.844937 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844776 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63340f7d-b861-410c-99a0-b693430a7661-config-volume\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:42.844937 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844811 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:42.844937 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844835 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7dd19cbf-97b2-4f8e-998a-d61582de2d3a-cert\") pod \"ingress-canary-cx6cm\" (UID: \"7dd19cbf-97b2-4f8e-998a-d61582de2d3a\") " pod="openshift-ingress-canary/ingress-canary-cx6cm" Jul 28 07:46:42.845115 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844918 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a69695cd-a960-4820-914f-d3c83005ccc0-registry-certificates\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.845157 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.844981 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63340f7d-b861-410c-99a0-b693430a7661-tmp-dir\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:42.845345 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:42.845323 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 07:46:42.845473 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:42.845389 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls podName:63340f7d-b861-410c-99a0-b693430a7661 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:43.345373348 +0000 UTC m=+34.586561161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls") pod "dns-default-g984h" (UID: "63340f7d-b861-410c-99a0-b693430a7661") : secret "dns-default-metrics-tls" not found Jul 28 07:46:42.845871 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.845688 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63340f7d-b861-410c-99a0-b693430a7661-config-volume\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:42.845871 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.845850 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a69695cd-a960-4820-914f-d3c83005ccc0-trusted-ca\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.849492 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.849468 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a69695cd-a960-4820-914f-d3c83005ccc0-image-registry-private-configuration\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.849584 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.849498 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7dd19cbf-97b2-4f8e-998a-d61582de2d3a-cert\") pod \"ingress-canary-cx6cm\" (UID: \"7dd19cbf-97b2-4f8e-998a-d61582de2d3a\") " pod="openshift-ingress-canary/ingress-canary-cx6cm" Jul 28 07:46:42.849584 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.849534 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a69695cd-a960-4820-914f-d3c83005ccc0-installation-pull-secrets\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.854516 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.854491 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdrk\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-kube-api-access-2cdrk\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.854616 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.854512 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx69t\" (UniqueName: \"kubernetes.io/projected/63340f7d-b861-410c-99a0-b693430a7661-kube-api-access-gx69t\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:42.855055 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.855034 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-856j4\" (UniqueName: \"kubernetes.io/projected/7dd19cbf-97b2-4f8e-998a-d61582de2d3a-kube-api-access-856j4\") pod \"ingress-canary-cx6cm\" (UID: \"7dd19cbf-97b2-4f8e-998a-d61582de2d3a\") " pod="openshift-ingress-canary/ingress-canary-cx6cm" Jul 28 07:46:42.855602 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.855580 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-bound-sa-token\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:42.907954 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:42.907919 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cx6cm" Jul 28 07:46:43.068087 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:43.067991 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cx6cm"] Jul 28 07:46:43.348968 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:43.348882 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:43.348968 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:43.348934 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:43.349180 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:43.349049 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 07:46:43.349180 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:43.349064 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 07:46:43.349180 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:43.349077 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646d78b7d9-mcdkh: secret "image-registry-tls" not found Jul 28 07:46:43.349180 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:43.349131 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls podName:a69695cd-a960-4820-914f-d3c83005ccc0 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:44.349111213 +0000 UTC m=+35.590299026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls") pod "image-registry-646d78b7d9-mcdkh" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0") : secret "image-registry-tls" not found Jul 28 07:46:43.349180 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:43.349148 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls podName:63340f7d-b861-410c-99a0-b693430a7661 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:44.349139905 +0000 UTC m=+35.590327723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls") pod "dns-default-g984h" (UID: "63340f7d-b861-410c-99a0-b693430a7661") : secret "dns-default-metrics-tls" not found Jul 28 07:46:43.556735 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:43.556698 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cx6cm" event={"ID":"7dd19cbf-97b2-4f8e-998a-d61582de2d3a","Type":"ContainerStarted","Data":"67c4ef4a06e4cea7adfc2e5d6594a1a760ab9f3e30d0a82578cdf6ddc88307b8"} Jul 28 07:46:44.104193 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:44.104151 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:44.206524 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:44.206483 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:44.268970 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:44.268930 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:46:44.269393 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:44.269374 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:46:44.269789 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:44.269770 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:46:44.272760 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:44.272739 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 07:46:44.272861 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:44.272739 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 07:46:44.274093 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:44.274076 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lp4z9\"" Jul 28 07:46:44.274205 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:44.274097 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 07:46:44.274205 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:44.274130 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 07:46:44.274205 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:44.274097 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4rbtx\"" Jul 28 07:46:44.357695 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:44.357604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:44.357695 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:44.357650 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:44.357899 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:44.357789 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 07:46:44.357899 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:44.357818 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 07:46:44.357899 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:44.357838 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646d78b7d9-mcdkh: secret "image-registry-tls" not found Jul 28 07:46:44.357899 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:44.357856 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls podName:63340f7d-b861-410c-99a0-b693430a7661 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:46.357837096 +0000 UTC m=+37.599024946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls") pod "dns-default-g984h" (UID: "63340f7d-b861-410c-99a0-b693430a7661") : secret "dns-default-metrics-tls" not found Jul 28 07:46:44.357899 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:44.357891 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls podName:a69695cd-a960-4820-914f-d3c83005ccc0 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:46.35787177 +0000 UTC m=+37.599059599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls") pod "image-registry-646d78b7d9-mcdkh" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0") : secret "image-registry-tls" not found Jul 28 07:46:45.034577 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:45.034388 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:45.106141 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:45.106102 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:45.565975 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:45.565942 2561 generic.go:356] "Generic (PLEG): container finished" podID="b04c48a0-8584-41c2-988e-c44e79c4a7a5" containerID="83514908aee2d5a61ce0f7c0cacc94347bb4a28a5ff248b0f9d96d344ed37a50" exitCode=0 Jul 28 07:46:45.566145 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:45.565997 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhxs5" event={"ID":"b04c48a0-8584-41c2-988e-c44e79c4a7a5","Type":"ContainerDied","Data":"83514908aee2d5a61ce0f7c0cacc94347bb4a28a5ff248b0f9d96d344ed37a50"} Jul 28 07:46:46.374509 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:46.374287 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:46.374942 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:46.374532 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:46.374942 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:46.374434 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 07:46:46.374942 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:46.374651 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 07:46:46.374942 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:46.374661 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls podName:63340f7d-b861-410c-99a0-b693430a7661 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:50.374636115 +0000 UTC m=+41.615823931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls") pod "dns-default-g984h" (UID: "63340f7d-b861-410c-99a0-b693430a7661") : secret "dns-default-metrics-tls" not found Jul 28 07:46:46.374942 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:46.374667 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646d78b7d9-mcdkh: secret "image-registry-tls" not found Jul 28 07:46:46.374942 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:46.374716 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls podName:a69695cd-a960-4820-914f-d3c83005ccc0 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:50.374700983 +0000 UTC m=+41.615888796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls") pod "image-registry-646d78b7d9-mcdkh" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0") : secret "image-registry-tls" not found Jul 28 07:46:46.402393 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:46.402355 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:46.499427 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:46.499390 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:46.573076 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:46.573037 2561 generic.go:356] "Generic (PLEG): container finished" podID="b04c48a0-8584-41c2-988e-c44e79c4a7a5" containerID="266119b44f96d55c3dcc0a3f9b3d81ee16d5c3b7956d46272d1875fbe2f464f2" exitCode=0 Jul 28 07:46:46.573260 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:46.573101 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhxs5" event={"ID":"b04c48a0-8584-41c2-988e-c44e79c4a7a5","Type":"ContainerDied","Data":"266119b44f96d55c3dcc0a3f9b3d81ee16d5c3b7956d46272d1875fbe2f464f2"} Jul 28 07:46:46.604429 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:46.604395 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:47.396368 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:47.396334 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:47.496853 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:47.496827 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:47.571587 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:47.571556 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:47.576387 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:47.576358 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cx6cm" event={"ID":"7dd19cbf-97b2-4f8e-998a-d61582de2d3a","Type":"ContainerStarted","Data":"93bfc486a326fc446e573d8f1692d2f1697b35755ff6eb6476fa960784ba9164"} Jul 28 07:46:47.579479 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:47.579446 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhxs5" event={"ID":"b04c48a0-8584-41c2-988e-c44e79c4a7a5","Type":"ContainerStarted","Data":"2e520068e030723e91ff931f343ec1785de79806524e3938467547977e28c54b"} Jul 28 07:46:47.600510 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:47.600462 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cx6cm" podStartSLOduration=1.777047665 podStartE2EDuration="5.600445633s" totalImagesPullingTime="3.823397968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:46:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:46:47.600157373 +0000 UTC m=+38.841345209" watchObservedRunningTime="2026-07-28 07:46:47.600445633 +0000 UTC m=+38.841633467" Jul 28 07:46:47.628804 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:47.628757 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zhxs5" podStartSLOduration=7.596140362 podStartE2EDuration="38.62874165s" totalImagesPullingTime="31.032601288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:46:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:46:47.627575831 +0000 UTC m=+38.868763678" watchObservedRunningTime="2026-07-28 07:46:47.62874165 +0000 UTC m=+38.869929485" Jul 28 07:46:47.754886 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:47.754846 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:47.856896 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:47.856866 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:47.964644 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:47.964612 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:48.198049 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:48.197962 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:48.310048 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:48.310022 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:50.201538 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:50.201490 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:46:50.404741 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:50.404703 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:50.404741 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:50.404745 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:50.404941 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:50.404852 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 07:46:50.404941 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:50.404853 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 07:46:50.404941 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:50.404916 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646d78b7d9-mcdkh: secret "image-registry-tls" not found Jul 28 07:46:50.404941 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:50.404920 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls podName:63340f7d-b861-410c-99a0-b693430a7661 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:58.404899677 +0000 UTC m=+49.646087510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls") pod "dns-default-g984h" (UID: "63340f7d-b861-410c-99a0-b693430a7661") : secret "dns-default-metrics-tls" not found Jul 28 07:46:50.405072 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:50.404952 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls podName:a69695cd-a960-4820-914f-d3c83005ccc0 nodeName:}" failed. No retries permitted until 2026-07-28 07:46:58.404941405 +0000 UTC m=+49.646129244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls") pod "image-registry-646d78b7d9-mcdkh" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0") : secret "image-registry-tls" not found Jul 28 07:46:58.461601 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:58.461560 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:46:58.461601 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:58.461606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:46:58.462073 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:58.461714 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 07:46:58.462073 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:58.461714 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 07:46:58.462073 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:58.461724 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646d78b7d9-mcdkh: secret "image-registry-tls" not found Jul 28 07:46:58.462073 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:58.461776 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls podName:a69695cd-a960-4820-914f-d3c83005ccc0 nodeName:}" failed. No retries permitted until 2026-07-28 07:47:14.461762921 +0000 UTC m=+65.702950733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls") pod "image-registry-646d78b7d9-mcdkh" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0") : secret "image-registry-tls" not found Jul 28 07:46:58.462073 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:46:58.461788 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls podName:63340f7d-b861-410c-99a0-b693430a7661 nodeName:}" failed. No retries permitted until 2026-07-28 07:47:14.461782254 +0000 UTC m=+65.702970067 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls") pod "dns-default-g984h" (UID: "63340f7d-b861-410c-99a0-b693430a7661") : secret "dns-default-metrics-tls" not found Jul 28 07:46:59.842743 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:46:59.842708 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:01.018740 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:01.018696 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:02.513166 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:02.513132 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:02.633050 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:02.633016 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:03.347339 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:03.347300 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:03.448338 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:03.448301 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:04.763057 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:04.763020 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:09.568316 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:09.568288 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmf27" Jul 28 07:47:09.757570 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:09.757541 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:09.848362 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:09.848282 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:13.976931 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:13.976880 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs\") pod \"network-metrics-daemon-dnr4f\" (UID: \"c79dbe4b-fc12-4534-9cc4-be27338b0967\") " pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:47:13.977340 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:13.976942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:47:13.979604 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:13.979581 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 07:47:13.979715 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:13.979644 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 07:47:13.987743 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:13.987725 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 07:47:13.987832 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:13.987822 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs podName:c79dbe4b-fc12-4534-9cc4-be27338b0967 nodeName:}" failed. No retries permitted until 2026-07-28 07:48:17.987805483 +0000 UTC m=+129.228993296 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs") pod "network-metrics-daemon-dnr4f" (UID: "c79dbe4b-fc12-4534-9cc4-be27338b0967") : secret "metrics-daemon-secret" not found Jul 28 07:47:13.991276 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:13.991249 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/764467bb-de90-44d5-bbe3-5a1bfc57a04a-original-pull-secret\") pod \"global-pull-secret-syncer-bwskd\" (UID: \"764467bb-de90-44d5-bbe3-5a1bfc57a04a\") " pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:47:14.077646 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:14.077602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbxx\" (UniqueName: \"kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx\") pod \"network-check-target-47rf9\" (UID: \"c00766d2-de01-45bb-a127-7ace967dbbc5\") " pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:47:14.080378 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:14.080360 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 07:47:14.090551 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:14.090533 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 07:47:14.100978 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:14.100952 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpbxx\" (UniqueName: \"kubernetes.io/projected/c00766d2-de01-45bb-a127-7ace967dbbc5-kube-api-access-cpbxx\") pod \"network-check-target-47rf9\" (UID: \"c00766d2-de01-45bb-a127-7ace967dbbc5\") " pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:47:14.284724 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:14.284648 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4rbtx\"" Jul 28 07:47:14.290797 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:14.290776 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwskd" Jul 28 07:47:14.292867 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:14.292838 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:47:14.441088 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:14.441057 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-47rf9"] Jul 28 07:47:14.444819 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:47:14.444792 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00766d2_de01_45bb_a127_7ace967dbbc5.slice/crio-4f68bd5afa82ab138dd4afdb6c928a12e80bb8ff9dd50e193000ffb5259a3237 WatchSource:0}: Error finding container 4f68bd5afa82ab138dd4afdb6c928a12e80bb8ff9dd50e193000ffb5259a3237: Status 404 returned error can't find the container with id 4f68bd5afa82ab138dd4afdb6c928a12e80bb8ff9dd50e193000ffb5259a3237 Jul 28 07:47:14.456770 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:14.456750 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bwskd"] Jul 28 07:47:14.459394 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:47:14.459373 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764467bb_de90_44d5_bbe3_5a1bfc57a04a.slice/crio-9aa39c97130b3fad604512ba1f3e9ae1870e714b4fab04078efafe5ac9fc0295 WatchSource:0}: Error finding container 9aa39c97130b3fad604512ba1f3e9ae1870e714b4fab04078efafe5ac9fc0295: Status 404 returned error can't find the container with id 9aa39c97130b3fad604512ba1f3e9ae1870e714b4fab04078efafe5ac9fc0295 Jul 28 07:47:14.480849 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:14.480826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:47:14.480964 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:14.480860 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:47:14.481003 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:14.480970 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 07:47:14.481003 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:14.480973 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 07:47:14.481003 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:14.480991 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646d78b7d9-mcdkh: secret "image-registry-tls" not found Jul 28 07:47:14.481093 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:14.481025 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls podName:63340f7d-b861-410c-99a0-b693430a7661 nodeName:}" failed. No retries permitted until 2026-07-28 07:47:46.481009619 +0000 UTC m=+97.722197434 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls") pod "dns-default-g984h" (UID: "63340f7d-b861-410c-99a0-b693430a7661") : secret "dns-default-metrics-tls" not found Jul 28 07:47:14.481093 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:14.481043 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls podName:a69695cd-a960-4820-914f-d3c83005ccc0 nodeName:}" failed. No retries permitted until 2026-07-28 07:47:46.481031246 +0000 UTC m=+97.722219059 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls") pod "image-registry-646d78b7d9-mcdkh" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0") : secret "image-registry-tls" not found Jul 28 07:47:14.640091 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:14.640009 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bwskd" event={"ID":"764467bb-de90-44d5-bbe3-5a1bfc57a04a","Type":"ContainerStarted","Data":"9aa39c97130b3fad604512ba1f3e9ae1870e714b4fab04078efafe5ac9fc0295"} Jul 28 07:47:14.640996 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:14.640970 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-47rf9" event={"ID":"c00766d2-de01-45bb-a127-7ace967dbbc5","Type":"ContainerStarted","Data":"4f68bd5afa82ab138dd4afdb6c928a12e80bb8ff9dd50e193000ffb5259a3237"} Jul 28 07:47:16.216355 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:16.216210 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:16.280328 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:16.280298 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:19.654983 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:19.654888 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-47rf9" event={"ID":"c00766d2-de01-45bb-a127-7ace967dbbc5","Type":"ContainerStarted","Data":"4345184b71438500b57a3fa531110f020d68cb1c83332b518b182f6e4cf14da0"} Jul 28 07:47:19.654983 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:19.654981 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:47:19.656353 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:19.656325 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bwskd" event={"ID":"764467bb-de90-44d5-bbe3-5a1bfc57a04a","Type":"ContainerStarted","Data":"c7b4794e5852f88806262bbcd9fbdbf2a04a81b4037e21e689b09d7701e84916"} Jul 28 07:47:19.687489 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:19.687441 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-47rf9" podStartSLOduration=65.728346359 podStartE2EDuration="1m10.687427798s" totalImagesPullingTime="4.959081439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:47:19.687375316 +0000 UTC m=+70.928563151" watchObservedRunningTime="2026-07-28 07:47:19.687427798 +0000 UTC m=+70.928615633" Jul 28 07:47:19.715782 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:19.715735 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bwskd" podStartSLOduration=65.770530263 podStartE2EDuration="1m10.715722119s" totalImagesPullingTime="4.945191856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:47:19.71535148 +0000 UTC m=+70.956539315" watchObservedRunningTime="2026-07-28 07:47:19.715722119 +0000 UTC m=+70.956909955" Jul 28 07:47:22.103483 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:22.103446 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:22.203921 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:22.203878 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:23.476661 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:23.476626 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:23.536396 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:23.536367 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:29.672276 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.672225 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kt56p"] Jul 28 07:47:29.674964 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.674949 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.676650 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.676627 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-6b2tp"] Jul 28 07:47:29.677910 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.677883 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sqzcw\"" Jul 28 07:47:29.678011 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.677883 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 28 07:47:29.678250 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.678213 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 28 07:47:29.678940 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.678926 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 07:47:29.678940 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.678933 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 07:47:29.680638 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.679943 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b2tp" Jul 28 07:47:29.683165 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.683145 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rb2c7\"" Jul 28 07:47:29.686650 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.686628 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 28 07:47:29.694331 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.694311 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kt56p"] Jul 28 07:47:29.695008 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.694991 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-6b2tp"] Jul 28 07:47:29.783012 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.782986 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39253359-6c29-4f64-bff2-e7547420003a-tmp\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.783012 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.783015 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wcz9\" (UniqueName: \"kubernetes.io/projected/39253359-6c29-4f64-bff2-e7547420003a-kube-api-access-4wcz9\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.783256 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.783036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39253359-6c29-4f64-bff2-e7547420003a-serving-cert\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.783256 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.783067 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39253359-6c29-4f64-bff2-e7547420003a-snapshots\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.783256 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.783151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39253359-6c29-4f64-bff2-e7547420003a-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.783256 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.783250 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39253359-6c29-4f64-bff2-e7547420003a-service-ca-bundle\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.783430 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.783307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5sjt\" (UniqueName: \"kubernetes.io/projected/60942839-5c15-456e-902b-360596800feb-kube-api-access-m5sjt\") pod \"network-check-source-7d88cb55d8-6b2tp\" (UID: \"60942839-5c15-456e-902b-360596800feb\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b2tp" Jul 28 07:47:29.822786 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.822762 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6"] Jul 28 07:47:29.825500 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.825484 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" Jul 28 07:47:29.828043 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.828016 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fctjl\"" Jul 28 07:47:29.828043 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.828028 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 07:47:29.828189 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.828044 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 07:47:29.828293 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.828277 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 07:47:29.828407 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.828379 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 07:47:29.838265 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.838223 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6"] Jul 28 07:47:29.884279 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.884254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39253359-6c29-4f64-bff2-e7547420003a-snapshots\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.884363 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.884294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39253359-6c29-4f64-bff2-e7547420003a-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.884363 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.884347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39253359-6c29-4f64-bff2-e7547420003a-service-ca-bundle\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.884456 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.884386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5sjt\" (UniqueName: \"kubernetes.io/projected/60942839-5c15-456e-902b-360596800feb-kube-api-access-m5sjt\") pod \"network-check-source-7d88cb55d8-6b2tp\" (UID: \"60942839-5c15-456e-902b-360596800feb\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b2tp" Jul 28 07:47:29.884456 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.884415 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6bvc\" (UniqueName: \"kubernetes.io/projected/3837e73f-948c-40bd-b62e-5b56d9c40be3-kube-api-access-d6bvc\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6\" (UID: \"3837e73f-948c-40bd-b62e-5b56d9c40be3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" Jul 28 07:47:29.884456 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.884443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39253359-6c29-4f64-bff2-e7547420003a-tmp\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.884585 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.884472 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wcz9\" (UniqueName: \"kubernetes.io/projected/39253359-6c29-4f64-bff2-e7547420003a-kube-api-access-4wcz9\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.884585 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.884501 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39253359-6c29-4f64-bff2-e7547420003a-serving-cert\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.884803 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.884613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3837e73f-948c-40bd-b62e-5b56d9c40be3-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6\" (UID: \"3837e73f-948c-40bd-b62e-5b56d9c40be3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" Jul 28 07:47:29.884970 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.884946 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39253359-6c29-4f64-bff2-e7547420003a-tmp\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.885109 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.885083 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39253359-6c29-4f64-bff2-e7547420003a-service-ca-bundle\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.885214 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.884690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3837e73f-948c-40bd-b62e-5b56d9c40be3-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6\" (UID: \"3837e73f-948c-40bd-b62e-5b56d9c40be3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" Jul 28 07:47:29.885214 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.885171 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39253359-6c29-4f64-bff2-e7547420003a-snapshots\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.885800 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.885782 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39253359-6c29-4f64-bff2-e7547420003a-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.887300 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.887281 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39253359-6c29-4f64-bff2-e7547420003a-serving-cert\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.894791 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.894771 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wcz9\" (UniqueName: \"kubernetes.io/projected/39253359-6c29-4f64-bff2-e7547420003a-kube-api-access-4wcz9\") pod \"insights-operator-5885fdb759-kt56p\" (UID: \"39253359-6c29-4f64-bff2-e7547420003a\") " pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.901673 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.901650 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5sjt\" (UniqueName: \"kubernetes.io/projected/60942839-5c15-456e-902b-360596800feb-kube-api-access-m5sjt\") pod \"network-check-source-7d88cb55d8-6b2tp\" (UID: \"60942839-5c15-456e-902b-360596800feb\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b2tp" Jul 28 07:47:29.985915 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.985880 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6bvc\" (UniqueName: \"kubernetes.io/projected/3837e73f-948c-40bd-b62e-5b56d9c40be3-kube-api-access-d6bvc\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6\" (UID: \"3837e73f-948c-40bd-b62e-5b56d9c40be3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" Jul 28 07:47:29.986033 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.985925 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3837e73f-948c-40bd-b62e-5b56d9c40be3-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6\" (UID: \"3837e73f-948c-40bd-b62e-5b56d9c40be3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" Jul 28 07:47:29.986033 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.985943 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3837e73f-948c-40bd-b62e-5b56d9c40be3-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6\" (UID: \"3837e73f-948c-40bd-b62e-5b56d9c40be3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" Jul 28 07:47:29.986541 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.986516 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3837e73f-948c-40bd-b62e-5b56d9c40be3-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6\" (UID: \"3837e73f-948c-40bd-b62e-5b56d9c40be3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" Jul 28 07:47:29.987423 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.987407 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-kt56p" Jul 28 07:47:29.988078 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.988053 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3837e73f-948c-40bd-b62e-5b56d9c40be3-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6\" (UID: \"3837e73f-948c-40bd-b62e-5b56d9c40be3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" Jul 28 07:47:29.992208 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.992188 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b2tp" Jul 28 07:47:29.994072 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:29.994045 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6bvc\" (UniqueName: \"kubernetes.io/projected/3837e73f-948c-40bd-b62e-5b56d9c40be3-kube-api-access-d6bvc\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6\" (UID: \"3837e73f-948c-40bd-b62e-5b56d9c40be3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" Jul 28 07:47:30.020366 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.020332 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:30.109315 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.109280 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:30.118195 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.118171 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-6b2tp"] Jul 28 07:47:30.121197 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:47:30.121174 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60942839_5c15_456e_902b_360596800feb.slice/crio-90f4e1db2f766d09e9d3c41a82fa6120d41a83101b64fddda32d057b94a26fa2 WatchSource:0}: Error finding container 90f4e1db2f766d09e9d3c41a82fa6120d41a83101b64fddda32d057b94a26fa2: Status 404 returned error can't find the container with id 90f4e1db2f766d09e9d3c41a82fa6120d41a83101b64fddda32d057b94a26fa2 Jul 28 07:47:30.133992 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.133976 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" Jul 28 07:47:30.140439 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.140409 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kt56p"] Jul 28 07:47:30.156305 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:47:30.156268 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39253359_6c29_4f64_bff2_e7547420003a.slice/crio-e966f3878c172742b700e8c64e7a66be005885c710658c3ecb89111694ed82d0 WatchSource:0}: Error finding container e966f3878c172742b700e8c64e7a66be005885c710658c3ecb89111694ed82d0: Status 404 returned error can't find the container with id e966f3878c172742b700e8c64e7a66be005885c710658c3ecb89111694ed82d0 Jul 28 07:47:30.265730 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.265647 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6"] Jul 28 07:47:30.269762 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:47:30.269733 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3837e73f_948c_40bd_b62e_5b56d9c40be3.slice/crio-cc43e7ae041b0f33f2a177cae8077b9dd4e3199de65b9d86172df78706367285 WatchSource:0}: Error finding container cc43e7ae041b0f33f2a177cae8077b9dd4e3199de65b9d86172df78706367285: Status 404 returned error can't find the container with id cc43e7ae041b0f33f2a177cae8077b9dd4e3199de65b9d86172df78706367285 Jul 28 07:47:30.564707 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.564634 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5"] Jul 28 07:47:30.567880 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.567864 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" Jul 28 07:47:30.571257 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.571221 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4wf4b\"" Jul 28 07:47:30.571602 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.571584 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 28 07:47:30.571860 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.571846 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 28 07:47:30.578601 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.578581 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5"] Jul 28 07:47:30.684139 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.684002 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b2tp" event={"ID":"60942839-5c15-456e-902b-360596800feb","Type":"ContainerStarted","Data":"1dfcc9401a05879fb49eac11fdf43ec480a18a6a09dc6463c327e6e9fbc1c326"} Jul 28 07:47:30.684139 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.684063 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b2tp" event={"ID":"60942839-5c15-456e-902b-360596800feb","Type":"ContainerStarted","Data":"90f4e1db2f766d09e9d3c41a82fa6120d41a83101b64fddda32d057b94a26fa2"} Jul 28 07:47:30.685862 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.685833 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" event={"ID":"3837e73f-948c-40bd-b62e-5b56d9c40be3","Type":"ContainerStarted","Data":"cc43e7ae041b0f33f2a177cae8077b9dd4e3199de65b9d86172df78706367285"} Jul 28 07:47:30.687216 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.687193 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kt56p" event={"ID":"39253359-6c29-4f64-bff2-e7547420003a","Type":"ContainerStarted","Data":"e966f3878c172742b700e8c64e7a66be005885c710658c3ecb89111694ed82d0"} Jul 28 07:47:30.692827 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.692802 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q8pt5\" (UID: \"68e5ffc6-636f-43c1-a25d-5fc5d6a898b3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" Jul 28 07:47:30.692947 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.692905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-q8pt5\" (UID: \"68e5ffc6-636f-43c1-a25d-5fc5d6a898b3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" Jul 28 07:47:30.705741 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.705696 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6b2tp" podStartSLOduration=1.705684047 podStartE2EDuration="1.705684047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:47:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:47:30.705101158 +0000 UTC m=+81.946288994" watchObservedRunningTime="2026-07-28 07:47:30.705684047 +0000 UTC m=+81.946871860" Jul 28 07:47:30.794094 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.794055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-q8pt5\" (UID: \"68e5ffc6-636f-43c1-a25d-5fc5d6a898b3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" Jul 28 07:47:30.794301 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.794151 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q8pt5\" (UID: \"68e5ffc6-636f-43c1-a25d-5fc5d6a898b3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" Jul 28 07:47:30.794375 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:30.794300 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 07:47:30.794375 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:30.794360 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert podName:68e5ffc6-636f-43c1-a25d-5fc5d6a898b3 nodeName:}" failed. No retries permitted until 2026-07-28 07:47:31.294345983 +0000 UTC m=+82.535533797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-q8pt5" (UID: "68e5ffc6-636f-43c1-a25d-5fc5d6a898b3") : secret "networking-console-plugin-cert" not found Jul 28 07:47:30.794906 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:30.794875 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-q8pt5\" (UID: \"68e5ffc6-636f-43c1-a25d-5fc5d6a898b3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" Jul 28 07:47:31.298267 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:31.298204 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q8pt5\" (UID: \"68e5ffc6-636f-43c1-a25d-5fc5d6a898b3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" Jul 28 07:47:31.298426 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:31.298370 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 07:47:31.298484 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:31.298440 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert podName:68e5ffc6-636f-43c1-a25d-5fc5d6a898b3 nodeName:}" failed. No retries permitted until 2026-07-28 07:47:32.298418874 +0000 UTC m=+83.539606692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-q8pt5" (UID: "68e5ffc6-636f-43c1-a25d-5fc5d6a898b3") : secret "networking-console-plugin-cert" not found Jul 28 07:47:32.305431 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:32.305394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q8pt5\" (UID: \"68e5ffc6-636f-43c1-a25d-5fc5d6a898b3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" Jul 28 07:47:32.305893 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:32.305565 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 07:47:32.305893 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:32.305647 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert podName:68e5ffc6-636f-43c1-a25d-5fc5d6a898b3 nodeName:}" failed. No retries permitted until 2026-07-28 07:47:34.305627339 +0000 UTC m=+85.546815169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-q8pt5" (UID: "68e5ffc6-636f-43c1-a25d-5fc5d6a898b3") : secret "networking-console-plugin-cert" not found Jul 28 07:47:32.584787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:32.584705 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:32.665783 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:32.665748 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:33.651348 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.651311 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bjvdl"] Jul 28 07:47:33.654555 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.654537 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:33.659896 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.659871 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 07:47:33.660030 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.660015 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dd2l6\"" Jul 28 07:47:33.660753 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.660737 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 07:47:33.664855 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.664836 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bjvdl"] Jul 28 07:47:33.681742 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.681708 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:33.698988 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.698943 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" event={"ID":"3837e73f-948c-40bd-b62e-5b56d9c40be3","Type":"ContainerStarted","Data":"9f9eecf8907496220a2211d1402f91e239f62ba93dd939ca1127c7311aebd647"} Jul 28 07:47:33.702126 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.702101 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kt56p" event={"ID":"39253359-6c29-4f64-bff2-e7547420003a","Type":"ContainerStarted","Data":"9faf213655f7c10a32fb1e191574d823a1592775f2ef92b0e9f58ab14df5c907"} Jul 28 07:47:33.714646 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.714621 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:33.714771 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.714668 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmwhc\" (UniqueName: \"kubernetes.io/projected/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-api-access-tmwhc\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:33.714816 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.714759 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7050f880-6fe2-492e-ae4b-63d98dc2dfea-data-volume\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:33.714816 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.714798 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:33.714887 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.714830 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7050f880-6fe2-492e-ae4b-63d98dc2dfea-crio-socket\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:33.743810 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.743761 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-kt56p" podStartSLOduration=2.204551606 podStartE2EDuration="4.743745521s" totalImagesPullingTime="2.539193915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:47:33.742800939 +0000 UTC m=+84.983988774" watchObservedRunningTime="2026-07-28 07:47:33.743745521 +0000 UTC m=+84.984933356" Jul 28 07:47:33.743949 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.743872 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" podStartSLOduration=2.314989441 podStartE2EDuration="4.743867962s" totalImagesPullingTime="2.428878521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:47:33.71991779 +0000 UTC m=+84.961105624" watchObservedRunningTime="2026-07-28 07:47:33.743867962 +0000 UTC m=+84.985055797" Jul 28 07:47:33.756178 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.756145 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:33.815832 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.815797 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmwhc\" (UniqueName: \"kubernetes.io/projected/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-api-access-tmwhc\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:33.815999 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.815861 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7050f880-6fe2-492e-ae4b-63d98dc2dfea-data-volume\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:33.815999 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.815885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:33.815999 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.815912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7050f880-6fe2-492e-ae4b-63d98dc2dfea-crio-socket\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:33.816166 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.816030 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7050f880-6fe2-492e-ae4b-63d98dc2dfea-crio-socket\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:33.816166 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.816159 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:33.816341 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:33.816322 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 07:47:33.816399 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.816323 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7050f880-6fe2-492e-ae4b-63d98dc2dfea-data-volume\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:33.816460 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:33.816325 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 07:47:33.816460 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:33.816458 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls podName:7050f880-6fe2-492e-ae4b-63d98dc2dfea nodeName:}" failed. No retries permitted until 2026-07-28 07:47:34.316432964 +0000 UTC m=+85.557620787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjvdl" (UID: "7050f880-6fe2-492e-ae4b-63d98dc2dfea") : secret "insights-runtime-extractor-tls" not found Jul 28 07:47:33.816551 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:33.816511 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm podName:7050f880-6fe2-492e-ae4b-63d98dc2dfea nodeName:}" failed. No retries permitted until 2026-07-28 07:47:34.316490375 +0000 UTC m=+85.557678219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bjvdl" (UID: "7050f880-6fe2-492e-ae4b-63d98dc2dfea") : configmap "kube-rbac-proxy" not found Jul 28 07:47:33.825163 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.825140 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmwhc\" (UniqueName: \"kubernetes.io/projected/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-api-access-tmwhc\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:33.991666 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:33.991629 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:34.082489 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:34.082459 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:34.182513 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:34.182483 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:34.320879 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:34.320776 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:34.320879 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:34.320841 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q8pt5\" (UID: \"68e5ffc6-636f-43c1-a25d-5fc5d6a898b3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" Jul 28 07:47:34.320879 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:34.320864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:34.321138 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:34.320929 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 07:47:34.321138 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:34.320952 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 07:47:34.321138 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:34.320989 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 07:47:34.321138 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:34.320993 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm podName:7050f880-6fe2-492e-ae4b-63d98dc2dfea nodeName:}" failed. No retries permitted until 2026-07-28 07:47:35.320976463 +0000 UTC m=+86.562164278 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bjvdl" (UID: "7050f880-6fe2-492e-ae4b-63d98dc2dfea") : configmap "kube-rbac-proxy" not found Jul 28 07:47:34.321138 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:34.321053 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls podName:7050f880-6fe2-492e-ae4b-63d98dc2dfea nodeName:}" failed. No retries permitted until 2026-07-28 07:47:35.321038447 +0000 UTC m=+86.562226260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjvdl" (UID: "7050f880-6fe2-492e-ae4b-63d98dc2dfea") : secret "insights-runtime-extractor-tls" not found Jul 28 07:47:34.321138 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:34.321063 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert podName:68e5ffc6-636f-43c1-a25d-5fc5d6a898b3 nodeName:}" failed. No retries permitted until 2026-07-28 07:47:38.321057294 +0000 UTC m=+89.562245107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-q8pt5" (UID: "68e5ffc6-636f-43c1-a25d-5fc5d6a898b3") : secret "networking-console-plugin-cert" not found Jul 28 07:47:34.755407 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:34.755368 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:35.054340 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:35.054212 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:35.179799 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:35.179748 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:35.328624 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:35.328552 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:35.328624 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:35.328611 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:35.328801 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:35.328678 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 07:47:35.328801 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:35.328697 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 07:47:35.328801 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:35.328733 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm podName:7050f880-6fe2-492e-ae4b-63d98dc2dfea nodeName:}" failed. No retries permitted until 2026-07-28 07:47:37.328720166 +0000 UTC m=+88.569907979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bjvdl" (UID: "7050f880-6fe2-492e-ae4b-63d98dc2dfea") : configmap "kube-rbac-proxy" not found Jul 28 07:47:35.328801 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:35.328760 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls podName:7050f880-6fe2-492e-ae4b-63d98dc2dfea nodeName:}" failed. No retries permitted until 2026-07-28 07:47:37.328746592 +0000 UTC m=+88.569934407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjvdl" (UID: "7050f880-6fe2-492e-ae4b-63d98dc2dfea") : secret "insights-runtime-extractor-tls" not found Jul 28 07:47:35.424362 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:35.424329 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9g4sg_f7f6e438-4728-48e0-8506-c771771bcb7b/dns-node-resolver/0.log" Jul 28 07:47:35.521539 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:35.521508 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:35.622611 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:35.622515 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:35.864144 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:35.864111 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:35.995369 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:35.995335 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:36.232953 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:36.232919 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:36.333501 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:36.333412 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:36.622961 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:36.622885 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t7gkh_c9a3c30e-bec9-4339-bb7a-caecdd1b0684/node-ca/0.log" Jul 28 07:47:37.222438 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:37.222411 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cx6cm_7dd19cbf-97b2-4f8e-998a-d61582de2d3a/serve-healthcheck-canary/0.log" Jul 28 07:47:37.343333 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:37.343293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:37.343499 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:37.343367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:37.343499 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:37.343437 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 07:47:37.343499 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:37.343461 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 07:47:37.343605 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:37.343520 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm podName:7050f880-6fe2-492e-ae4b-63d98dc2dfea nodeName:}" failed. No retries permitted until 2026-07-28 07:47:41.343503707 +0000 UTC m=+92.584691520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bjvdl" (UID: "7050f880-6fe2-492e-ae4b-63d98dc2dfea") : configmap "kube-rbac-proxy" not found Jul 28 07:47:37.343605 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:37.343534 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls podName:7050f880-6fe2-492e-ae4b-63d98dc2dfea nodeName:}" failed. No retries permitted until 2026-07-28 07:47:41.343528673 +0000 UTC m=+92.584716485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjvdl" (UID: "7050f880-6fe2-492e-ae4b-63d98dc2dfea") : secret "insights-runtime-extractor-tls" not found Jul 28 07:47:37.415417 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:37.415376 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:37.495892 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:37.495808 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:38.350379 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:38.350346 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q8pt5\" (UID: \"68e5ffc6-636f-43c1-a25d-5fc5d6a898b3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" Jul 28 07:47:38.350762 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:38.350531 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 07:47:38.350762 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:38.350595 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert podName:68e5ffc6-636f-43c1-a25d-5fc5d6a898b3 nodeName:}" failed. No retries permitted until 2026-07-28 07:47:46.35058042 +0000 UTC m=+97.591768232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-q8pt5" (UID: "68e5ffc6-636f-43c1-a25d-5fc5d6a898b3") : secret "networking-console-plugin-cert" not found Jul 28 07:47:38.564362 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:38.564328 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:41.057557 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:41.057517 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:41.249409 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:41.249371 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:41.349854 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:41.349767 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:41.373829 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:41.373797 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:41.373966 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:41.373864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:41.373966 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:41.373914 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 07:47:41.373966 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:41.373957 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 07:47:41.374089 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:41.373978 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm podName:7050f880-6fe2-492e-ae4b-63d98dc2dfea nodeName:}" failed. No retries permitted until 2026-07-28 07:47:49.373961799 +0000 UTC m=+100.615149613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bjvdl" (UID: "7050f880-6fe2-492e-ae4b-63d98dc2dfea") : configmap "kube-rbac-proxy" not found Jul 28 07:47:41.374089 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:41.374001 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls podName:7050f880-6fe2-492e-ae4b-63d98dc2dfea nodeName:}" failed. No retries permitted until 2026-07-28 07:47:49.373990432 +0000 UTC m=+100.615178245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjvdl" (UID: "7050f880-6fe2-492e-ae4b-63d98dc2dfea") : secret "insights-runtime-extractor-tls" not found Jul 28 07:47:41.450639 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:41.450611 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:41.556446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:41.556412 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:41.919969 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:41.919938 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:42.710651 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:42.710617 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:42.883412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:42.883376 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:43.115585 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:43.115505 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:43.318508 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:43.318473 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:43.521677 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:43.521642 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:43.907623 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:43.907543 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:44.520722 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:44.520689 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:44.719134 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:44.719101 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:44.781998 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:44.781914 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:44.914021 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:44.913982 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:45.303529 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:45.303483 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:45.406046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:45.406003 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:45.567763 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:45.567690 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:46.122735 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:46.122701 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:46.417327 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:46.417206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q8pt5\" (UID: \"68e5ffc6-636f-43c1-a25d-5fc5d6a898b3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" Jul 28 07:47:46.417474 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:46.417369 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 07:47:46.417474 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:46.417449 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert podName:68e5ffc6-636f-43c1-a25d-5fc5d6a898b3 nodeName:}" failed. No retries permitted until 2026-07-28 07:48:02.417431265 +0000 UTC m=+113.658619078 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-q8pt5" (UID: "68e5ffc6-636f-43c1-a25d-5fc5d6a898b3") : secret "networking-console-plugin-cert" not found Jul 28 07:47:46.518532 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:46.518483 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:47:46.518641 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:46.518554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:47:46.522869 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:46.521969 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63340f7d-b861-410c-99a0-b693430a7661-metrics-tls\") pod \"dns-default-g984h\" (UID: \"63340f7d-b861-410c-99a0-b693430a7661\") " pod="openshift-dns/dns-default-g984h" Jul 28 07:47:46.523509 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:46.523486 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls\") pod \"image-registry-646d78b7d9-mcdkh\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:47:46.791057 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:46.791022 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7rpxm\"" Jul 28 07:47:46.799305 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:46.799282 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:47:46.805179 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:46.805163 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qn72b\"" Jul 28 07:47:46.812787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:46.812762 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g984h" Jul 28 07:47:46.898856 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:46.898816 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:46.952400 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:46.952371 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-646d78b7d9-mcdkh"] Jul 28 07:47:46.955115 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:47:46.955093 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69695cd_a960_4820_914f_d3c83005ccc0.slice/crio-4d7cd6b89c76640bcffcb36e5f65fe5183beea44ca5d4c500c88d3e8dae6c558 WatchSource:0}: Error finding container 4d7cd6b89c76640bcffcb36e5f65fe5183beea44ca5d4c500c88d3e8dae6c558: Status 404 returned error can't find the container with id 4d7cd6b89c76640bcffcb36e5f65fe5183beea44ca5d4c500c88d3e8dae6c558 Jul 28 07:47:46.958111 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:46.958086 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g984h"] Jul 28 07:47:46.960354 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:47:46.960330 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63340f7d_b861_410c_99a0_b693430a7661.slice/crio-47a1cc40978438b18dab621d05c794444b96acda0f5b492c83c87d2e0c35d5d6 WatchSource:0}: Error finding container 47a1cc40978438b18dab621d05c794444b96acda0f5b492c83c87d2e0c35d5d6: Status 404 returned error can't find the container with id 47a1cc40978438b18dab621d05c794444b96acda0f5b492c83c87d2e0c35d5d6 Jul 28 07:47:47.001361 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:47.001332 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:47.187984 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:47.187904 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:47.334000 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:47.333972 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:47.744271 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:47.744218 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" event={"ID":"a69695cd-a960-4820-914f-d3c83005ccc0","Type":"ContainerStarted","Data":"35e56e74bdaae06e75e4966a8e0c9881c6f8a754221e382a23eda260b4c3750e"} Jul 28 07:47:47.744412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:47.744292 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" event={"ID":"a69695cd-a960-4820-914f-d3c83005ccc0","Type":"ContainerStarted","Data":"4d7cd6b89c76640bcffcb36e5f65fe5183beea44ca5d4c500c88d3e8dae6c558"} Jul 28 07:47:47.744412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:47.744358 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:47:47.745535 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:47.745512 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g984h" event={"ID":"63340f7d-b861-410c-99a0-b693430a7661","Type":"ContainerStarted","Data":"47a1cc40978438b18dab621d05c794444b96acda0f5b492c83c87d2e0c35d5d6"} Jul 28 07:47:47.769283 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:47.769211 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" podStartSLOduration=98.769193979 podStartE2EDuration="1m38.769193979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:46:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:47:47.76701042 +0000 UTC m=+99.008198255" watchObservedRunningTime="2026-07-28 07:47:47.769193979 +0000 UTC m=+99.010381792" Jul 28 07:47:48.106545 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:48.106457 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:48.310811 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:48.310772 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:48.713835 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:48.713803 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:49.394060 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:49.394028 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:49.444575 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:49.444549 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:49.444719 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:49.444598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:49.444719 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:49.444685 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 07:47:49.444818 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:47:49.444736 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls podName:7050f880-6fe2-492e-ae4b-63d98dc2dfea nodeName:}" failed. No retries permitted until 2026-07-28 07:48:05.444722636 +0000 UTC m=+116.685910450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjvdl" (UID: "7050f880-6fe2-492e-ae4b-63d98dc2dfea") : secret "insights-runtime-extractor-tls" not found Jul 28 07:47:49.445075 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:49.445056 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7050f880-6fe2-492e-ae4b-63d98dc2dfea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:47:49.712139 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:49.712091 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:49.753141 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:49.753108 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g984h" event={"ID":"63340f7d-b861-410c-99a0-b693430a7661","Type":"ContainerStarted","Data":"34bf3cb5561fdc58b04dbe0fa7a108525e206ecfeea9050cafb41986565a05a9"} Jul 28 07:47:49.753354 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:49.753194 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g984h" event={"ID":"63340f7d-b861-410c-99a0-b693430a7661","Type":"ContainerStarted","Data":"edb5859b0a5cca8f66e7704c4f11b86c7322a009fb187348ce0d98472e19a3f4"} Jul 28 07:47:49.753354 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:49.753263 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g984h" Jul 28 07:47:49.774137 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:49.774084 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g984h" podStartSLOduration=66.001408111 podStartE2EDuration="1m7.77406808s" totalImagesPullingTime="1.772659969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:46:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:47:49.773543783 +0000 UTC m=+101.014731640" watchObservedRunningTime="2026-07-28 07:47:49.77406808 +0000 UTC m=+101.015255918" Jul 28 07:47:50.128330 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:50.128219 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:50.379174 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:50.379083 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:50.507144 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:50.507098 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:50.660864 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:50.660790 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-47rf9" Jul 28 07:47:50.937622 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:50.937543 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:51.311306 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:51.311270 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:51.504187 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:51.504147 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:51.706019 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:51.705975 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:54.792574 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:54.792541 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:54.893177 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:54.893145 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:54.993291 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:54.993257 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:55.290072 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:55.290037 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:55.466109 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:55.466070 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:55.535644 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:55.535609 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:55.735112 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:55.735084 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:55.799763 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:55.799727 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:55.870553 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:55.870518 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:56.273415 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:56.273387 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:56.481925 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:56.481886 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:56.583334 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:56.583250 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:56.703328 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:56.703287 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:57.350552 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:57.350519 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:58.592864 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.592831 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4"] Jul 28 07:47:58.595610 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.595583 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" Jul 28 07:47:58.602941 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.602918 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 07:47:58.602941 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.602933 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 07:47:58.603099 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.602988 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 07:47:58.603099 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.603006 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 28 07:47:58.610408 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.610386 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4"] Jul 28 07:47:58.700846 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.700812 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-9jf2w"] Jul 28 07:47:58.702673 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.702658 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-9jf2w" Jul 28 07:47:58.705645 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.705625 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 07:47:58.706350 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.706333 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 07:47:58.706442 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.706422 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ncz5b\"" Jul 28 07:47:58.719867 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.719839 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dd4d\" (UniqueName: \"kubernetes.io/projected/1ca6224a-929d-4db9-b7d8-349e490fd47b-kube-api-access-9dd4d\") pod \"klusterlet-addon-workmgr-9df6f7b68-whgh4\" (UID: \"1ca6224a-929d-4db9-b7d8-349e490fd47b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" Jul 28 07:47:58.719980 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.719958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1ca6224a-929d-4db9-b7d8-349e490fd47b-klusterlet-config\") pod \"klusterlet-addon-workmgr-9df6f7b68-whgh4\" (UID: \"1ca6224a-929d-4db9-b7d8-349e490fd47b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" Jul 28 07:47:58.720046 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.719988 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ca6224a-929d-4db9-b7d8-349e490fd47b-tmp\") pod \"klusterlet-addon-workmgr-9df6f7b68-whgh4\" (UID: \"1ca6224a-929d-4db9-b7d8-349e490fd47b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" Jul 28 07:47:58.727631 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.727610 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-9jf2w"] Jul 28 07:47:58.768542 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.768515 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:58.820484 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.820453 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7st8\" (UniqueName: \"kubernetes.io/projected/e0243c88-c264-4b3a-a554-4a58d3b199e9-kube-api-access-x7st8\") pod \"downloads-7c97dc4555-9jf2w\" (UID: \"e0243c88-c264-4b3a-a554-4a58d3b199e9\") " pod="openshift-console/downloads-7c97dc4555-9jf2w" Jul 28 07:47:58.820649 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.820504 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1ca6224a-929d-4db9-b7d8-349e490fd47b-klusterlet-config\") pod \"klusterlet-addon-workmgr-9df6f7b68-whgh4\" (UID: \"1ca6224a-929d-4db9-b7d8-349e490fd47b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" Jul 28 07:47:58.820649 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.820526 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ca6224a-929d-4db9-b7d8-349e490fd47b-tmp\") pod \"klusterlet-addon-workmgr-9df6f7b68-whgh4\" (UID: \"1ca6224a-929d-4db9-b7d8-349e490fd47b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" Jul 28 07:47:58.820649 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.820611 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dd4d\" (UniqueName: \"kubernetes.io/projected/1ca6224a-929d-4db9-b7d8-349e490fd47b-kube-api-access-9dd4d\") pod \"klusterlet-addon-workmgr-9df6f7b68-whgh4\" (UID: \"1ca6224a-929d-4db9-b7d8-349e490fd47b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" Jul 28 07:47:58.820857 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.820843 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ca6224a-929d-4db9-b7d8-349e490fd47b-tmp\") pod \"klusterlet-addon-workmgr-9df6f7b68-whgh4\" (UID: \"1ca6224a-929d-4db9-b7d8-349e490fd47b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" Jul 28 07:47:58.823090 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.823073 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1ca6224a-929d-4db9-b7d8-349e490fd47b-klusterlet-config\") pod \"klusterlet-addon-workmgr-9df6f7b68-whgh4\" (UID: \"1ca6224a-929d-4db9-b7d8-349e490fd47b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" Jul 28 07:47:58.830319 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.830298 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dd4d\" (UniqueName: \"kubernetes.io/projected/1ca6224a-929d-4db9-b7d8-349e490fd47b-kube-api-access-9dd4d\") pod \"klusterlet-addon-workmgr-9df6f7b68-whgh4\" (UID: \"1ca6224a-929d-4db9-b7d8-349e490fd47b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" Jul 28 07:47:58.868666 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.868601 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:47:58.904391 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.904362 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" Jul 28 07:47:58.921728 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.921704 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7st8\" (UniqueName: \"kubernetes.io/projected/e0243c88-c264-4b3a-a554-4a58d3b199e9-kube-api-access-x7st8\") pod \"downloads-7c97dc4555-9jf2w\" (UID: \"e0243c88-c264-4b3a-a554-4a58d3b199e9\") " pod="openshift-console/downloads-7c97dc4555-9jf2w" Jul 28 07:47:58.931572 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:58.931549 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7st8\" (UniqueName: \"kubernetes.io/projected/e0243c88-c264-4b3a-a554-4a58d3b199e9-kube-api-access-x7st8\") pod \"downloads-7c97dc4555-9jf2w\" (UID: \"e0243c88-c264-4b3a-a554-4a58d3b199e9\") " pod="openshift-console/downloads-7c97dc4555-9jf2w" Jul 28 07:47:59.010964 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:59.010931 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-9jf2w" Jul 28 07:47:59.034439 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:59.034406 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4"] Jul 28 07:47:59.037200 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:47:59.037163 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca6224a_929d_4db9_b7d8_349e490fd47b.slice/crio-eea64dc346fa623ae721457bd4d30f918a3fee939ca65c7620a3da0a74eb38fd WatchSource:0}: Error finding container eea64dc346fa623ae721457bd4d30f918a3fee939ca65c7620a3da0a74eb38fd: Status 404 returned error can't find the container with id eea64dc346fa623ae721457bd4d30f918a3fee939ca65c7620a3da0a74eb38fd Jul 28 07:47:59.136199 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:59.136121 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-9jf2w"] Jul 28 07:47:59.139066 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:47:59.139043 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0243c88_c264_4b3a_a554_4a58d3b199e9.slice/crio-a9adbb2b4e04a1e565a5c4329bf1da10bde324bb215338b9f68eeeb98608393c WatchSource:0}: Error finding container a9adbb2b4e04a1e565a5c4329bf1da10bde324bb215338b9f68eeeb98608393c: Status 404 returned error can't find the container with id a9adbb2b4e04a1e565a5c4329bf1da10bde324bb215338b9f68eeeb98608393c Jul 28 07:47:59.767396 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:59.764973 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g984h" Jul 28 07:47:59.791826 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:59.791785 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-9jf2w" event={"ID":"e0243c88-c264-4b3a-a554-4a58d3b199e9","Type":"ContainerStarted","Data":"a9adbb2b4e04a1e565a5c4329bf1da10bde324bb215338b9f68eeeb98608393c"} Jul 28 07:47:59.793830 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:59.793786 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" event={"ID":"1ca6224a-929d-4db9-b7d8-349e490fd47b","Type":"ContainerStarted","Data":"eea64dc346fa623ae721457bd4d30f918a3fee939ca65c7620a3da0a74eb38fd"} Jul 28 07:47:59.902086 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:47:59.902032 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:02.453491 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:02.453445 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q8pt5\" (UID: \"68e5ffc6-636f-43c1-a25d-5fc5d6a898b3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" Jul 28 07:48:02.456539 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:02.456512 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/68e5ffc6-636f-43c1-a25d-5fc5d6a898b3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q8pt5\" (UID: \"68e5ffc6-636f-43c1-a25d-5fc5d6a898b3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" Jul 28 07:48:02.677154 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:02.677124 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" Jul 28 07:48:03.143935 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:03.143910 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5"] Jul 28 07:48:03.149048 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:48:03.149024 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e5ffc6_636f_43c1_a25d_5fc5d6a898b3.slice/crio-5df2fd445cf9f6c37495341431dc6d0f38d2696e0652b3b0a3a760eb0c233bdf WatchSource:0}: Error finding container 5df2fd445cf9f6c37495341431dc6d0f38d2696e0652b3b0a3a760eb0c233bdf: Status 404 returned error can't find the container with id 5df2fd445cf9f6c37495341431dc6d0f38d2696e0652b3b0a3a760eb0c233bdf Jul 28 07:48:03.810722 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:03.810683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" event={"ID":"68e5ffc6-636f-43c1-a25d-5fc5d6a898b3","Type":"ContainerStarted","Data":"5df2fd445cf9f6c37495341431dc6d0f38d2696e0652b3b0a3a760eb0c233bdf"} Jul 28 07:48:03.812434 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:03.812401 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" event={"ID":"1ca6224a-929d-4db9-b7d8-349e490fd47b","Type":"ContainerStarted","Data":"707157e28cbdd42a2e8897df6e41a2a0b5023b68cfd28773ea6c79ce474ccc27"} Jul 28 07:48:03.812647 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:03.812631 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" Jul 28 07:48:03.814556 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:03.814530 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" Jul 28 07:48:03.842379 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:03.842333 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9df6f7b68-whgh4" podStartSLOduration=1.818038625 podStartE2EDuration="5.842317811s" totalImagesPullingTime="4.024279186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:48:03.841659449 +0000 UTC m=+115.082847288" watchObservedRunningTime="2026-07-28 07:48:03.842317811 +0000 UTC m=+115.083505645" Jul 28 07:48:04.431018 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:04.430974 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:04.530772 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:04.530737 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:04.630378 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:04.630343 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:04.630991 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:04.630965 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xh6kx"] Jul 28 07:48:04.633833 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:04.633814 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xh6kx" Jul 28 07:48:04.636514 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:04.636280 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 28 07:48:04.636514 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:04.636359 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wvdsf\"" Jul 28 07:48:04.642536 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:04.642511 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xh6kx"] Jul 28 07:48:04.772066 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:04.772029 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3144c73f-b628-4b83-8901-fd394e288b8e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xh6kx\" (UID: \"3144c73f-b628-4b83-8901-fd394e288b8e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xh6kx" Jul 28 07:48:04.817678 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:04.817631 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" event={"ID":"68e5ffc6-636f-43c1-a25d-5fc5d6a898b3","Type":"ContainerStarted","Data":"8abed2f4f73fc2bcfd0966aa49671e1c1523bfda11dac892bc4b05cfb113cc7d"} Jul 28 07:48:04.835448 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:04.835386 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q8pt5" podStartSLOduration=33.43124942 podStartE2EDuration="34.835367229s" totalImagesPullingTime="1.404117809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:48:04.833583577 +0000 UTC m=+116.074771412" watchObservedRunningTime="2026-07-28 07:48:04.835367229 +0000 UTC m=+116.076555069" Jul 28 07:48:04.873648 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:04.873610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3144c73f-b628-4b83-8901-fd394e288b8e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xh6kx\" (UID: \"3144c73f-b628-4b83-8901-fd394e288b8e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xh6kx" Jul 28 07:48:04.873818 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:48:04.873785 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 28 07:48:04.873884 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:48:04.873854 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3144c73f-b628-4b83-8901-fd394e288b8e-tls-certificates podName:3144c73f-b628-4b83-8901-fd394e288b8e nodeName:}" failed. No retries permitted until 2026-07-28 07:48:05.37383436 +0000 UTC m=+116.615022176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3144c73f-b628-4b83-8901-fd394e288b8e-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-xh6kx" (UID: "3144c73f-b628-4b83-8901-fd394e288b8e") : secret "prometheus-operator-admission-webhook-tls" not found Jul 28 07:48:04.917918 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:04.917880 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:05.018760 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:05.018725 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:05.082697 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:05.082592 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:05.378309 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:05.378215 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3144c73f-b628-4b83-8901-fd394e288b8e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xh6kx\" (UID: \"3144c73f-b628-4b83-8901-fd394e288b8e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xh6kx" Jul 28 07:48:05.380739 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:05.380709 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3144c73f-b628-4b83-8901-fd394e288b8e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xh6kx\" (UID: \"3144c73f-b628-4b83-8901-fd394e288b8e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xh6kx" Jul 28 07:48:05.479166 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:05.479125 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:48:05.481816 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:05.481780 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7050f880-6fe2-492e-ae4b-63d98dc2dfea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvdl\" (UID: \"7050f880-6fe2-492e-ae4b-63d98dc2dfea\") " pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:48:05.544301 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:05.544265 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xh6kx" Jul 28 07:48:05.690112 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:05.690077 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xh6kx"] Jul 28 07:48:05.693336 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:48:05.693299 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3144c73f_b628_4b83_8901_fd394e288b8e.slice/crio-4ed863e9d8faf5428c79d9f25c92625a2b2ed69628011b30655d5e261558ee18 WatchSource:0}: Error finding container 4ed863e9d8faf5428c79d9f25c92625a2b2ed69628011b30655d5e261558ee18: Status 404 returned error can't find the container with id 4ed863e9d8faf5428c79d9f25c92625a2b2ed69628011b30655d5e261558ee18 Jul 28 07:48:05.763652 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:05.763621 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bjvdl" Jul 28 07:48:05.849514 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:05.849457 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xh6kx" event={"ID":"3144c73f-b628-4b83-8901-fd394e288b8e","Type":"ContainerStarted","Data":"4ed863e9d8faf5428c79d9f25c92625a2b2ed69628011b30655d5e261558ee18"} Jul 28 07:48:05.939465 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:05.939396 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bjvdl"] Jul 28 07:48:05.942523 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:48:05.942500 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7050f880_6fe2_492e_ae4b_63d98dc2dfea.slice/crio-0ec1599e943690a2e0b25f599d80f7c20c3e68b32aa300ec28db311f2b735dfc WatchSource:0}: Error finding container 0ec1599e943690a2e0b25f599d80f7c20c3e68b32aa300ec28db311f2b735dfc: Status 404 returned error can't find the container with id 0ec1599e943690a2e0b25f599d80f7c20c3e68b32aa300ec28db311f2b735dfc Jul 28 07:48:06.807154 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:06.807108 2561 patch_prober.go:28] interesting pod/image-registry-646d78b7d9-mcdkh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 28 07:48:06.807455 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:06.807177 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" podUID="a69695cd-a960-4820-914f-d3c83005ccc0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 07:48:06.856706 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:06.856625 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bjvdl" event={"ID":"7050f880-6fe2-492e-ae4b-63d98dc2dfea","Type":"ContainerStarted","Data":"0ec1599e943690a2e0b25f599d80f7c20c3e68b32aa300ec28db311f2b735dfc"} Jul 28 07:48:07.862444 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:07.862397 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xh6kx" event={"ID":"3144c73f-b628-4b83-8901-fd394e288b8e","Type":"ContainerStarted","Data":"596674ee67839e4f521ff06709f0110acd760008acb04f9d104d745bfdd96ca1"} Jul 28 07:48:07.862849 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:07.862588 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xh6kx" Jul 28 07:48:07.868689 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:07.868657 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xh6kx" Jul 28 07:48:07.878559 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:07.878177 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xh6kx" podStartSLOduration=2.391542406 podStartE2EDuration="3.87815963s" totalImagesPullingTime="1.486617224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:48:07.878157108 +0000 UTC m=+119.119344955" watchObservedRunningTime="2026-07-28 07:48:07.87815963 +0000 UTC m=+119.119347466" Jul 28 07:48:08.653591 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.653555 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:08.695122 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.695090 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-jdbnm"] Jul 28 07:48:08.702267 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.702219 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:08.704868 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.704705 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caae9db2-b8c9-423b-a702-8336eca7a405-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-jdbnm\" (UID: \"caae9db2-b8c9-423b-a702-8336eca7a405\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:08.704868 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.704759 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caae9db2-b8c9-423b-a702-8336eca7a405-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-jdbnm\" (UID: \"caae9db2-b8c9-423b-a702-8336eca7a405\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:08.704868 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.704802 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/caae9db2-b8c9-423b-a702-8336eca7a405-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-jdbnm\" (UID: \"caae9db2-b8c9-423b-a702-8336eca7a405\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:08.705091 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.704918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhwgj\" (UniqueName: \"kubernetes.io/projected/caae9db2-b8c9-423b-a702-8336eca7a405-kube-api-access-bhwgj\") pod \"prometheus-operator-84d69f794d-jdbnm\" (UID: \"caae9db2-b8c9-423b-a702-8336eca7a405\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:08.708412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.705964 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 07:48:08.708412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.705983 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 07:48:08.708412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.706200 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 07:48:08.708412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.706420 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ww962\"" Jul 28 07:48:08.708412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.706595 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 07:48:08.708412 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.707894 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 07:48:08.709776 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.709720 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-jdbnm"] Jul 28 07:48:08.726285 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.726258 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:08.754103 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.754075 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:48:08.805740 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.805706 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/caae9db2-b8c9-423b-a702-8336eca7a405-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-jdbnm\" (UID: \"caae9db2-b8c9-423b-a702-8336eca7a405\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:08.805883 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.805822 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhwgj\" (UniqueName: \"kubernetes.io/projected/caae9db2-b8c9-423b-a702-8336eca7a405-kube-api-access-bhwgj\") pod \"prometheus-operator-84d69f794d-jdbnm\" (UID: \"caae9db2-b8c9-423b-a702-8336eca7a405\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:08.805942 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.805894 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caae9db2-b8c9-423b-a702-8336eca7a405-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-jdbnm\" (UID: \"caae9db2-b8c9-423b-a702-8336eca7a405\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:08.805995 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.805949 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caae9db2-b8c9-423b-a702-8336eca7a405-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-jdbnm\" (UID: \"caae9db2-b8c9-423b-a702-8336eca7a405\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:08.806470 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:48:08.806444 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 28 07:48:08.806586 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:48:08.806537 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caae9db2-b8c9-423b-a702-8336eca7a405-prometheus-operator-tls podName:caae9db2-b8c9-423b-a702-8336eca7a405 nodeName:}" failed. No retries permitted until 2026-07-28 07:48:09.306505928 +0000 UTC m=+120.547693761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/caae9db2-b8c9-423b-a702-8336eca7a405-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-jdbnm" (UID: "caae9db2-b8c9-423b-a702-8336eca7a405") : secret "prometheus-operator-tls" not found Jul 28 07:48:08.806727 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.806694 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caae9db2-b8c9-423b-a702-8336eca7a405-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-jdbnm\" (UID: \"caae9db2-b8c9-423b-a702-8336eca7a405\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:08.809741 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.809719 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caae9db2-b8c9-423b-a702-8336eca7a405-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-jdbnm\" (UID: \"caae9db2-b8c9-423b-a702-8336eca7a405\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:08.816602 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.816576 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhwgj\" (UniqueName: \"kubernetes.io/projected/caae9db2-b8c9-423b-a702-8336eca7a405-kube-api-access-bhwgj\") pod \"prometheus-operator-84d69f794d-jdbnm\" (UID: \"caae9db2-b8c9-423b-a702-8336eca7a405\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:08.906030 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:08.905890 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:09.008280 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:09.008220 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:09.075978 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:09.075943 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:09.309740 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:09.309700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/caae9db2-b8c9-423b-a702-8336eca7a405-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-jdbnm\" (UID: \"caae9db2-b8c9-423b-a702-8336eca7a405\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:09.312816 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:09.312779 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/caae9db2-b8c9-423b-a702-8336eca7a405-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-jdbnm\" (UID: \"caae9db2-b8c9-423b-a702-8336eca7a405\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:09.320484 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:09.320440 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ww962\"" Jul 28 07:48:09.327905 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:09.327885 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" Jul 28 07:48:09.337040 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:09.337014 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:09.410943 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:09.410901 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:10.909664 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.909629 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-959cfdb75-fllbm"] Jul 28 07:48:10.913556 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.913535 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:10.914577 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.914550 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:10.917310 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.917281 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 07:48:10.917430 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.917336 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 07:48:10.917430 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.917357 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 07:48:10.917430 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.917284 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 07:48:10.917430 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.917284 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 07:48:10.917742 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.917726 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8nkk7\"" Jul 28 07:48:10.922326 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.921791 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 07:48:10.922326 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.922220 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-oauth-config\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:10.922326 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.922280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-config\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:10.922326 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.922305 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-trusted-ca-bundle\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:10.922652 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.922339 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-serving-cert\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:10.922652 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.922405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9h9b\" (UniqueName: \"kubernetes.io/projected/e9ed74df-8ddc-4502-9d82-a03f878d5de1-kube-api-access-b9h9b\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:10.922652 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.922461 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-oauth-serving-cert\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:10.922652 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.922484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-service-ca\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:10.924552 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.924529 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-959cfdb75-fllbm"] Jul 28 07:48:10.975830 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:10.975747 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:11.023070 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.023033 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-oauth-config\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.023273 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.023081 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-config\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.023273 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.023110 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-trusted-ca-bundle\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.023273 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.023142 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-serving-cert\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.023273 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.023198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9h9b\" (UniqueName: \"kubernetes.io/projected/e9ed74df-8ddc-4502-9d82-a03f878d5de1-kube-api-access-b9h9b\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.023273 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.023263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-oauth-serving-cert\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.023548 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.023288 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-service-ca\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.024029 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.024005 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-service-ca\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.024541 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.024516 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-trusted-ca-bundle\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.025267 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.025217 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-config\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.025433 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.025412 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-oauth-serving-cert\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.027776 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.027730 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-oauth-config\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.028085 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.028060 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-serving-cert\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.040314 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.040286 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9h9b\" (UniqueName: \"kubernetes.io/projected/e9ed74df-8ddc-4502-9d82-a03f878d5de1-kube-api-access-b9h9b\") pod \"console-959cfdb75-fllbm\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.225800 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.225760 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:11.298209 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:11.298167 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:14.358661 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:14.358619 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:14.457932 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:14.457894 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:17.988222 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:17.988191 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs\") pod \"network-metrics-daemon-dnr4f\" (UID: \"c79dbe4b-fc12-4534-9cc4-be27338b0967\") " pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:48:17.991693 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:17.991664 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c79dbe4b-fc12-4534-9cc4-be27338b0967-metrics-certs\") pod \"network-metrics-daemon-dnr4f\" (UID: \"c79dbe4b-fc12-4534-9cc4-be27338b0967\") " pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:48:18.064443 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:18.064403 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:18.165508 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:18.165475 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:18.200165 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:18.200135 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lp4z9\"" Jul 28 07:48:18.208292 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:18.208270 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnr4f" Jul 28 07:48:18.266685 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:18.266653 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:19.159849 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:19.159768 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-jdbnm"] Jul 28 07:48:19.164050 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:19.163819 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-959cfdb75-fllbm"] Jul 28 07:48:19.165090 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:48:19.165055 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaae9db2_b8c9_423b_a702_8336eca7a405.slice/crio-6eaf17a8804a096c2932939f44cfcb331cae45dca26ba0e3d4e7baf37f07e4e7 WatchSource:0}: Error finding container 6eaf17a8804a096c2932939f44cfcb331cae45dca26ba0e3d4e7baf37f07e4e7: Status 404 returned error can't find the container with id 6eaf17a8804a096c2932939f44cfcb331cae45dca26ba0e3d4e7baf37f07e4e7 Jul 28 07:48:19.169130 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:48:19.169110 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ed74df_8ddc_4502_9d82_a03f878d5de1.slice/crio-28ab5eae10a03a7b8a99bbe48018eb0febbfabce8814f921f4109e90b1dbc96e WatchSource:0}: Error finding container 28ab5eae10a03a7b8a99bbe48018eb0febbfabce8814f921f4109e90b1dbc96e: Status 404 returned error can't find the container with id 28ab5eae10a03a7b8a99bbe48018eb0febbfabce8814f921f4109e90b1dbc96e Jul 28 07:48:19.184626 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:19.184602 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dnr4f"] Jul 28 07:48:19.188318 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:48:19.188291 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc79dbe4b_fc12_4534_9cc4_be27338b0967.slice/crio-1447b30871858c7325c66360ef98ef17e4389c503d097665754e01932196c3d0 WatchSource:0}: Error finding container 1447b30871858c7325c66360ef98ef17e4389c503d097665754e01932196c3d0: Status 404 returned error can't find the container with id 1447b30871858c7325c66360ef98ef17e4389c503d097665754e01932196c3d0 Jul 28 07:48:19.915576 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:19.915423 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-959cfdb75-fllbm" event={"ID":"e9ed74df-8ddc-4502-9d82-a03f878d5de1","Type":"ContainerStarted","Data":"28ab5eae10a03a7b8a99bbe48018eb0febbfabce8814f921f4109e90b1dbc96e"} Jul 28 07:48:19.918886 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:19.918853 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-9jf2w" event={"ID":"e0243c88-c264-4b3a-a554-4a58d3b199e9","Type":"ContainerStarted","Data":"a3192bac7482ed1e327b1314485f45987eee8a992bcf86595a66021c1e9cd88f"} Jul 28 07:48:19.922347 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:19.922320 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-9jf2w" Jul 28 07:48:19.926117 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:19.926045 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bjvdl" event={"ID":"7050f880-6fe2-492e-ae4b-63d98dc2dfea","Type":"ContainerStarted","Data":"ffc22c33e9f4af4138f9a169f90795fb3fcea879113fa901c25ce81acfd556c6"} Jul 28 07:48:19.929218 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:19.928611 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnr4f" event={"ID":"c79dbe4b-fc12-4534-9cc4-be27338b0967","Type":"ContainerStarted","Data":"1447b30871858c7325c66360ef98ef17e4389c503d097665754e01932196c3d0"} Jul 28 07:48:19.930789 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:19.930732 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" event={"ID":"caae9db2-b8c9-423b-a702-8336eca7a405","Type":"ContainerStarted","Data":"6eaf17a8804a096c2932939f44cfcb331cae45dca26ba0e3d4e7baf37f07e4e7"} Jul 28 07:48:19.933756 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:19.933712 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-9jf2w" Jul 28 07:48:19.965446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:19.963447 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-9jf2w" podStartSLOduration=2.049250041 podStartE2EDuration="21.963423488s" totalImagesPullingTime="19.914173447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:48:19.94172182 +0000 UTC m=+131.182909656" watchObservedRunningTime="2026-07-28 07:48:19.963423488 +0000 UTC m=+131.204611326" Jul 28 07:48:20.046401 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:20.046313 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:20.120506 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:20.120412 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:20.390630 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:20.390592 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:20.491426 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:20.491370 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:21.214329 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:21.214293 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-646d78b7d9-mcdkh"] Jul 28 07:48:21.304749 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:21.304667 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:21.405515 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:21.405356 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:21.504858 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:21.504696 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:22.149030 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:22.148997 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:24.773560 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:24.773485 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:24.827167 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:24.827124 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:25.554023 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:25.553932 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:25.644165 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:25.644121 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:25.744777 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:25.744741 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:25.810494 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:25.810363 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:26.972484 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:26.972452 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" event={"ID":"caae9db2-b8c9-423b-a702-8336eca7a405","Type":"ContainerStarted","Data":"092b6889456ec4d1a0c04d5f3cb4871caeb4f73304ef3b618d6f98025e42df53"} Jul 28 07:48:27.192686 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:27.192591 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:27.983580 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:27.983454 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-959cfdb75-fllbm" event={"ID":"e9ed74df-8ddc-4502-9d82-a03f878d5de1","Type":"ContainerStarted","Data":"ace13d33b1172b23954a1864d568943311874c719102d61e18727de10d04a226"} Jul 28 07:48:27.986091 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:27.986060 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bjvdl" event={"ID":"7050f880-6fe2-492e-ae4b-63d98dc2dfea","Type":"ContainerStarted","Data":"6822eb997806736fafaf539169dcde9742e3458e1c752f86e99f4353c3fb8b45"} Jul 28 07:48:27.988783 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:27.988727 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnr4f" event={"ID":"c79dbe4b-fc12-4534-9cc4-be27338b0967","Type":"ContainerStarted","Data":"1e83e2468446eb2b4e1a30c498644e761dee8fbdf29fb5d483bea75d941d83e1"} Jul 28 07:48:27.988783 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:27.988781 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnr4f" event={"ID":"c79dbe4b-fc12-4534-9cc4-be27338b0967","Type":"ContainerStarted","Data":"b66ed4d2d5f85c4995218578539d65b7f2113e82a001d183ac6ff0f420884440"} Jul 28 07:48:27.991319 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:27.991293 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" event={"ID":"caae9db2-b8c9-423b-a702-8336eca7a405","Type":"ContainerStarted","Data":"cf80d4ebf286f3d2b59334e9f206f690fb475563ebf16ae909c13611c03db3c8"} Jul 28 07:48:28.004345 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:28.004280 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-959cfdb75-fllbm" podStartSLOduration=10.382901581 podStartE2EDuration="18.004259868s" totalImagesPullingTime="7.621358287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:48:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:48:28.002422836 +0000 UTC m=+139.243610674" watchObservedRunningTime="2026-07-28 07:48:28.004259868 +0000 UTC m=+139.245447703" Jul 28 07:48:28.021081 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:28.021039 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-jdbnm" podStartSLOduration=12.43213936 podStartE2EDuration="20.021025534s" totalImagesPullingTime="7.588886174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:48:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:48:28.02001217 +0000 UTC m=+139.261200005" watchObservedRunningTime="2026-07-28 07:48:28.021025534 +0000 UTC m=+139.262213368" Jul 28 07:48:28.142401 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:28.142356 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:28.206038 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:28.206002 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:29.800963 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:29.800923 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:30.040363 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.040331 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:30.071562 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.071440 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dnr4f" podStartSLOduration=133.478070346 podStartE2EDuration="2m21.071421875s" totalImagesPullingTime="7.593351529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:48:28.036361992 +0000 UTC m=+139.277549828" watchObservedRunningTime="2026-07-28 07:48:30.071421875 +0000 UTC m=+141.312609710" Jul 28 07:48:30.072471 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.072444 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-7556r"] Jul 28 07:48:30.142852 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.142819 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-7556r"] Jul 28 07:48:30.143028 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.142882 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n7v5g"] Jul 28 07:48:30.143028 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.142932 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.146344 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.146318 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 28 07:48:30.147950 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.147425 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bn6gr\"" Jul 28 07:48:30.147950 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.147427 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 28 07:48:30.147950 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.147455 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 28 07:48:30.148179 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.148149 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:30.157517 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.157494 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.161519 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.161495 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 07:48:30.161644 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.161536 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wv5nn\"" Jul 28 07:48:30.161916 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.161898 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 07:48:30.162006 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.161980 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 07:48:30.200771 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.200734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/743b8d26-92b5-4058-9043-2bb3a0351da5-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.200970 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.200794 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/743b8d26-92b5-4058-9043-2bb3a0351da5-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.200970 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.200833 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/743b8d26-92b5-4058-9043-2bb3a0351da5-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.200970 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.200868 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/743b8d26-92b5-4058-9043-2bb3a0351da5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.200970 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.200897 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmwf4\" (UniqueName: \"kubernetes.io/projected/743b8d26-92b5-4058-9043-2bb3a0351da5-kube-api-access-nmwf4\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.201142 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.200972 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/743b8d26-92b5-4058-9043-2bb3a0351da5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.246850 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.246812 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:30.302070 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-textfile\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.302280 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302076 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-accelerators-collector-config\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.302280 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/743b8d26-92b5-4058-9043-2bb3a0351da5-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.302280 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/743b8d26-92b5-4058-9043-2bb3a0351da5-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.302280 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302206 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-tls\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.302280 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302248 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/743b8d26-92b5-4058-9043-2bb3a0351da5-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.302280 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302275 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-wtmp\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.302591 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302299 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/743b8d26-92b5-4058-9043-2bb3a0351da5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.302591 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302318 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmwf4\" (UniqueName: \"kubernetes.io/projected/743b8d26-92b5-4058-9043-2bb3a0351da5-kube-api-access-nmwf4\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.302591 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302348 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.302591 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302385 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/743b8d26-92b5-4058-9043-2bb3a0351da5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.302591 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302435 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htcfg\" (UniqueName: \"kubernetes.io/projected/7c6e39ba-1087-4763-a4d1-099be0556ebf-kube-api-access-htcfg\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.302591 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c6e39ba-1087-4763-a4d1-099be0556ebf-root\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.302591 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c6e39ba-1087-4763-a4d1-099be0556ebf-sys\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.302917 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302603 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c6e39ba-1087-4763-a4d1-099be0556ebf-metrics-client-ca\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.302980 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.302946 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/743b8d26-92b5-4058-9043-2bb3a0351da5-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.303393 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.303372 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/743b8d26-92b5-4058-9043-2bb3a0351da5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.303488 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.303460 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/743b8d26-92b5-4058-9043-2bb3a0351da5-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.304994 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.304975 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/743b8d26-92b5-4058-9043-2bb3a0351da5-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.305256 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.305217 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/743b8d26-92b5-4058-9043-2bb3a0351da5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.312891 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.312861 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmwf4\" (UniqueName: \"kubernetes.io/projected/743b8d26-92b5-4058-9043-2bb3a0351da5-kube-api-access-nmwf4\") pod \"kube-state-metrics-56d9f944b4-7556r\" (UID: \"743b8d26-92b5-4058-9043-2bb3a0351da5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.403716 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.403630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-accelerators-collector-config\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.403716 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.403711 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-tls\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.403919 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.403753 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-wtmp\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.403919 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.403785 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.403919 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.403817 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htcfg\" (UniqueName: \"kubernetes.io/projected/7c6e39ba-1087-4763-a4d1-099be0556ebf-kube-api-access-htcfg\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.403919 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.403847 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c6e39ba-1087-4763-a4d1-099be0556ebf-root\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.403919 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.403875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c6e39ba-1087-4763-a4d1-099be0556ebf-sys\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.404166 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.403909 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c6e39ba-1087-4763-a4d1-099be0556ebf-metrics-client-ca\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.404166 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.403962 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-textfile\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.404296 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.404273 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-accelerators-collector-config\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.404390 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.404364 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-textfile\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.404523 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.404437 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c6e39ba-1087-4763-a4d1-099be0556ebf-root\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.404523 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.404477 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c6e39ba-1087-4763-a4d1-099be0556ebf-sys\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.404687 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:48:30.404657 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 07:48:30.404762 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:48:30.404720 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-tls podName:7c6e39ba-1087-4763-a4d1-099be0556ebf nodeName:}" failed. No retries permitted until 2026-07-28 07:48:30.904702856 +0000 UTC m=+142.145890668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-tls") pod "node-exporter-n7v5g" (UID: "7c6e39ba-1087-4763-a4d1-099be0556ebf") : secret "node-exporter-tls" not found Jul 28 07:48:30.405021 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.405000 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-wtmp\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.405095 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.405055 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c6e39ba-1087-4763-a4d1-099be0556ebf-metrics-client-ca\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.407578 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.407559 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.412989 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.412951 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htcfg\" (UniqueName: \"kubernetes.io/projected/7c6e39ba-1087-4763-a4d1-099be0556ebf-kube-api-access-htcfg\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.426683 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.426653 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:30.453996 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.453967 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" Jul 28 07:48:30.532056 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.532019 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:30.623366 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.623327 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:30.724026 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.723938 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:30.908051 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.908016 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-tls\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:30.910376 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:30.910348 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c6e39ba-1087-4763-a4d1-099be0556ebf-node-exporter-tls\") pod \"node-exporter-n7v5g\" (UID: \"7c6e39ba-1087-4763-a4d1-099be0556ebf\") " pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:31.067985 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:31.067913 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n7v5g" Jul 28 07:48:31.091734 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:31.091701 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:31.097930 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:48:31.097901 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6e39ba_1087_4763_a4d1_099be0556ebf.slice/crio-c7391ae5f3cd35331403d6d73fdc13caad6044ad0e05ffe4c1dd0e2d53a36292 WatchSource:0}: Error finding container c7391ae5f3cd35331403d6d73fdc13caad6044ad0e05ffe4c1dd0e2d53a36292: Status 404 returned error can't find the container with id c7391ae5f3cd35331403d6d73fdc13caad6044ad0e05ffe4c1dd0e2d53a36292 Jul 28 07:48:31.181898 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:31.181863 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:31.207920 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:31.207893 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-7556r"] Jul 28 07:48:31.211854 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:48:31.211772 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743b8d26_92b5_4058_9043_2bb3a0351da5.slice/crio-48b01e4b41ec257917f119b0ef58a420243becdc0d6b4c299a60c087d23e6619 WatchSource:0}: Error finding container 48b01e4b41ec257917f119b0ef58a420243becdc0d6b4c299a60c087d23e6619: Status 404 returned error can't find the container with id 48b01e4b41ec257917f119b0ef58a420243becdc0d6b4c299a60c087d23e6619 Jul 28 07:48:31.226605 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:31.226579 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:31.226883 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:31.226637 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:31.231480 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:31.231460 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:31.272614 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:31.272583 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:32.008500 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:32.008455 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bjvdl" event={"ID":"7050f880-6fe2-492e-ae4b-63d98dc2dfea","Type":"ContainerStarted","Data":"8ca89b7e556707f1fcae29c6661d5f2603da056245856be144e53f7e64005c01"} Jul 28 07:48:32.010421 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:32.010394 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n7v5g" event={"ID":"7c6e39ba-1087-4763-a4d1-099be0556ebf","Type":"ContainerStarted","Data":"c7391ae5f3cd35331403d6d73fdc13caad6044ad0e05ffe4c1dd0e2d53a36292"} Jul 28 07:48:32.011934 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:32.011864 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" event={"ID":"743b8d26-92b5-4058-9043-2bb3a0351da5","Type":"ContainerStarted","Data":"48b01e4b41ec257917f119b0ef58a420243becdc0d6b4c299a60c087d23e6619"} Jul 28 07:48:32.016650 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:32.016630 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:48:32.029820 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:32.029567 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bjvdl" podStartSLOduration=33.860037532 podStartE2EDuration="59.029548216s" totalImagesPullingTime="25.169510684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:47:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:48:32.02726422 +0000 UTC m=+143.268452051" watchObservedRunningTime="2026-07-28 07:48:32.029548216 +0000 UTC m=+143.270736052" Jul 28 07:48:32.225637 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:32.225507 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:32.326849 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:32.326775 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:32.449130 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:32.449096 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:33.002269 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:33.002216 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:33.081207 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:33.081156 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:33.478167 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:33.478084 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:33.579518 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:33.579400 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:34.020110 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.020083 2561 generic.go:356] "Generic (PLEG): container finished" podID="7c6e39ba-1087-4763-a4d1-099be0556ebf" containerID="b04c351b3b09ba8568edf2e0900e9a2c3a38d9f781e2dd23bd0b59db14de9d53" exitCode=0 Jul 28 07:48:34.020407 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.020169 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n7v5g" event={"ID":"7c6e39ba-1087-4763-a4d1-099be0556ebf","Type":"ContainerDied","Data":"b04c351b3b09ba8568edf2e0900e9a2c3a38d9f781e2dd23bd0b59db14de9d53"} Jul 28 07:48:34.022282 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.022258 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" event={"ID":"743b8d26-92b5-4058-9043-2bb3a0351da5","Type":"ContainerStarted","Data":"4f3d23bf45438237972b7576966fefc31629acdb0a53ec92ae1ea7d779ebfd23"} Jul 28 07:48:34.022407 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.022313 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" event={"ID":"743b8d26-92b5-4058-9043-2bb3a0351da5","Type":"ContainerStarted","Data":"d1988e2be06cac3523e54c71683c1efc21ed46320242295ac58ba1e22b20677d"} Jul 28 07:48:34.022407 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.022342 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" event={"ID":"743b8d26-92b5-4058-9043-2bb3a0351da5","Type":"ContainerStarted","Data":"ef219ffdb3edcf38ae84b82ba2e9659ae3a8fcd5851b9b214217d573e922c66f"} Jul 28 07:48:34.063595 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.063552 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7556r" podStartSLOduration=2.148847595 podStartE2EDuration="4.063537529s" totalImagesPullingTime="1.914689934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:48:34.062071329 +0000 UTC m=+145.303259175" watchObservedRunningTime="2026-07-28 07:48:34.063537529 +0000 UTC m=+145.304725364" Jul 28 07:48:34.165663 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.165632 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:34.255422 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.255386 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:34.886553 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.886512 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-pt726"] Jul 28 07:48:34.894883 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.893664 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:34.902925 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.902903 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pt726" Jul 28 07:48:34.907356 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.907337 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-d6vbj\"" Jul 28 07:48:34.908847 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.908796 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 28 07:48:34.910116 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.910087 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-pt726"] Jul 28 07:48:34.983937 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:34.983898 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:35.027992 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.027960 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n7v5g" event={"ID":"7c6e39ba-1087-4763-a4d1-099be0556ebf","Type":"ContainerStarted","Data":"f60586b9cb445760ecc6f6d614eb700f45cb65d96cd4fd328a8fd06486bc40dc"} Jul 28 07:48:35.028157 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.028010 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n7v5g" event={"ID":"7c6e39ba-1087-4763-a4d1-099be0556ebf","Type":"ContainerStarted","Data":"57a09d3344c1a7843c8364889e95d796d02ed5d60c9092d26c7a5c28e2bd6d55"} Jul 28 07:48:35.045829 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.045802 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg9cz\" (UniqueName: \"kubernetes.io/projected/d3478cde-07c3-4558-aea3-f983d985111e-kube-api-access-lg9cz\") pod \"monitoring-plugin-68b7fc9574-pt726\" (UID: \"d3478cde-07c3-4558-aea3-f983d985111e\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pt726" Jul 28 07:48:35.045940 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.045865 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3478cde-07c3-4558-aea3-f983d985111e-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-pt726\" (UID: \"d3478cde-07c3-4558-aea3-f983d985111e\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pt726" Jul 28 07:48:35.050343 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.050305 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n7v5g" podStartSLOduration=2.914491398 podStartE2EDuration="5.050290659s" totalImagesPullingTime="2.026073873s" totalInitContainerRuntime="109.725388ms" isStatefulPod=true podCreationTimestamp="2026-07-28 07:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:48:35.048109911 +0000 UTC m=+146.289297749" watchObservedRunningTime="2026-07-28 07:48:35.050290659 +0000 UTC m=+146.291478494" Jul 28 07:48:35.113625 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.113571 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:35.146682 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.146621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg9cz\" (UniqueName: \"kubernetes.io/projected/d3478cde-07c3-4558-aea3-f983d985111e-kube-api-access-lg9cz\") pod \"monitoring-plugin-68b7fc9574-pt726\" (UID: \"d3478cde-07c3-4558-aea3-f983d985111e\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pt726" Jul 28 07:48:35.147009 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.146837 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3478cde-07c3-4558-aea3-f983d985111e-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-pt726\" (UID: \"d3478cde-07c3-4558-aea3-f983d985111e\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pt726" Jul 28 07:48:35.149427 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.149403 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3478cde-07c3-4558-aea3-f983d985111e-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-pt726\" (UID: \"d3478cde-07c3-4558-aea3-f983d985111e\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pt726" Jul 28 07:48:35.156042 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.156015 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg9cz\" (UniqueName: \"kubernetes.io/projected/d3478cde-07c3-4558-aea3-f983d985111e-kube-api-access-lg9cz\") pod \"monitoring-plugin-68b7fc9574-pt726\" (UID: \"d3478cde-07c3-4558-aea3-f983d985111e\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pt726" Jul 28 07:48:35.214016 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.213991 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pt726" Jul 28 07:48:35.294954 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.294926 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq"] Jul 28 07:48:35.319716 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.319695 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq"] Jul 28 07:48:35.319849 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.319832 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.323000 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.322779 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 07:48:35.323000 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.322809 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 07:48:35.323000 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.322830 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 07:48:35.323000 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.322779 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 07:48:35.323385 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.323100 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 07:48:35.323385 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.323156 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cvt6t\"" Jul 28 07:48:35.328112 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.328000 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 07:48:35.371904 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.371798 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-pt726"] Jul 28 07:48:35.374383 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:48:35.374354 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3478cde_07c3_4558_aea3_f983d985111e.slice/crio-5e853ba053f0469a4795e2037f74d1f06f52bf049e6f8fb1f4fd90f4c6a2d2d7 WatchSource:0}: Error finding container 5e853ba053f0469a4795e2037f74d1f06f52bf049e6f8fb1f4fd90f4c6a2d2d7: Status 404 returned error can't find the container with id 5e853ba053f0469a4795e2037f74d1f06f52bf049e6f8fb1f4fd90f4c6a2d2d7 Jul 28 07:48:35.449267 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.449176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32521622-5cbd-4262-8393-1024b76a277c-serving-certs-ca-bundle\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.449267 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.449210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32521622-5cbd-4262-8393-1024b76a277c-metrics-client-ca\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.449267 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.449258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32521622-5cbd-4262-8393-1024b76a277c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.449467 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.449314 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/32521622-5cbd-4262-8393-1024b76a277c-secret-telemeter-client\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.449467 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.449341 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/32521622-5cbd-4262-8393-1024b76a277c-telemeter-client-tls\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.449467 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.449360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/32521622-5cbd-4262-8393-1024b76a277c-federate-client-tls\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.449467 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.449388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j72ld\" (UniqueName: \"kubernetes.io/projected/32521622-5cbd-4262-8393-1024b76a277c-kube-api-access-j72ld\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.449467 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.449442 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32521622-5cbd-4262-8393-1024b76a277c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.549932 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.549901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32521622-5cbd-4262-8393-1024b76a277c-serving-certs-ca-bundle\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.549932 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.549934 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32521622-5cbd-4262-8393-1024b76a277c-metrics-client-ca\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.550180 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.549952 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32521622-5cbd-4262-8393-1024b76a277c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.550180 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.549978 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/32521622-5cbd-4262-8393-1024b76a277c-secret-telemeter-client\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.550180 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.549994 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/32521622-5cbd-4262-8393-1024b76a277c-telemeter-client-tls\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.550180 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.550016 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/32521622-5cbd-4262-8393-1024b76a277c-federate-client-tls\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.550180 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.550055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j72ld\" (UniqueName: \"kubernetes.io/projected/32521622-5cbd-4262-8393-1024b76a277c-kube-api-access-j72ld\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.550180 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.550093 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32521622-5cbd-4262-8393-1024b76a277c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.550981 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.550927 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32521622-5cbd-4262-8393-1024b76a277c-metrics-client-ca\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.550981 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.550946 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32521622-5cbd-4262-8393-1024b76a277c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.551154 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.551061 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32521622-5cbd-4262-8393-1024b76a277c-serving-certs-ca-bundle\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.553248 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.553205 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/32521622-5cbd-4262-8393-1024b76a277c-telemeter-client-tls\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.553345 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.553280 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32521622-5cbd-4262-8393-1024b76a277c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.553345 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.553302 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/32521622-5cbd-4262-8393-1024b76a277c-federate-client-tls\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.553480 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.553460 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/32521622-5cbd-4262-8393-1024b76a277c-secret-telemeter-client\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.560199 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.560178 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j72ld\" (UniqueName: \"kubernetes.io/projected/32521622-5cbd-4262-8393-1024b76a277c-kube-api-access-j72ld\") pod \"telemeter-client-5c889bf7f7-bwwlq\" (UID: \"32521622-5cbd-4262-8393-1024b76a277c\") " pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.633340 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.633309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" Jul 28 07:48:35.792345 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.792318 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq"] Jul 28 07:48:35.794024 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:48:35.794002 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32521622_5cbd_4262_8393_1024b76a277c.slice/crio-645dcda091afab7652c6cb55eeffadc03a914c9ff6113511aab5f6da8dc0436b WatchSource:0}: Error finding container 645dcda091afab7652c6cb55eeffadc03a914c9ff6113511aab5f6da8dc0436b: Status 404 returned error can't find the container with id 645dcda091afab7652c6cb55eeffadc03a914c9ff6113511aab5f6da8dc0436b Jul 28 07:48:35.841060 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.841021 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:35.957980 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:35.957949 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:36.032824 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.032790 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" event={"ID":"32521622-5cbd-4262-8393-1024b76a277c","Type":"ContainerStarted","Data":"645dcda091afab7652c6cb55eeffadc03a914c9ff6113511aab5f6da8dc0436b"} Jul 28 07:48:36.033909 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.033883 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pt726" event={"ID":"d3478cde-07c3-4558-aea3-f983d985111e","Type":"ContainerStarted","Data":"5e853ba053f0469a4795e2037f74d1f06f52bf049e6f8fb1f4fd90f4c6a2d2d7"} Jul 28 07:48:36.269349 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.269261 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:36.278268 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.276669 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 07:48:36.293220 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.293189 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.297145 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.296949 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 07:48:36.297145 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.297140 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4pnwh\"" Jul 28 07:48:36.300727 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.300689 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3bli1qr0d22rm\"" Jul 28 07:48:36.300988 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.300971 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 07:48:36.301217 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.301195 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 07:48:36.301498 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.301482 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 07:48:36.302708 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.302193 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 07:48:36.302708 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.302200 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 07:48:36.302708 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.302453 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 07:48:36.302708 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.302536 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 07:48:36.302708 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.302547 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 07:48:36.305428 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.305116 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 07:48:36.306219 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.306197 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 07:48:36.310286 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.306616 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 07:48:36.310286 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.307131 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 07:48:36.310286 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.307843 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 07:48:36.310286 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.308340 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 07:48:36.323248 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.323047 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 07:48:36.358481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.357967 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-config\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.358481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358017 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.358481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.358481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358108 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.358481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358155 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.358481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.358481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358193 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.358481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358263 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.358481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358314 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.358481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358339 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.358481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358379 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.358481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.359200 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358536 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.359200 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358569 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.359200 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9ps6\" (UniqueName: \"kubernetes.io/projected/9422a291-ed50-4414-9e0f-423b0ae8c9cf-kube-api-access-x9ps6\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.359200 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9422a291-ed50-4414-9e0f-423b0ae8c9cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.359200 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358670 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9422a291-ed50-4414-9e0f-423b0ae8c9cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.359200 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.359200 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358781 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.359200 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.358805 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.426754 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.426649 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:36.460310 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460484 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460325 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460484 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460368 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460484 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460417 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460484 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460646 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460646 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9ps6\" (UniqueName: \"kubernetes.io/projected/9422a291-ed50-4414-9e0f-423b0ae8c9cf-kube-api-access-x9ps6\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460646 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460544 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9422a291-ed50-4414-9e0f-423b0ae8c9cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460646 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9422a291-ed50-4414-9e0f-423b0ae8c9cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460646 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460591 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460646 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460614 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460646 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460636 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460927 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-config\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460927 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460698 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460927 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460744 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460927 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460768 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460927 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460927 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460834 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460927 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460859 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.460927 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.460887 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.461578 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.461552 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.461578 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.461573 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.462392 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.462208 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.462762 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.462736 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.463085 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.462946 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.463283 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.463260 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.465446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.464978 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.465446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.465246 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.465446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.465294 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9422a291-ed50-4414-9e0f-423b0ae8c9cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.465446 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.465400 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.466614 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.466590 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.466873 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.466849 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.466873 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.466875 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.467254 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.467206 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9422a291-ed50-4414-9e0f-423b0ae8c9cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.467912 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.467392 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.467912 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.467839 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.467912 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.467868 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-config\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.468201 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.468158 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.468766 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.468745 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.471014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.470972 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9ps6\" (UniqueName: \"kubernetes.io/projected/9422a291-ed50-4414-9e0f-423b0ae8c9cf-kube-api-access-x9ps6\") pod \"prometheus-k8s-0\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.616265 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.616170 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:36.813893 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:36.813860 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 07:48:36.817016 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:48:36.816991 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9422a291_ed50_4414_9e0f_423b0ae8c9cf.slice/crio-4cb11ff81e8ac3590d55f613f09210b24caadf5cc6fb18807a880a7c061bbf30 WatchSource:0}: Error finding container 4cb11ff81e8ac3590d55f613f09210b24caadf5cc6fb18807a880a7c061bbf30: Status 404 returned error can't find the container with id 4cb11ff81e8ac3590d55f613f09210b24caadf5cc6fb18807a880a7c061bbf30 Jul 28 07:48:37.040779 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:37.040736 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerStarted","Data":"4cb11ff81e8ac3590d55f613f09210b24caadf5cc6fb18807a880a7c061bbf30"} Jul 28 07:48:40.055303 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:40.055265 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" event={"ID":"32521622-5cbd-4262-8393-1024b76a277c","Type":"ContainerStarted","Data":"36bed9b6a7a73469585dbec9e5f2f3bd22117d6574855e0440b44a19fd1043c1"} Jul 28 07:48:40.055741 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:40.055333 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" event={"ID":"32521622-5cbd-4262-8393-1024b76a277c","Type":"ContainerStarted","Data":"bf631e4b6de6375d2c99efc285bfefee4294ab6f808ce4b418744fc43a85104d"} Jul 28 07:48:40.055741 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:40.055360 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" event={"ID":"32521622-5cbd-4262-8393-1024b76a277c","Type":"ContainerStarted","Data":"1d0e02214631e247a540ecf70daa1d976acfa85cfd1c60a5aeb2f004a348d36f"} Jul 28 07:48:40.056734 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:40.056706 2561 generic.go:356] "Generic (PLEG): container finished" podID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerID="bae6d0f283fd836e1eb9400ad1895177013c6af16282e9a10394c44ca975cfc0" exitCode=0 Jul 28 07:48:40.056849 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:40.056784 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerDied","Data":"bae6d0f283fd836e1eb9400ad1895177013c6af16282e9a10394c44ca975cfc0"} Jul 28 07:48:40.058351 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:40.058328 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pt726" event={"ID":"d3478cde-07c3-4558-aea3-f983d985111e","Type":"ContainerStarted","Data":"d5e167f2c35b401efe659ba6bd719d94e54eac6b715943e98877e752fcebe60d"} Jul 28 07:48:40.058548 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:40.058527 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pt726" Jul 28 07:48:40.063783 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:40.063767 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pt726" Jul 28 07:48:40.080623 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:40.080585 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c889bf7f7-bwwlq" podStartSLOduration=1.8893099150000001 podStartE2EDuration="5.08057404s" totalImagesPullingTime="3.191264125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:48:40.079373634 +0000 UTC m=+151.320561469" watchObservedRunningTime="2026-07-28 07:48:40.08057404 +0000 UTC m=+151.321761876" Jul 28 07:48:40.096499 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:40.096461 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pt726" podStartSLOduration=2.506842774 podStartE2EDuration="6.096449276s" totalImagesPullingTime="3.589606502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:48:40.096302549 +0000 UTC m=+151.337490385" watchObservedRunningTime="2026-07-28 07:48:40.096449276 +0000 UTC m=+151.337637110" Jul 28 07:48:40.763948 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:40.763891 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:40.825630 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:40.825594 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:44.082743 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:44.082642 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerStarted","Data":"8bd3941ffb3f7cefd0a6262966486174e851870e7d7ecb4516baf6e8c0f65948"} Jul 28 07:48:44.082743 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:44.082739 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerStarted","Data":"a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412"} Jul 28 07:48:44.084420 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:44.084385 2561 generic.go:356] "Generic (PLEG): container finished" podID="39253359-6c29-4f64-bff2-e7547420003a" containerID="9faf213655f7c10a32fb1e191574d823a1592775f2ef92b0e9f58ab14df5c907" exitCode=0 Jul 28 07:48:44.084546 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:44.084473 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kt56p" event={"ID":"39253359-6c29-4f64-bff2-e7547420003a","Type":"ContainerDied","Data":"9faf213655f7c10a32fb1e191574d823a1592775f2ef92b0e9f58ab14df5c907"} Jul 28 07:48:44.085032 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:44.084888 2561 scope.go:117] "RemoveContainer" containerID="9faf213655f7c10a32fb1e191574d823a1592775f2ef92b0e9f58ab14df5c907" Jul 28 07:48:45.091627 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:45.091591 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kt56p" event={"ID":"39253359-6c29-4f64-bff2-e7547420003a","Type":"ContainerStarted","Data":"a7eedaa2f26f503c682bc69db7535b3d710a1c2fe675ba6a388cc06f7dad2df1"} Jul 28 07:48:46.244078 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.244032 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" podUID="a69695cd-a960-4820-914f-d3c83005ccc0" containerName="registry" containerID="cri-o://35e56e74bdaae06e75e4966a8e0c9881c6f8a754221e382a23eda260b4c3750e" gracePeriod=30 Jul 28 07:48:46.561849 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.561824 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:48:46.659781 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.659754 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a69695cd-a960-4820-914f-d3c83005ccc0-registry-certificates\") pod \"a69695cd-a960-4820-914f-d3c83005ccc0\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " Jul 28 07:48:46.659923 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.659801 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-bound-sa-token\") pod \"a69695cd-a960-4820-914f-d3c83005ccc0\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " Jul 28 07:48:46.659923 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.659837 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls\") pod \"a69695cd-a960-4820-914f-d3c83005ccc0\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " Jul 28 07:48:46.659923 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.659867 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a69695cd-a960-4820-914f-d3c83005ccc0-trusted-ca\") pod \"a69695cd-a960-4820-914f-d3c83005ccc0\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " Jul 28 07:48:46.659923 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.659898 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a69695cd-a960-4820-914f-d3c83005ccc0-ca-trust-extracted\") pod \"a69695cd-a960-4820-914f-d3c83005ccc0\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " Jul 28 07:48:46.659923 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.659914 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cdrk\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-kube-api-access-2cdrk\") pod \"a69695cd-a960-4820-914f-d3c83005ccc0\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " Jul 28 07:48:46.660173 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.659972 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a69695cd-a960-4820-914f-d3c83005ccc0-image-registry-private-configuration\") pod \"a69695cd-a960-4820-914f-d3c83005ccc0\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " Jul 28 07:48:46.660173 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.660003 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a69695cd-a960-4820-914f-d3c83005ccc0-installation-pull-secrets\") pod \"a69695cd-a960-4820-914f-d3c83005ccc0\" (UID: \"a69695cd-a960-4820-914f-d3c83005ccc0\") " Jul 28 07:48:46.660297 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.660221 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a69695cd-a960-4820-914f-d3c83005ccc0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a69695cd-a960-4820-914f-d3c83005ccc0" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:48:46.661320 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.661292 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a69695cd-a960-4820-914f-d3c83005ccc0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a69695cd-a960-4820-914f-d3c83005ccc0" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:48:46.663262 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.663097 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-kube-api-access-2cdrk" (OuterVolumeSpecName: "kube-api-access-2cdrk") pod "a69695cd-a960-4820-914f-d3c83005ccc0" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0"). InnerVolumeSpecName "kube-api-access-2cdrk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:48:46.663262 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.663191 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a69695cd-a960-4820-914f-d3c83005ccc0" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:48:46.663737 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.663710 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a69695cd-a960-4820-914f-d3c83005ccc0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a69695cd-a960-4820-914f-d3c83005ccc0" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:48:46.663989 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.663894 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a69695cd-a960-4820-914f-d3c83005ccc0" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:48:46.664346 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.664308 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a69695cd-a960-4820-914f-d3c83005ccc0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a69695cd-a960-4820-914f-d3c83005ccc0" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:48:46.669676 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.669649 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a69695cd-a960-4820-914f-d3c83005ccc0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a69695cd-a960-4820-914f-d3c83005ccc0" (UID: "a69695cd-a960-4820-914f-d3c83005ccc0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 07:48:46.761737 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.761710 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a69695cd-a960-4820-914f-d3c83005ccc0-registry-certificates\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:48:46.761821 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.761746 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-bound-sa-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:48:46.761821 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.761761 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-registry-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:48:46.761821 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.761773 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a69695cd-a960-4820-914f-d3c83005ccc0-trusted-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:48:46.761821 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.761785 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a69695cd-a960-4820-914f-d3c83005ccc0-ca-trust-extracted\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:48:46.761821 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.761798 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cdrk\" (UniqueName: \"kubernetes.io/projected/a69695cd-a960-4820-914f-d3c83005ccc0-kube-api-access-2cdrk\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:48:46.761821 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.761813 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a69695cd-a960-4820-914f-d3c83005ccc0-image-registry-private-configuration\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:48:46.762018 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:46.761826 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a69695cd-a960-4820-914f-d3c83005ccc0-installation-pull-secrets\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:48:47.100712 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.100618 2561 generic.go:356] "Generic (PLEG): container finished" podID="a69695cd-a960-4820-914f-d3c83005ccc0" containerID="35e56e74bdaae06e75e4966a8e0c9881c6f8a754221e382a23eda260b4c3750e" exitCode=0 Jul 28 07:48:47.100712 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.100669 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" Jul 28 07:48:47.100911 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.100707 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" event={"ID":"a69695cd-a960-4820-914f-d3c83005ccc0","Type":"ContainerDied","Data":"35e56e74bdaae06e75e4966a8e0c9881c6f8a754221e382a23eda260b4c3750e"} Jul 28 07:48:47.100911 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.100785 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646d78b7d9-mcdkh" event={"ID":"a69695cd-a960-4820-914f-d3c83005ccc0","Type":"ContainerDied","Data":"4d7cd6b89c76640bcffcb36e5f65fe5183beea44ca5d4c500c88d3e8dae6c558"} Jul 28 07:48:47.100911 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.100814 2561 scope.go:117] "RemoveContainer" containerID="35e56e74bdaae06e75e4966a8e0c9881c6f8a754221e382a23eda260b4c3750e" Jul 28 07:48:47.104546 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.104519 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerStarted","Data":"87149d5ba16db6ce31109a44dc21de4c57f96127f4e0f85c33f2f1cc7db7f8ee"} Jul 28 07:48:47.104678 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.104592 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerStarted","Data":"03234af1290d744c504b2422d62523608b2fe32dd6a0e670c457302b81878db3"} Jul 28 07:48:47.104678 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.104644 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerStarted","Data":"044df09a496eea3c01d7071a35f1f0cff9547716f3c5f7f2f14e622f4ddb32b7"} Jul 28 07:48:47.104785 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.104682 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerStarted","Data":"0e0ebf35a156e1e0b663cc474e5a34c5460c4ecf7d0cd58ae9c6bddab57f719e"} Jul 28 07:48:47.111127 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.111112 2561 scope.go:117] "RemoveContainer" containerID="35e56e74bdaae06e75e4966a8e0c9881c6f8a754221e382a23eda260b4c3750e" Jul 28 07:48:47.111408 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:48:47.111389 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35e56e74bdaae06e75e4966a8e0c9881c6f8a754221e382a23eda260b4c3750e\": container with ID starting with 35e56e74bdaae06e75e4966a8e0c9881c6f8a754221e382a23eda260b4c3750e not found: ID does not exist" containerID="35e56e74bdaae06e75e4966a8e0c9881c6f8a754221e382a23eda260b4c3750e" Jul 28 07:48:47.111461 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.111416 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35e56e74bdaae06e75e4966a8e0c9881c6f8a754221e382a23eda260b4c3750e"} err="failed to get container status \"35e56e74bdaae06e75e4966a8e0c9881c6f8a754221e382a23eda260b4c3750e\": rpc error: code = NotFound desc = could not find container \"35e56e74bdaae06e75e4966a8e0c9881c6f8a754221e382a23eda260b4c3750e\": container with ID starting with 35e56e74bdaae06e75e4966a8e0c9881c6f8a754221e382a23eda260b4c3750e not found: ID does not exist" Jul 28 07:48:47.137619 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.137572 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.018364821 podStartE2EDuration="11.137553465s" totalImagesPullingTime="8.10133116s" totalInitContainerRuntime="17.857484ms" isStatefulPod=false podCreationTimestamp="2026-07-28 07:48:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:48:47.136261643 +0000 UTC m=+158.377449470" watchObservedRunningTime="2026-07-28 07:48:47.137553465 +0000 UTC m=+158.378741301" Jul 28 07:48:47.154789 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.154764 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-646d78b7d9-mcdkh"] Jul 28 07:48:47.160958 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.160938 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-646d78b7d9-mcdkh"] Jul 28 07:48:47.274440 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:47.274221 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a69695cd-a960-4820-914f-d3c83005ccc0" path="/var/lib/kubelet/pods/a69695cd-a960-4820-914f-d3c83005ccc0/volumes" Jul 28 07:48:49.115034 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:49.114999 2561 generic.go:356] "Generic (PLEG): container finished" podID="3837e73f-948c-40bd-b62e-5b56d9c40be3" containerID="9f9eecf8907496220a2211d1402f91e239f62ba93dd939ca1127c7311aebd647" exitCode=0 Jul 28 07:48:49.115454 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:49.115052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" event={"ID":"3837e73f-948c-40bd-b62e-5b56d9c40be3","Type":"ContainerDied","Data":"9f9eecf8907496220a2211d1402f91e239f62ba93dd939ca1127c7311aebd647"} Jul 28 07:48:49.115496 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:49.115476 2561 scope.go:117] "RemoveContainer" containerID="9f9eecf8907496220a2211d1402f91e239f62ba93dd939ca1127c7311aebd647" Jul 28 07:48:50.120787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:50.120753 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6" event={"ID":"3837e73f-948c-40bd-b62e-5b56d9c40be3","Type":"ContainerStarted","Data":"8cfa6e9f2a8af2e7f1597fbf124aae07b62ce4041664e5bba91a7d5f2b71b643"} Jul 28 07:48:51.616576 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:51.616543 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:48:52.479004 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:52.478970 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-959cfdb75-fllbm"] Jul 28 07:48:52.589068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:52.589038 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:52.689977 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:52.689939 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:52.744338 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:52.744218 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:55.743919 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:55.743885 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:48:55.804013 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:48:55.803984 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:49:17.499183 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.499111 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-959cfdb75-fllbm" podUID="e9ed74df-8ddc-4502-9d82-a03f878d5de1" containerName="console" containerID="cri-o://ace13d33b1172b23954a1864d568943311874c719102d61e18727de10d04a226" gracePeriod=15 Jul 28 07:49:17.742793 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.742769 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:49:17.826357 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.826254 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-oauth-config\") pod \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " Jul 28 07:49:17.826357 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.826311 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9h9b\" (UniqueName: \"kubernetes.io/projected/e9ed74df-8ddc-4502-9d82-a03f878d5de1-kube-api-access-b9h9b\") pod \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " Jul 28 07:49:17.826357 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.826333 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-trusted-ca-bundle\") pod \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " Jul 28 07:49:17.826357 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.826350 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-oauth-serving-cert\") pod \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " Jul 28 07:49:17.826666 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.826397 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-service-ca\") pod \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " Jul 28 07:49:17.826666 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.826444 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-config\") pod \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " Jul 28 07:49:17.826666 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.826460 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-serving-cert\") pod \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\" (UID: \"e9ed74df-8ddc-4502-9d82-a03f878d5de1\") " Jul 28 07:49:17.827086 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.826804 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e9ed74df-8ddc-4502-9d82-a03f878d5de1" (UID: "e9ed74df-8ddc-4502-9d82-a03f878d5de1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:49:17.827086 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.826812 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e9ed74df-8ddc-4502-9d82-a03f878d5de1" (UID: "e9ed74df-8ddc-4502-9d82-a03f878d5de1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:49:17.827086 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.827045 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-service-ca" (OuterVolumeSpecName: "service-ca") pod "e9ed74df-8ddc-4502-9d82-a03f878d5de1" (UID: "e9ed74df-8ddc-4502-9d82-a03f878d5de1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:49:17.827270 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.827106 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-config" (OuterVolumeSpecName: "console-config") pod "e9ed74df-8ddc-4502-9d82-a03f878d5de1" (UID: "e9ed74df-8ddc-4502-9d82-a03f878d5de1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:49:17.828935 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.828905 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e9ed74df-8ddc-4502-9d82-a03f878d5de1" (UID: "e9ed74df-8ddc-4502-9d82-a03f878d5de1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:49:17.829441 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.829420 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9ed74df-8ddc-4502-9d82-a03f878d5de1-kube-api-access-b9h9b" (OuterVolumeSpecName: "kube-api-access-b9h9b") pod "e9ed74df-8ddc-4502-9d82-a03f878d5de1" (UID: "e9ed74df-8ddc-4502-9d82-a03f878d5de1"). InnerVolumeSpecName "kube-api-access-b9h9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:49:17.829518 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.829431 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e9ed74df-8ddc-4502-9d82-a03f878d5de1" (UID: "e9ed74df-8ddc-4502-9d82-a03f878d5de1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:49:17.927866 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.927826 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:49:17.927866 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.927859 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-config\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:49:17.927866 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.927869 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-serving-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:49:17.927866 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.927878 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9ed74df-8ddc-4502-9d82-a03f878d5de1-console-oauth-config\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:49:17.928224 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.927888 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9h9b\" (UniqueName: \"kubernetes.io/projected/e9ed74df-8ddc-4502-9d82-a03f878d5de1-kube-api-access-b9h9b\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:49:17.928224 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.927897 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-trusted-ca-bundle\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:49:17.928224 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:17.927905 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9ed74df-8ddc-4502-9d82-a03f878d5de1-oauth-serving-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:49:18.234865 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:18.234832 2561 generic.go:356] "Generic (PLEG): container finished" podID="e9ed74df-8ddc-4502-9d82-a03f878d5de1" containerID="ace13d33b1172b23954a1864d568943311874c719102d61e18727de10d04a226" exitCode=0 Jul 28 07:49:18.235043 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:18.234880 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-959cfdb75-fllbm" Jul 28 07:49:18.235043 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:18.234923 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-959cfdb75-fllbm" event={"ID":"e9ed74df-8ddc-4502-9d82-a03f878d5de1","Type":"ContainerDied","Data":"ace13d33b1172b23954a1864d568943311874c719102d61e18727de10d04a226"} Jul 28 07:49:18.235043 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:18.234979 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-959cfdb75-fllbm" event={"ID":"e9ed74df-8ddc-4502-9d82-a03f878d5de1","Type":"ContainerDied","Data":"28ab5eae10a03a7b8a99bbe48018eb0febbfabce8814f921f4109e90b1dbc96e"} Jul 28 07:49:18.235043 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:18.235007 2561 scope.go:117] "RemoveContainer" containerID="ace13d33b1172b23954a1864d568943311874c719102d61e18727de10d04a226" Jul 28 07:49:18.244165 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:18.244142 2561 scope.go:117] "RemoveContainer" containerID="ace13d33b1172b23954a1864d568943311874c719102d61e18727de10d04a226" Jul 28 07:49:18.244436 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:49:18.244419 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ace13d33b1172b23954a1864d568943311874c719102d61e18727de10d04a226\": container with ID starting with ace13d33b1172b23954a1864d568943311874c719102d61e18727de10d04a226 not found: ID does not exist" containerID="ace13d33b1172b23954a1864d568943311874c719102d61e18727de10d04a226" Jul 28 07:49:18.244507 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:18.244444 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace13d33b1172b23954a1864d568943311874c719102d61e18727de10d04a226"} err="failed to get container status \"ace13d33b1172b23954a1864d568943311874c719102d61e18727de10d04a226\": rpc error: code = NotFound desc = could not find container \"ace13d33b1172b23954a1864d568943311874c719102d61e18727de10d04a226\": container with ID starting with ace13d33b1172b23954a1864d568943311874c719102d61e18727de10d04a226 not found: ID does not exist" Jul 28 07:49:18.258430 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:18.258408 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-959cfdb75-fllbm"] Jul 28 07:49:18.267812 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:18.267791 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-959cfdb75-fllbm"] Jul 28 07:49:19.274614 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:19.274577 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9ed74df-8ddc-4502-9d82-a03f878d5de1" path="/var/lib/kubelet/pods/e9ed74df-8ddc-4502-9d82-a03f878d5de1/volumes" Jul 28 07:49:20.684672 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:20.684640 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:49:31.770708 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:31.770664 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:49:36.617187 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:36.617147 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:49:36.636496 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:36.636465 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:49:37.325258 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:37.325214 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:49:42.460373 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:42.460333 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:49:46.168344 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:46.168305 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:49:46.230417 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:46.230385 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:49:54.696519 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:54.696481 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 07:49:54.697031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:54.696794 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="prometheus" containerID="cri-o://a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412" gracePeriod=600 Jul 28 07:49:54.697031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:54.696823 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="kube-rbac-proxy" containerID="cri-o://03234af1290d744c504b2422d62523608b2fe32dd6a0e670c457302b81878db3" gracePeriod=600 Jul 28 07:49:54.697031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:54.696838 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="thanos-sidecar" containerID="cri-o://0e0ebf35a156e1e0b663cc474e5a34c5460c4ecf7d0cd58ae9c6bddab57f719e" gracePeriod=600 Jul 28 07:49:54.697031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:54.696878 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="config-reloader" containerID="cri-o://8bd3941ffb3f7cefd0a6262966486174e851870e7d7ecb4516baf6e8c0f65948" gracePeriod=600 Jul 28 07:49:54.697031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:54.696907 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="kube-rbac-proxy-thanos" containerID="cri-o://87149d5ba16db6ce31109a44dc21de4c57f96127f4e0f85c33f2f1cc7db7f8ee" gracePeriod=600 Jul 28 07:49:54.697031 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:54.696958 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="kube-rbac-proxy-web" containerID="cri-o://044df09a496eea3c01d7071a35f1f0cff9547716f3c5f7f2f14e622f4ddb32b7" gracePeriod=600 Jul 28 07:49:55.052808 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:55.052768 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:49:55.105775 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:55.105733 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:49:55.382523 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:55.382441 2561 generic.go:356] "Generic (PLEG): container finished" podID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerID="044df09a496eea3c01d7071a35f1f0cff9547716f3c5f7f2f14e622f4ddb32b7" exitCode=0 Jul 28 07:49:55.382523 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:55.382467 2561 generic.go:356] "Generic (PLEG): container finished" podID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerID="0e0ebf35a156e1e0b663cc474e5a34c5460c4ecf7d0cd58ae9c6bddab57f719e" exitCode=0 Jul 28 07:49:55.382523 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:55.382474 2561 generic.go:356] "Generic (PLEG): container finished" podID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerID="8bd3941ffb3f7cefd0a6262966486174e851870e7d7ecb4516baf6e8c0f65948" exitCode=0 Jul 28 07:49:55.382737 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:55.382519 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerDied","Data":"044df09a496eea3c01d7071a35f1f0cff9547716f3c5f7f2f14e622f4ddb32b7"} Jul 28 07:49:55.382737 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:55.382596 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerDied","Data":"0e0ebf35a156e1e0b663cc474e5a34c5460c4ecf7d0cd58ae9c6bddab57f719e"} Jul 28 07:49:55.382737 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:55.382634 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerDied","Data":"8bd3941ffb3f7cefd0a6262966486174e851870e7d7ecb4516baf6e8c0f65948"} Jul 28 07:49:56.391349 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:56.391316 2561 generic.go:356] "Generic (PLEG): container finished" podID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerID="87149d5ba16db6ce31109a44dc21de4c57f96127f4e0f85c33f2f1cc7db7f8ee" exitCode=0 Jul 28 07:49:56.391349 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:56.391346 2561 generic.go:356] "Generic (PLEG): container finished" podID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerID="03234af1290d744c504b2422d62523608b2fe32dd6a0e670c457302b81878db3" exitCode=0 Jul 28 07:49:56.391737 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:56.391371 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerDied","Data":"87149d5ba16db6ce31109a44dc21de4c57f96127f4e0f85c33f2f1cc7db7f8ee"} Jul 28 07:49:56.391737 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:56.391435 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerDied","Data":"03234af1290d744c504b2422d62523608b2fe32dd6a0e670c457302b81878db3"} Jul 28 07:49:57.309533 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:49:57.309488 2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 28 07:49:57.310449 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:49:57.310419 2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 28 07:49:57.311286 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:49:57.311256 2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 28 07:49:57.311350 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:49:57.311300 2561 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="prometheus" probeResult="unknown" Jul 28 07:49:58.141714 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:58.141670 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:49:58.202083 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:49:58.202038 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:50:02.310109 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:50:02.310063 2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 28 07:50:02.311120 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:50:02.311083 2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 28 07:50:02.311979 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:50:02.311950 2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 28 07:50:02.312056 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:50:02.311995 2561 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="prometheus" probeResult="unknown" Jul 28 07:50:04.156363 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.156297 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.212121 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212093 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-config\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212316 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212139 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-serving-certs-ca-bundle\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212316 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212169 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212316 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212306 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-1\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212489 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212340 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9422a291-ed50-4414-9e0f-423b0ae8c9cf-config-out\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212489 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212371 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-metrics-client-ca\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212489 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212401 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212489 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212431 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-trusted-ca-bundle\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212489 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212469 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-metrics-client-certs\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212721 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212493 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9422a291-ed50-4414-9e0f-423b0ae8c9cf-tls-assets\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212721 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212550 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-tls\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212721 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212593 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-grpc-tls\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212721 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212618 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-2\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212721 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212655 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-kube-rbac-proxy\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212721 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212684 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-db\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.212721 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212680 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:50:04.212721 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212705 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-web-config\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.213108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.212733 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:50:04.213108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.213043 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:50:04.215168 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.213696 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-thanos-prometheus-http-client-file\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.215168 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.213744 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-0\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.215168 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.213771 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:50:04.215168 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.213789 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-kubelet-serving-ca-bundle\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.215168 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.213824 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9ps6\" (UniqueName: \"kubernetes.io/projected/9422a291-ed50-4414-9e0f-423b0ae8c9cf-kube-api-access-x9ps6\") pod \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\" (UID: \"9422a291-ed50-4414-9e0f-423b0ae8c9cf\") " Jul 28 07:50:04.215168 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.214306 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.215168 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.214333 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.215168 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.214348 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.215168 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.214363 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.216130 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.215896 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:50:04.216130 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.215911 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:50:04.216483 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.216441 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:50:04.216565 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.216537 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-config" (OuterVolumeSpecName: "config") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:50:04.216620 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.216594 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9422a291-ed50-4414-9e0f-423b0ae8c9cf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:50:04.216807 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.216691 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9422a291-ed50-4414-9e0f-423b0ae8c9cf-config-out" (OuterVolumeSpecName: "config-out") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 07:50:04.216807 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.216783 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 07:50:04.217846 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.217760 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:50:04.218758 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.218720 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:50:04.218758 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.218733 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:50:04.218905 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.218885 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:50:04.218959 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.218915 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:50:04.219025 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.219006 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:50:04.219453 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.219432 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:50:04.220547 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.220516 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9422a291-ed50-4414-9e0f-423b0ae8c9cf-kube-api-access-x9ps6" (OuterVolumeSpecName: "kube-api-access-x9ps6") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "kube-api-access-x9ps6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:50:04.231515 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.231472 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-web-config" (OuterVolumeSpecName: "web-config") pod "9422a291-ed50-4414-9e0f-423b0ae8c9cf" (UID: "9422a291-ed50-4414-9e0f-423b0ae8c9cf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:50:04.314793 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314751 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9ps6\" (UniqueName: \"kubernetes.io/projected/9422a291-ed50-4414-9e0f-423b0ae8c9cf-kube-api-access-x9ps6\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.314793 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314786 2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-config\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.314793 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314799 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.315014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314809 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9422a291-ed50-4414-9e0f-423b0ae8c9cf-config-out\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.315014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314819 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-metrics-client-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.315014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314828 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.315014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314836 2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-metrics-client-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.315014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314844 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9422a291-ed50-4414-9e0f-423b0ae8c9cf-tls-assets\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.315014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314852 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.315014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314860 2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-grpc-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.315014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314868 2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-secret-kube-rbac-proxy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.315014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314876 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-db\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.315014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314884 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-web-config\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.315014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314892 2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9422a291-ed50-4414-9e0f-423b0ae8c9cf-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.315014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314901 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.315014 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.314909 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9422a291-ed50-4414-9e0f-423b0ae8c9cf-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:50:04.428298 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.428187 2561 generic.go:356] "Generic (PLEG): container finished" podID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerID="a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412" exitCode=0 Jul 28 07:50:04.428298 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.428256 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerDied","Data":"a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412"} Jul 28 07:50:04.428466 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.428332 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9422a291-ed50-4414-9e0f-423b0ae8c9cf","Type":"ContainerDied","Data":"4cb11ff81e8ac3590d55f613f09210b24caadf5cc6fb18807a880a7c061bbf30"} Jul 28 07:50:04.428466 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.428352 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.428466 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.428365 2561 scope.go:117] "RemoveContainer" containerID="87149d5ba16db6ce31109a44dc21de4c57f96127f4e0f85c33f2f1cc7db7f8ee" Jul 28 07:50:04.436616 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.436597 2561 scope.go:117] "RemoveContainer" containerID="03234af1290d744c504b2422d62523608b2fe32dd6a0e670c457302b81878db3" Jul 28 07:50:04.443765 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.443746 2561 scope.go:117] "RemoveContainer" containerID="044df09a496eea3c01d7071a35f1f0cff9547716f3c5f7f2f14e622f4ddb32b7" Jul 28 07:50:04.452965 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.452944 2561 scope.go:117] "RemoveContainer" containerID="0e0ebf35a156e1e0b663cc474e5a34c5460c4ecf7d0cd58ae9c6bddab57f719e" Jul 28 07:50:04.454642 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.454617 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 07:50:04.458737 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.458712 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 07:50:04.460649 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.460634 2561 scope.go:117] "RemoveContainer" containerID="8bd3941ffb3f7cefd0a6262966486174e851870e7d7ecb4516baf6e8c0f65948" Jul 28 07:50:04.467529 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.467509 2561 scope.go:117] "RemoveContainer" containerID="a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412" Jul 28 07:50:04.475132 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.475105 2561 scope.go:117] "RemoveContainer" containerID="bae6d0f283fd836e1eb9400ad1895177013c6af16282e9a10394c44ca975cfc0" Jul 28 07:50:04.482049 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.482027 2561 scope.go:117] "RemoveContainer" containerID="87149d5ba16db6ce31109a44dc21de4c57f96127f4e0f85c33f2f1cc7db7f8ee" Jul 28 07:50:04.482361 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:50:04.482341 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87149d5ba16db6ce31109a44dc21de4c57f96127f4e0f85c33f2f1cc7db7f8ee\": container with ID starting with 87149d5ba16db6ce31109a44dc21de4c57f96127f4e0f85c33f2f1cc7db7f8ee not found: ID does not exist" containerID="87149d5ba16db6ce31109a44dc21de4c57f96127f4e0f85c33f2f1cc7db7f8ee" Jul 28 07:50:04.482430 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.482373 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87149d5ba16db6ce31109a44dc21de4c57f96127f4e0f85c33f2f1cc7db7f8ee"} err="failed to get container status \"87149d5ba16db6ce31109a44dc21de4c57f96127f4e0f85c33f2f1cc7db7f8ee\": rpc error: code = NotFound desc = could not find container \"87149d5ba16db6ce31109a44dc21de4c57f96127f4e0f85c33f2f1cc7db7f8ee\": container with ID starting with 87149d5ba16db6ce31109a44dc21de4c57f96127f4e0f85c33f2f1cc7db7f8ee not found: ID does not exist" Jul 28 07:50:04.482430 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.482394 2561 scope.go:117] "RemoveContainer" containerID="03234af1290d744c504b2422d62523608b2fe32dd6a0e670c457302b81878db3" Jul 28 07:50:04.482658 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:50:04.482625 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03234af1290d744c504b2422d62523608b2fe32dd6a0e670c457302b81878db3\": container with ID starting with 03234af1290d744c504b2422d62523608b2fe32dd6a0e670c457302b81878db3 not found: ID does not exist" containerID="03234af1290d744c504b2422d62523608b2fe32dd6a0e670c457302b81878db3" Jul 28 07:50:04.482700 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.482663 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03234af1290d744c504b2422d62523608b2fe32dd6a0e670c457302b81878db3"} err="failed to get container status \"03234af1290d744c504b2422d62523608b2fe32dd6a0e670c457302b81878db3\": rpc error: code = NotFound desc = could not find container \"03234af1290d744c504b2422d62523608b2fe32dd6a0e670c457302b81878db3\": container with ID starting with 03234af1290d744c504b2422d62523608b2fe32dd6a0e670c457302b81878db3 not found: ID does not exist" Jul 28 07:50:04.482700 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.482679 2561 scope.go:117] "RemoveContainer" containerID="044df09a496eea3c01d7071a35f1f0cff9547716f3c5f7f2f14e622f4ddb32b7" Jul 28 07:50:04.482906 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:50:04.482891 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"044df09a496eea3c01d7071a35f1f0cff9547716f3c5f7f2f14e622f4ddb32b7\": container with ID starting with 044df09a496eea3c01d7071a35f1f0cff9547716f3c5f7f2f14e622f4ddb32b7 not found: ID does not exist" containerID="044df09a496eea3c01d7071a35f1f0cff9547716f3c5f7f2f14e622f4ddb32b7" Jul 28 07:50:04.482999 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.482906 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"044df09a496eea3c01d7071a35f1f0cff9547716f3c5f7f2f14e622f4ddb32b7"} err="failed to get container status \"044df09a496eea3c01d7071a35f1f0cff9547716f3c5f7f2f14e622f4ddb32b7\": rpc error: code = NotFound desc = could not find container \"044df09a496eea3c01d7071a35f1f0cff9547716f3c5f7f2f14e622f4ddb32b7\": container with ID starting with 044df09a496eea3c01d7071a35f1f0cff9547716f3c5f7f2f14e622f4ddb32b7 not found: ID does not exist" Jul 28 07:50:04.482999 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.482917 2561 scope.go:117] "RemoveContainer" containerID="0e0ebf35a156e1e0b663cc474e5a34c5460c4ecf7d0cd58ae9c6bddab57f719e" Jul 28 07:50:04.483164 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:50:04.483093 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e0ebf35a156e1e0b663cc474e5a34c5460c4ecf7d0cd58ae9c6bddab57f719e\": container with ID starting with 0e0ebf35a156e1e0b663cc474e5a34c5460c4ecf7d0cd58ae9c6bddab57f719e not found: ID does not exist" containerID="0e0ebf35a156e1e0b663cc474e5a34c5460c4ecf7d0cd58ae9c6bddab57f719e" Jul 28 07:50:04.483164 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.483110 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e0ebf35a156e1e0b663cc474e5a34c5460c4ecf7d0cd58ae9c6bddab57f719e"} err="failed to get container status \"0e0ebf35a156e1e0b663cc474e5a34c5460c4ecf7d0cd58ae9c6bddab57f719e\": rpc error: code = NotFound desc = could not find container \"0e0ebf35a156e1e0b663cc474e5a34c5460c4ecf7d0cd58ae9c6bddab57f719e\": container with ID starting with 0e0ebf35a156e1e0b663cc474e5a34c5460c4ecf7d0cd58ae9c6bddab57f719e not found: ID does not exist" Jul 28 07:50:04.483164 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.483123 2561 scope.go:117] "RemoveContainer" containerID="8bd3941ffb3f7cefd0a6262966486174e851870e7d7ecb4516baf6e8c0f65948" Jul 28 07:50:04.483736 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:50:04.483452 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bd3941ffb3f7cefd0a6262966486174e851870e7d7ecb4516baf6e8c0f65948\": container with ID starting with 8bd3941ffb3f7cefd0a6262966486174e851870e7d7ecb4516baf6e8c0f65948 not found: ID does not exist" containerID="8bd3941ffb3f7cefd0a6262966486174e851870e7d7ecb4516baf6e8c0f65948" Jul 28 07:50:04.483736 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.483608 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd3941ffb3f7cefd0a6262966486174e851870e7d7ecb4516baf6e8c0f65948"} err="failed to get container status \"8bd3941ffb3f7cefd0a6262966486174e851870e7d7ecb4516baf6e8c0f65948\": rpc error: code = NotFound desc = could not find container \"8bd3941ffb3f7cefd0a6262966486174e851870e7d7ecb4516baf6e8c0f65948\": container with ID starting with 8bd3941ffb3f7cefd0a6262966486174e851870e7d7ecb4516baf6e8c0f65948 not found: ID does not exist" Jul 28 07:50:04.483736 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.483635 2561 scope.go:117] "RemoveContainer" containerID="a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412" Jul 28 07:50:04.484725 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:50:04.484670 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412\": container with ID starting with a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412 not found: ID does not exist" containerID="a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412" Jul 28 07:50:04.484821 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.484740 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412"} err="failed to get container status \"a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412\": rpc error: code = NotFound desc = could not find container \"a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412\": container with ID starting with a9cb1a529fcc439d87b8a48d011ef8b64b6d2a33be5da1b3af5023e9e35ae412 not found: ID does not exist" Jul 28 07:50:04.484821 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.484780 2561 scope.go:117] "RemoveContainer" containerID="bae6d0f283fd836e1eb9400ad1895177013c6af16282e9a10394c44ca975cfc0" Jul 28 07:50:04.485082 ip-10-0-132-33 kubenswrapper[2561]: E0728 07:50:04.485059 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bae6d0f283fd836e1eb9400ad1895177013c6af16282e9a10394c44ca975cfc0\": container with ID starting with bae6d0f283fd836e1eb9400ad1895177013c6af16282e9a10394c44ca975cfc0 not found: ID does not exist" containerID="bae6d0f283fd836e1eb9400ad1895177013c6af16282e9a10394c44ca975cfc0" Jul 28 07:50:04.485152 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.485091 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae6d0f283fd836e1eb9400ad1895177013c6af16282e9a10394c44ca975cfc0"} err="failed to get container status \"bae6d0f283fd836e1eb9400ad1895177013c6af16282e9a10394c44ca975cfc0\": rpc error: code = NotFound desc = could not find container \"bae6d0f283fd836e1eb9400ad1895177013c6af16282e9a10394c44ca975cfc0\": container with ID starting with bae6d0f283fd836e1eb9400ad1895177013c6af16282e9a10394c44ca975cfc0 not found: ID does not exist" Jul 28 07:50:04.485706 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.485690 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 07:50:04.485999 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.485983 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="kube-rbac-proxy-web" Jul 28 07:50:04.485999 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.485999 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="kube-rbac-proxy-web" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486006 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="kube-rbac-proxy" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486011 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="kube-rbac-proxy" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486030 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a69695cd-a960-4820-914f-d3c83005ccc0" containerName="registry" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486039 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a69695cd-a960-4820-914f-d3c83005ccc0" containerName="registry" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486049 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9ed74df-8ddc-4502-9d82-a03f878d5de1" containerName="console" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486056 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9ed74df-8ddc-4502-9d82-a03f878d5de1" containerName="console" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486065 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="thanos-sidecar" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486070 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="thanos-sidecar" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486076 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="kube-rbac-proxy-thanos" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486082 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="kube-rbac-proxy-thanos" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486093 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="init-config-reloader" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486098 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="init-config-reloader" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486104 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="prometheus" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486108 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="prometheus" Jul 28 07:50:04.486108 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486113 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="config-reloader" Jul 28 07:50:04.486596 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486118 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="config-reloader" Jul 28 07:50:04.486596 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486170 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="kube-rbac-proxy-web" Jul 28 07:50:04.486596 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486178 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9ed74df-8ddc-4502-9d82-a03f878d5de1" containerName="console" Jul 28 07:50:04.486596 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486185 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a69695cd-a960-4820-914f-d3c83005ccc0" containerName="registry" Jul 28 07:50:04.486596 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486190 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="thanos-sidecar" Jul 28 07:50:04.486596 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486195 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="kube-rbac-proxy-thanos" Jul 28 07:50:04.486596 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486200 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="config-reloader" Jul 28 07:50:04.486596 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486207 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="kube-rbac-proxy" Jul 28 07:50:04.486596 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.486217 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" containerName="prometheus" Jul 28 07:50:04.491500 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.491484 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.495063 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.494901 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 07:50:04.495063 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.494934 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 07:50:04.495063 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.494950 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4pnwh\"" Jul 28 07:50:04.495063 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.494935 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3bli1qr0d22rm\"" Jul 28 07:50:04.495063 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.494976 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 07:50:04.495063 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.494983 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 07:50:04.495063 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.495031 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 07:50:04.495567 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.495114 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 07:50:04.495567 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.495472 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 07:50:04.495567 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.495544 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 07:50:04.495681 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.495579 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 07:50:04.495722 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.495702 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 07:50:04.495722 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.495713 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 07:50:04.495954 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.495928 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 07:50:04.496068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.496053 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 07:50:04.499521 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.499498 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 07:50:04.501584 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.501565 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 07:50:04.507179 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.507156 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 07:50:04.617024 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.616983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0636b00-8b4a-4550-8b91-fef90a3a227c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617024 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617024 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617214 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617214 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617094 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617214 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617214 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617160 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617214 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617205 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-config\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617486 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617221 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617486 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617316 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617486 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617486 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617418 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617486 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617439 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0636b00-8b4a-4550-8b91-fef90a3a227c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617486 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617467 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617767 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617489 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617767 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617506 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617767 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617522 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6fj7\" (UniqueName: \"kubernetes.io/projected/f0636b00-8b4a-4550-8b91-fef90a3a227c-kube-api-access-h6fj7\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617767 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617570 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617767 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617619 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617767 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617642 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.617767 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.617661 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719043 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719260 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719053 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719260 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719084 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0636b00-8b4a-4550-8b91-fef90a3a227c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719260 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719260 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719132 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719260 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719260 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719176 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6fj7\" (UniqueName: \"kubernetes.io/projected/f0636b00-8b4a-4550-8b91-fef90a3a227c-kube-api-access-h6fj7\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719537 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719358 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719537 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719409 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719537 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719537 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719481 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719537 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719530 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0636b00-8b4a-4550-8b91-fef90a3a227c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719584 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719611 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719664 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719694 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-config\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719719 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.719787 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719756 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.720198 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.719893 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.720198 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.720107 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.720198 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.720185 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.720992 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.720963 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.722746 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.722258 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0636b00-8b4a-4550-8b91-fef90a3a227c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.722746 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.722471 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.722907 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.722889 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.722966 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.722943 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.723288 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.723264 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.723361 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.723343 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.723417 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.723357 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.723649 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.723626 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0636b00-8b4a-4550-8b91-fef90a3a227c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.723980 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.723954 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.724289 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.724265 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.724632 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.724612 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.724784 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.724770 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.725148 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.725111 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0636b00-8b4a-4550-8b91-fef90a3a227c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.725579 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.725561 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-config\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.725724 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.725707 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0636b00-8b4a-4550-8b91-fef90a3a227c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.727202 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.727184 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6fj7\" (UniqueName: \"kubernetes.io/projected/f0636b00-8b4a-4550-8b91-fef90a3a227c-kube-api-access-h6fj7\") pod \"prometheus-k8s-0\" (UID: \"f0636b00-8b4a-4550-8b91-fef90a3a227c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.802914 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.802869 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:04.950801 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:04.950774 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 07:50:04.953088 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:50:04.953063 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0636b00_8b4a_4550_8b91_fef90a3a227c.slice/crio-bdebbda4b622d2af020eabbcfffa47530d6e2c83551a73f08cab64c49f659c88 WatchSource:0}: Error finding container bdebbda4b622d2af020eabbcfffa47530d6e2c83551a73f08cab64c49f659c88: Status 404 returned error can't find the container with id bdebbda4b622d2af020eabbcfffa47530d6e2c83551a73f08cab64c49f659c88 Jul 28 07:50:05.274474 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:05.274391 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9422a291-ed50-4414-9e0f-423b0ae8c9cf" path="/var/lib/kubelet/pods/9422a291-ed50-4414-9e0f-423b0ae8c9cf/volumes" Jul 28 07:50:05.434616 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:05.434575 2561 generic.go:356] "Generic (PLEG): container finished" podID="f0636b00-8b4a-4550-8b91-fef90a3a227c" containerID="d143fff5d6d4d9d2168bfd0a4a7a8ff8a6c9af83122cccfb80bcc47869c7d8df" exitCode=0 Jul 28 07:50:05.434782 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:05.434655 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0636b00-8b4a-4550-8b91-fef90a3a227c","Type":"ContainerDied","Data":"d143fff5d6d4d9d2168bfd0a4a7a8ff8a6c9af83122cccfb80bcc47869c7d8df"} Jul 28 07:50:05.434782 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:05.434721 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0636b00-8b4a-4550-8b91-fef90a3a227c","Type":"ContainerStarted","Data":"bdebbda4b622d2af020eabbcfffa47530d6e2c83551a73f08cab64c49f659c88"} Jul 28 07:50:05.928351 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:05.928303 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:50:06.029691 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:06.029657 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:50:06.098870 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:06.098783 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:50:06.441910 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:06.441824 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0636b00-8b4a-4550-8b91-fef90a3a227c","Type":"ContainerStarted","Data":"2fc63ff252f7427d4b3e27f628cd03b54a5123bf5c3a0954d33d0e10ce67adc6"} Jul 28 07:50:06.441910 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:06.441912 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0636b00-8b4a-4550-8b91-fef90a3a227c","Type":"ContainerStarted","Data":"38a40043f1ae7083a7aff83e17ee7079db3a0040d30b4508dd92b88c9b3cfe23"} Jul 28 07:50:06.442323 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:06.441938 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0636b00-8b4a-4550-8b91-fef90a3a227c","Type":"ContainerStarted","Data":"5ea9b996c4062c579a1c85222d5b9ccb4416973567238b9c071bf791593cb365"} Jul 28 07:50:06.442323 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:06.441964 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0636b00-8b4a-4550-8b91-fef90a3a227c","Type":"ContainerStarted","Data":"44f820254ffe6abb23c0430935ec5eee29048fc3fa1b9ee055b3f9e789b8d035"} Jul 28 07:50:06.442323 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:06.441988 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0636b00-8b4a-4550-8b91-fef90a3a227c","Type":"ContainerStarted","Data":"ac66512facc2bd345823a67b69d1c081326d13afb4688aeda4c35e3936a387a1"} Jul 28 07:50:06.442323 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:06.442009 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0636b00-8b4a-4550-8b91-fef90a3a227c","Type":"ContainerStarted","Data":"e6ede9d66b5a4fe8f99c4f33830ad0233620acc935c3be8bd634b8e7684232fd"} Jul 28 07:50:06.473110 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:06.473057 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.454700564 podStartE2EDuration="2.473039266s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.338702ms" isStatefulPod=false podCreationTimestamp="2026-07-28 07:50:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:50:06.470735862 +0000 UTC m=+237.711923697" watchObservedRunningTime="2026-07-28 07:50:06.473039266 +0000 UTC m=+237.714227101" Jul 28 07:50:09.803393 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:09.803349 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:50:10.738612 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:10.738582 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:50:10.839438 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:50:10.839402 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:04.467450 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:04.467417 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:04.600639 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:04.600601 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:04.803621 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:04.803534 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:51:04.819565 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:04.819533 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:51:05.685140 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:05.685109 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 07:51:09.183436 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:09.183413 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/ovn-acl-logging/0.log" Jul 28 07:51:09.191459 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:09.191432 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 07:51:09.198035 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:09.198014 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/ovn-acl-logging/0.log" Jul 28 07:51:31.380775 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:31.380732 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:32.262007 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:32.261961 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:34.905391 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:34.905342 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:35.005981 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:35.005939 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:37.097986 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:37.097948 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:37.205807 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:37.205769 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:39.423949 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.423918 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:39.535859 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.535824 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:39.662135 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.662097 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:39.712652 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.712622 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-96mgh"] Jul 28 07:51:39.715825 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.715809 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-96mgh" Jul 28 07:51:39.718578 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.718560 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 28 07:51:39.719566 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.719546 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ltf9g\"" Jul 28 07:51:39.719645 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.719550 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 28 07:51:39.724346 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.724325 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-96mgh"] Jul 28 07:51:39.760397 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.760369 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:39.813411 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.813383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39b6255c-8771-4bef-be59-81240b5eca8b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-96mgh\" (UID: \"39b6255c-8771-4bef-be59-81240b5eca8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-96mgh" Jul 28 07:51:39.813560 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.813476 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxzft\" (UniqueName: \"kubernetes.io/projected/39b6255c-8771-4bef-be59-81240b5eca8b-kube-api-access-gxzft\") pod \"cert-manager-cainjector-559cdd8c87-96mgh\" (UID: \"39b6255c-8771-4bef-be59-81240b5eca8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-96mgh" Jul 28 07:51:39.914402 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.914372 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxzft\" (UniqueName: \"kubernetes.io/projected/39b6255c-8771-4bef-be59-81240b5eca8b-kube-api-access-gxzft\") pod \"cert-manager-cainjector-559cdd8c87-96mgh\" (UID: \"39b6255c-8771-4bef-be59-81240b5eca8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-96mgh" Jul 28 07:51:39.914563 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.914420 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39b6255c-8771-4bef-be59-81240b5eca8b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-96mgh\" (UID: \"39b6255c-8771-4bef-be59-81240b5eca8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-96mgh" Jul 28 07:51:39.923004 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.922982 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39b6255c-8771-4bef-be59-81240b5eca8b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-96mgh\" (UID: \"39b6255c-8771-4bef-be59-81240b5eca8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-96mgh" Jul 28 07:51:39.923196 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:39.923175 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxzft\" (UniqueName: \"kubernetes.io/projected/39b6255c-8771-4bef-be59-81240b5eca8b-kube-api-access-gxzft\") pod \"cert-manager-cainjector-559cdd8c87-96mgh\" (UID: \"39b6255c-8771-4bef-be59-81240b5eca8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-96mgh" Jul 28 07:51:40.042809 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:40.042725 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-96mgh" Jul 28 07:51:40.176890 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:40.176863 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-96mgh"] Jul 28 07:51:40.179877 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:51:40.179852 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39b6255c_8771_4bef_be59_81240b5eca8b.slice/crio-db8f5edf7bed4f1186acc9a8f7d0f8f58617aef910f4a6ac759ca88b92d79c8c WatchSource:0}: Error finding container db8f5edf7bed4f1186acc9a8f7d0f8f58617aef910f4a6ac759ca88b92d79c8c: Status 404 returned error can't find the container with id db8f5edf7bed4f1186acc9a8f7d0f8f58617aef910f4a6ac759ca88b92d79c8c Jul 28 07:51:40.182260 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:40.182216 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 07:51:40.807687 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:40.807646 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-96mgh" event={"ID":"39b6255c-8771-4bef-be59-81240b5eca8b","Type":"ContainerStarted","Data":"db8f5edf7bed4f1186acc9a8f7d0f8f58617aef910f4a6ac759ca88b92d79c8c"} Jul 28 07:51:43.821786 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:43.821748 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-96mgh" event={"ID":"39b6255c-8771-4bef-be59-81240b5eca8b","Type":"ContainerStarted","Data":"dd6364cad8d426e3ea872dac03e8f6a3037e81316611520cb0fc6dfd416be875"} Jul 28 07:51:43.839654 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:43.839603 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-96mgh" podStartSLOduration=1.968115188 podStartE2EDuration="4.839587982s" totalImagesPullingTime="2.871472794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:51:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:51:43.837479249 +0000 UTC m=+335.078667085" watchObservedRunningTime="2026-07-28 07:51:43.839587982 +0000 UTC m=+335.080775817" Jul 28 07:51:45.008636 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:45.008602 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:45.106461 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:45.106427 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:47.056864 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:47.056817 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:54.396173 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:54.396136 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:51:54.494733 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:51:54.494692 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:52:06.616032 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:06.615945 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:52:07.887910 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:07.887873 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:52:12.177932 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:12.177894 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:52:12.242565 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:12.242532 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:52:15.683392 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:15.683355 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:52:17.215399 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:17.215359 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:52:22.505874 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:22.505831 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:52:22.616009 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:22.615971 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:52:22.804084 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:22.803999 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:52:37.605877 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:37.605840 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:52:37.707753 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:37.707716 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:52:40.689480 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.689422 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:52:40.696784 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.696758 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm"] Jul 28 07:52:40.699753 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.699738 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" Jul 28 07:52:40.702463 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.702446 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 28 07:52:40.702572 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.702508 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 28 07:52:40.702572 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.702450 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 28 07:52:40.703469 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.703453 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-wt7hc\"" Jul 28 07:52:40.703542 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.703526 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 28 07:52:40.710160 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.710142 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm"] Jul 28 07:52:40.719006 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.718987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7d01c05-5ec4-4c90-91fd-3ecc9f836817-cert\") pod \"kubeflow-trainer-controller-manager-58578cbcc6-sdtwm\" (UID: \"e7d01c05-5ec4-4c90-91fd-3ecc9f836817\") " pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" Jul 28 07:52:40.719096 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.719031 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e7d01c05-5ec4-4c90-91fd-3ecc9f836817-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-58578cbcc6-sdtwm\" (UID: \"e7d01c05-5ec4-4c90-91fd-3ecc9f836817\") " pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" Jul 28 07:52:40.719096 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.719086 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4lbg\" (UniqueName: \"kubernetes.io/projected/e7d01c05-5ec4-4c90-91fd-3ecc9f836817-kube-api-access-q4lbg\") pod \"kubeflow-trainer-controller-manager-58578cbcc6-sdtwm\" (UID: \"e7d01c05-5ec4-4c90-91fd-3ecc9f836817\") " pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" Jul 28 07:52:40.819429 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.819402 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7d01c05-5ec4-4c90-91fd-3ecc9f836817-cert\") pod \"kubeflow-trainer-controller-manager-58578cbcc6-sdtwm\" (UID: \"e7d01c05-5ec4-4c90-91fd-3ecc9f836817\") " pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" Jul 28 07:52:40.819549 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.819449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e7d01c05-5ec4-4c90-91fd-3ecc9f836817-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-58578cbcc6-sdtwm\" (UID: \"e7d01c05-5ec4-4c90-91fd-3ecc9f836817\") " pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" Jul 28 07:52:40.819549 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.819487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4lbg\" (UniqueName: \"kubernetes.io/projected/e7d01c05-5ec4-4c90-91fd-3ecc9f836817-kube-api-access-q4lbg\") pod \"kubeflow-trainer-controller-manager-58578cbcc6-sdtwm\" (UID: \"e7d01c05-5ec4-4c90-91fd-3ecc9f836817\") " pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" Jul 28 07:52:40.820129 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.820103 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e7d01c05-5ec4-4c90-91fd-3ecc9f836817-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-58578cbcc6-sdtwm\" (UID: \"e7d01c05-5ec4-4c90-91fd-3ecc9f836817\") " pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" Jul 28 07:52:40.821842 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.821825 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7d01c05-5ec4-4c90-91fd-3ecc9f836817-cert\") pod \"kubeflow-trainer-controller-manager-58578cbcc6-sdtwm\" (UID: \"e7d01c05-5ec4-4c90-91fd-3ecc9f836817\") " pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" Jul 28 07:52:40.829705 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.829684 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4lbg\" (UniqueName: \"kubernetes.io/projected/e7d01c05-5ec4-4c90-91fd-3ecc9f836817-kube-api-access-q4lbg\") pod \"kubeflow-trainer-controller-manager-58578cbcc6-sdtwm\" (UID: \"e7d01c05-5ec4-4c90-91fd-3ecc9f836817\") " pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" Jul 28 07:52:40.956275 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:40.956211 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:52:41.008154 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:41.008127 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" Jul 28 07:52:41.139098 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:41.139040 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm"] Jul 28 07:52:41.143104 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:52:41.143077 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7d01c05_5ec4_4c90_91fd_3ecc9f836817.slice/crio-819d752b16d8d0db746ebedf13dcfd505f232beef40e4af9c1d70020d8e90c46 WatchSource:0}: Error finding container 819d752b16d8d0db746ebedf13dcfd505f232beef40e4af9c1d70020d8e90c46: Status 404 returned error can't find the container with id 819d752b16d8d0db746ebedf13dcfd505f232beef40e4af9c1d70020d8e90c46 Jul 28 07:52:42.047493 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:42.047449 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" event={"ID":"e7d01c05-5ec4-4c90-91fd-3ecc9f836817","Type":"ContainerStarted","Data":"819d752b16d8d0db746ebedf13dcfd505f232beef40e4af9c1d70020d8e90c46"} Jul 28 07:52:44.058507 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:44.058472 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" event={"ID":"e7d01c05-5ec4-4c90-91fd-3ecc9f836817","Type":"ContainerStarted","Data":"2aa87871f31e0c4a0e894c5b09372f423d7d8639a95c7ef9a5926202049adef2"} Jul 28 07:52:44.058956 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:44.058601 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" Jul 28 07:52:44.074976 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:44.074926 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" podStartSLOduration=1.639340463 podStartE2EDuration="4.074913172s" totalImagesPullingTime="2.435572709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:52:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:52:44.073941207 +0000 UTC m=+395.315129048" watchObservedRunningTime="2026-07-28 07:52:44.074913172 +0000 UTC m=+395.316101003" Jul 28 07:52:44.253736 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:52:44.253702 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:53:00.067194 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:53:00.067159 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-58578cbcc6-sdtwm" Jul 28 07:53:01.736588 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:53:01.736550 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:53:01.838092 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:53:01.838056 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:53:41.345097 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:53:41.345006 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:53:41.416351 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:53:41.416318 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:53:51.833199 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:53:51.833159 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:53:51.932409 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:53:51.932369 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:53:51.999353 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:53:51.999320 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:53:59.587553 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:53:59.587515 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:54:28.683633 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:28.683593 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:54:28.901766 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:28.901737 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:54:29.001480 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:29.001441 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj"] Jul 28 07:54:29.004768 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:29.004749 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" Jul 28 07:54:29.010534 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:29.010506 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-pk5bf\"/\"kube-root-ca.crt\"" Jul 28 07:54:29.010669 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:29.010506 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-pk5bf\"/\"default-dockercfg-t9x6h\"" Jul 28 07:54:29.011557 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:29.011534 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-pk5bf\"/\"openshift-service-ca.crt\"" Jul 28 07:54:29.021334 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:29.021315 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj"] Jul 28 07:54:29.022852 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:29.022827 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmcxd\" (UniqueName: \"kubernetes.io/projected/cff797b6-4779-45d1-8051-86850fba593e-kube-api-access-xmcxd\") pod \"progression-enabled-node-0-0-mz4hj\" (UID: \"cff797b6-4779-45d1-8051-86850fba593e\") " pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" Jul 28 07:54:29.123714 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:29.123679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmcxd\" (UniqueName: \"kubernetes.io/projected/cff797b6-4779-45d1-8051-86850fba593e-kube-api-access-xmcxd\") pod \"progression-enabled-node-0-0-mz4hj\" (UID: \"cff797b6-4779-45d1-8051-86850fba593e\") " pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" Jul 28 07:54:29.142100 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:29.142066 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmcxd\" (UniqueName: \"kubernetes.io/projected/cff797b6-4779-45d1-8051-86850fba593e-kube-api-access-xmcxd\") pod \"progression-enabled-node-0-0-mz4hj\" (UID: \"cff797b6-4779-45d1-8051-86850fba593e\") " pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" Jul 28 07:54:29.314274 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:29.314170 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" Jul 28 07:54:29.455722 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:29.455690 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj"] Jul 28 07:54:29.458722 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:54:29.458695 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff797b6_4779_45d1_8051_86850fba593e.slice/crio-25d74eb385f1fa341020279547109106e629aa07ac1418eb6562e45bd32f522b WatchSource:0}: Error finding container 25d74eb385f1fa341020279547109106e629aa07ac1418eb6562e45bd32f522b: Status 404 returned error can't find the container with id 25d74eb385f1fa341020279547109106e629aa07ac1418eb6562e45bd32f522b Jul 28 07:54:29.471878 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:29.471843 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" event={"ID":"cff797b6-4779-45d1-8051-86850fba593e","Type":"ContainerStarted","Data":"25d74eb385f1fa341020279547109106e629aa07ac1418eb6562e45bd32f522b"} Jul 28 07:54:31.018028 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:54:31.017990 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:55:16.517686 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:55:16.517585 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:55:16.618848 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:55:16.618817 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:55:47.634927 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:55:47.634884 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:55:48.958866 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:55:48.958814 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:56:13.993747 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:13.993706 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:56:16.595771 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:16.595742 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/ovn-acl-logging/0.log" Jul 28 07:56:16.596214 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:16.595744 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/ovn-acl-logging/0.log" Jul 28 07:56:17.975116 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:17.975079 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" event={"ID":"cff797b6-4779-45d1-8051-86850fba593e","Type":"ContainerStarted","Data":"db28ab1d7fdfb30a738436c8ef525a3613a6dd1d74ef4290747cb21e641ade49"} Jul 28 07:56:17.975565 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:17.975171 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" Jul 28 07:56:18.007333 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:18.007283 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" podStartSLOduration=2.473148831 podStartE2EDuration="1m50.007266322s" totalImagesPullingTime="1m47.534117491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:56:18.004357978 +0000 UTC m=+609.245545814" watchObservedRunningTime="2026-07-28 07:56:18.007266322 +0000 UTC m=+609.248454157" Jul 28 07:56:19.983358 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:19.983314 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" Jul 28 07:56:26.738067 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:26.738029 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:56:33.989094 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:33.989047 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:56:40.213682 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:40.213632 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" podUID="cff797b6-4779-45d1-8051-86850fba593e" containerName="node" probeResult="failure" output="Get \"http://10.132.0.26:28080/metrics\": read tcp 10.132.0.2:53316->10.132.0.26:28080: read: connection reset by peer" Jul 28 07:56:40.981639 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:40.981593 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" podUID="cff797b6-4779-45d1-8051-86850fba593e" containerName="node" probeResult="failure" output="Get \"http://10.132.0.26:28080/metrics\": dial tcp 10.132.0.26:28080: connect: connection refused" Jul 28 07:56:40.981813 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:40.981747 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" Jul 28 07:56:40.982177 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:40.982145 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" podUID="cff797b6-4779-45d1-8051-86850fba593e" containerName="node" probeResult="failure" output="Get \"http://10.132.0.26:28080/metrics\": dial tcp 10.132.0.26:28080: connect: connection refused" Jul 28 07:56:41.081421 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:41.081389 2561 generic.go:356] "Generic (PLEG): container finished" podID="cff797b6-4779-45d1-8051-86850fba593e" containerID="db28ab1d7fdfb30a738436c8ef525a3613a6dd1d74ef4290747cb21e641ade49" exitCode=0 Jul 28 07:56:41.081588 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:41.081468 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" event={"ID":"cff797b6-4779-45d1-8051-86850fba593e","Type":"ContainerDied","Data":"db28ab1d7fdfb30a738436c8ef525a3613a6dd1d74ef4290747cb21e641ade49"} Jul 28 07:56:42.221698 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:42.221668 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" Jul 28 07:56:42.326058 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:42.326022 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmcxd\" (UniqueName: \"kubernetes.io/projected/cff797b6-4779-45d1-8051-86850fba593e-kube-api-access-xmcxd\") pod \"cff797b6-4779-45d1-8051-86850fba593e\" (UID: \"cff797b6-4779-45d1-8051-86850fba593e\") " Jul 28 07:56:42.328364 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:42.328330 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cff797b6-4779-45d1-8051-86850fba593e-kube-api-access-xmcxd" (OuterVolumeSpecName: "kube-api-access-xmcxd") pod "cff797b6-4779-45d1-8051-86850fba593e" (UID: "cff797b6-4779-45d1-8051-86850fba593e"). InnerVolumeSpecName "kube-api-access-xmcxd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:56:42.427505 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:42.427426 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmcxd\" (UniqueName: \"kubernetes.io/projected/cff797b6-4779-45d1-8051-86850fba593e-kube-api-access-xmcxd\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:56:43.091603 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.091573 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" Jul 28 07:56:43.091603 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.091589 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj" event={"ID":"cff797b6-4779-45d1-8051-86850fba593e","Type":"ContainerDied","Data":"25d74eb385f1fa341020279547109106e629aa07ac1418eb6562e45bd32f522b"} Jul 28 07:56:43.091840 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.091630 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25d74eb385f1fa341020279547109106e629aa07ac1418eb6562e45bd32f522b" Jul 28 07:56:43.390901 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.390820 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:56:43.420676 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.420644 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx"] Jul 28 07:56:43.421012 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.420993 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cff797b6-4779-45d1-8051-86850fba593e" containerName="node" Jul 28 07:56:43.421012 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.421010 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cff797b6-4779-45d1-8051-86850fba593e" containerName="node" Jul 28 07:56:43.421158 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.421059 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cff797b6-4779-45d1-8051-86850fba593e" containerName="node" Jul 28 07:56:43.442355 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.442330 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx"] Jul 28 07:56:43.442531 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.442432 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" Jul 28 07:56:43.445318 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.445297 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-pk5bf\"/\"default-dockercfg-t9x6h\"" Jul 28 07:56:43.445417 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.445297 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-pk5bf\"/\"kube-root-ca.crt\"" Jul 28 07:56:43.445417 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.445297 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-pk5bf\"/\"openshift-service-ca.crt\"" Jul 28 07:56:43.534943 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.534905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9cjj\" (UniqueName: \"kubernetes.io/projected/995fb9fd-1983-4c4e-a6d5-f91ac34241a1-kube-api-access-r9cjj\") pod \"progression-disabled-node-0-0-jsdgx\" (UID: \"995fb9fd-1983-4c4e-a6d5-f91ac34241a1\") " pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" Jul 28 07:56:43.636258 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.636202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cjj\" (UniqueName: \"kubernetes.io/projected/995fb9fd-1983-4c4e-a6d5-f91ac34241a1-kube-api-access-r9cjj\") pod \"progression-disabled-node-0-0-jsdgx\" (UID: \"995fb9fd-1983-4c4e-a6d5-f91ac34241a1\") " pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" Jul 28 07:56:43.645367 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.645301 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9cjj\" (UniqueName: \"kubernetes.io/projected/995fb9fd-1983-4c4e-a6d5-f91ac34241a1-kube-api-access-r9cjj\") pod \"progression-disabled-node-0-0-jsdgx\" (UID: \"995fb9fd-1983-4c4e-a6d5-f91ac34241a1\") " pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" Jul 28 07:56:43.751187 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.751153 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" Jul 28 07:56:43.896615 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:43.896541 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx"] Jul 28 07:56:43.899745 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:56:43.899712 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995fb9fd_1983_4c4e_a6d5_f91ac34241a1.slice/crio-b2b912214215dc1274f3f3fbb84e06d98b295bf4d6ebe52d5c7aa9b5fbac8daa WatchSource:0}: Error finding container b2b912214215dc1274f3f3fbb84e06d98b295bf4d6ebe52d5c7aa9b5fbac8daa: Status 404 returned error can't find the container with id b2b912214215dc1274f3f3fbb84e06d98b295bf4d6ebe52d5c7aa9b5fbac8daa Jul 28 07:56:44.099740 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:44.099709 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" event={"ID":"995fb9fd-1983-4c4e-a6d5-f91ac34241a1","Type":"ContainerStarted","Data":"5479dcf5bfc00169c8a9574813b11595e8ea243038af65374697f3b6924ae8e7"} Jul 28 07:56:44.099929 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:44.099753 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" event={"ID":"995fb9fd-1983-4c4e-a6d5-f91ac34241a1","Type":"ContainerStarted","Data":"b2b912214215dc1274f3f3fbb84e06d98b295bf4d6ebe52d5c7aa9b5fbac8daa"} Jul 28 07:56:44.099929 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:44.099847 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" Jul 28 07:56:44.119443 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:44.119388 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" podStartSLOduration=1.119372446 podStartE2EDuration="1.119372446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:56:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:56:44.11762505 +0000 UTC m=+635.358812884" watchObservedRunningTime="2026-07-28 07:56:44.119372446 +0000 UTC m=+635.360560346" Jul 28 07:56:46.106987 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:56:46.106958 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" Jul 28 07:57:07.104540 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:07.104496 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" podUID="995fb9fd-1983-4c4e-a6d5-f91ac34241a1" containerName="node" probeResult="failure" output="Get \"http://10.132.0.27:28080/metrics\": dial tcp 10.132.0.27:28080: connect: connection refused" Jul 28 07:57:07.198802 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:07.198767 2561 generic.go:356] "Generic (PLEG): container finished" podID="995fb9fd-1983-4c4e-a6d5-f91ac34241a1" containerID="5479dcf5bfc00169c8a9574813b11595e8ea243038af65374697f3b6924ae8e7" exitCode=0 Jul 28 07:57:07.198965 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:07.198828 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" event={"ID":"995fb9fd-1983-4c4e-a6d5-f91ac34241a1","Type":"ContainerDied","Data":"5479dcf5bfc00169c8a9574813b11595e8ea243038af65374697f3b6924ae8e7"} Jul 28 07:57:08.326406 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:08.326383 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" Jul 28 07:57:08.444319 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:08.444283 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9cjj\" (UniqueName: \"kubernetes.io/projected/995fb9fd-1983-4c4e-a6d5-f91ac34241a1-kube-api-access-r9cjj\") pod \"995fb9fd-1983-4c4e-a6d5-f91ac34241a1\" (UID: \"995fb9fd-1983-4c4e-a6d5-f91ac34241a1\") " Jul 28 07:57:08.446384 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:08.446353 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/995fb9fd-1983-4c4e-a6d5-f91ac34241a1-kube-api-access-r9cjj" (OuterVolumeSpecName: "kube-api-access-r9cjj") pod "995fb9fd-1983-4c4e-a6d5-f91ac34241a1" (UID: "995fb9fd-1983-4c4e-a6d5-f91ac34241a1"). InnerVolumeSpecName "kube-api-access-r9cjj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:57:08.545576 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:08.545545 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9cjj\" (UniqueName: \"kubernetes.io/projected/995fb9fd-1983-4c4e-a6d5-f91ac34241a1-kube-api-access-r9cjj\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:57:09.207886 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:09.207861 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" Jul 28 07:57:09.207886 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:09.207881 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx" event={"ID":"995fb9fd-1983-4c4e-a6d5-f91ac34241a1","Type":"ContainerDied","Data":"b2b912214215dc1274f3f3fbb84e06d98b295bf4d6ebe52d5c7aa9b5fbac8daa"} Jul 28 07:57:09.208087 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:09.207927 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2b912214215dc1274f3f3fbb84e06d98b295bf4d6ebe52d5c7aa9b5fbac8daa" Jul 28 07:57:18.395626 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.395595 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd"] Jul 28 07:57:18.396068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.395945 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995fb9fd-1983-4c4e-a6d5-f91ac34241a1" containerName="node" Jul 28 07:57:18.396068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.395958 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="995fb9fd-1983-4c4e-a6d5-f91ac34241a1" containerName="node" Jul 28 07:57:18.396068 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.396034 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="995fb9fd-1983-4c4e-a6d5-f91ac34241a1" containerName="node" Jul 28 07:57:18.397533 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.397493 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:57:18.398460 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.398443 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" Jul 28 07:57:18.401117 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.401097 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-pk5bf\"/\"openshift-service-ca.crt\"" Jul 28 07:57:18.401210 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.401134 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-pk5bf\"/\"kube-root-ca.crt\"" Jul 28 07:57:18.401408 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.401392 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-pk5bf\"/\"default-dockercfg-t9x6h\"" Jul 28 07:57:18.407968 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.407942 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd"] Jul 28 07:57:18.526759 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.526726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbmw8\" (UniqueName: \"kubernetes.io/projected/305b22bf-aa01-422f-9bff-df0ce3ca3b53-kube-api-access-wbmw8\") pod \"progression-invalid-node-0-0-9jdrd\" (UID: \"305b22bf-aa01-422f-9bff-df0ce3ca3b53\") " pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" Jul 28 07:57:18.627582 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.627540 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbmw8\" (UniqueName: \"kubernetes.io/projected/305b22bf-aa01-422f-9bff-df0ce3ca3b53-kube-api-access-wbmw8\") pod \"progression-invalid-node-0-0-9jdrd\" (UID: \"305b22bf-aa01-422f-9bff-df0ce3ca3b53\") " pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" Jul 28 07:57:18.636439 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.636419 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbmw8\" (UniqueName: \"kubernetes.io/projected/305b22bf-aa01-422f-9bff-df0ce3ca3b53-kube-api-access-wbmw8\") pod \"progression-invalid-node-0-0-9jdrd\" (UID: \"305b22bf-aa01-422f-9bff-df0ce3ca3b53\") " pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" Jul 28 07:57:18.708045 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.708017 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" Jul 28 07:57:18.840308 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:18.840281 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd"] Jul 28 07:57:18.842800 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:57:18.842771 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305b22bf_aa01_422f_9bff_df0ce3ca3b53.slice/crio-713f603440ad9b921998d9383bd49083f00d74299472cd901dfe58d429d9eac5 WatchSource:0}: Error finding container 713f603440ad9b921998d9383bd49083f00d74299472cd901dfe58d429d9eac5: Status 404 returned error can't find the container with id 713f603440ad9b921998d9383bd49083f00d74299472cd901dfe58d429d9eac5 Jul 28 07:57:19.261223 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:19.261188 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" event={"ID":"305b22bf-aa01-422f-9bff-df0ce3ca3b53","Type":"ContainerStarted","Data":"9eb73862834e2b72aab3f068c519a26f0f50ca169cd018d283702527135f4c44"} Jul 28 07:57:19.261432 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:19.261257 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" event={"ID":"305b22bf-aa01-422f-9bff-df0ce3ca3b53","Type":"ContainerStarted","Data":"713f603440ad9b921998d9383bd49083f00d74299472cd901dfe58d429d9eac5"} Jul 28 07:57:19.261432 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:19.261278 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" Jul 28 07:57:19.280864 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:19.280817 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" podStartSLOduration=1.280796801 podStartE2EDuration="1.280796801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:57:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:57:19.278833986 +0000 UTC m=+670.520021822" watchObservedRunningTime="2026-07-28 07:57:19.280796801 +0000 UTC m=+670.521984636" Jul 28 07:57:20.264003 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:20.263967 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" podUID="305b22bf-aa01-422f-9bff-df0ce3ca3b53" containerName="node" probeResult="failure" output="Get \"http://10.132.0.28:28080/metrics\": dial tcp 10.132.0.28:28080: connect: connection refused" Jul 28 07:57:20.266733 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:20.266697 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" podUID="305b22bf-aa01-422f-9bff-df0ce3ca3b53" containerName="node" probeResult="failure" output="Get \"http://10.132.0.28:28080/metrics\": dial tcp 10.132.0.28:28080: connect: connection refused" Jul 28 07:57:21.268189 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:21.268165 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" Jul 28 07:57:26.716315 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:26.716283 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:57:33.439856 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:33.439816 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:57:33.971545 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:33.971510 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:57:42.267521 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:42.267433 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" podUID="305b22bf-aa01-422f-9bff-df0ce3ca3b53" containerName="node" probeResult="failure" output="Get \"http://10.132.0.28:28080/metrics\": dial tcp 10.132.0.28:28080: connect: connection refused" Jul 28 07:57:42.366723 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:42.366685 2561 generic.go:356] "Generic (PLEG): container finished" podID="305b22bf-aa01-422f-9bff-df0ce3ca3b53" containerID="9eb73862834e2b72aab3f068c519a26f0f50ca169cd018d283702527135f4c44" exitCode=0 Jul 28 07:57:42.366879 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:42.366762 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" event={"ID":"305b22bf-aa01-422f-9bff-df0ce3ca3b53","Type":"ContainerDied","Data":"9eb73862834e2b72aab3f068c519a26f0f50ca169cd018d283702527135f4c44"} Jul 28 07:57:43.497424 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:43.497400 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" Jul 28 07:57:43.525988 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:43.525954 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbmw8\" (UniqueName: \"kubernetes.io/projected/305b22bf-aa01-422f-9bff-df0ce3ca3b53-kube-api-access-wbmw8\") pod \"305b22bf-aa01-422f-9bff-df0ce3ca3b53\" (UID: \"305b22bf-aa01-422f-9bff-df0ce3ca3b53\") " Jul 28 07:57:43.528279 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:43.528219 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/305b22bf-aa01-422f-9bff-df0ce3ca3b53-kube-api-access-wbmw8" (OuterVolumeSpecName: "kube-api-access-wbmw8") pod "305b22bf-aa01-422f-9bff-df0ce3ca3b53" (UID: "305b22bf-aa01-422f-9bff-df0ce3ca3b53"). InnerVolumeSpecName "kube-api-access-wbmw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:57:43.627469 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:43.627382 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbmw8\" (UniqueName: \"kubernetes.io/projected/305b22bf-aa01-422f-9bff-df0ce3ca3b53-kube-api-access-wbmw8\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:57:44.376950 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:44.376915 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" event={"ID":"305b22bf-aa01-422f-9bff-df0ce3ca3b53","Type":"ContainerDied","Data":"713f603440ad9b921998d9383bd49083f00d74299472cd901dfe58d429d9eac5"} Jul 28 07:57:44.377125 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:44.376962 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="713f603440ad9b921998d9383bd49083f00d74299472cd901dfe58d429d9eac5" Jul 28 07:57:44.377125 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:57:44.376932 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd" Jul 28 07:58:11.440676 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:58:11.440596 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:58:11.542065 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:58:11.542026 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:59:30.125701 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.125658 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:59:30.153335 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.153306 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx"] Jul 28 07:59:30.153631 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.153619 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="305b22bf-aa01-422f-9bff-df0ce3ca3b53" containerName="node" Jul 28 07:59:30.153684 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.153632 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="305b22bf-aa01-422f-9bff-df0ce3ca3b53" containerName="node" Jul 28 07:59:30.153721 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.153706 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="305b22bf-aa01-422f-9bff-df0ce3ca3b53" containerName="node" Jul 28 07:59:30.155806 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.155786 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx" Jul 28 07:59:30.159079 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.159060 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-pk5bf\"/\"kube-root-ca.crt\"" Jul 28 07:59:30.160147 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.160128 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-pk5bf\"/\"openshift-service-ca.crt\"" Jul 28 07:59:30.160212 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.160169 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-pk5bf\"/\"default-dockercfg-t9x6h\"" Jul 28 07:59:30.166713 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.166664 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx"] Jul 28 07:59:30.227941 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.227907 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxf7c\" (UniqueName: \"kubernetes.io/projected/fa6d4d52-6903-48d0-ac71-1ee527ac7ff6-kube-api-access-gxf7c\") pod \"progression-no-metrics-node-0-0-btpnx\" (UID: \"fa6d4d52-6903-48d0-ac71-1ee527ac7ff6\") " pod="rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx" Jul 28 07:59:30.328845 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.328807 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxf7c\" (UniqueName: \"kubernetes.io/projected/fa6d4d52-6903-48d0-ac71-1ee527ac7ff6-kube-api-access-gxf7c\") pod \"progression-no-metrics-node-0-0-btpnx\" (UID: \"fa6d4d52-6903-48d0-ac71-1ee527ac7ff6\") " pod="rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx" Jul 28 07:59:30.337964 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.337932 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxf7c\" (UniqueName: \"kubernetes.io/projected/fa6d4d52-6903-48d0-ac71-1ee527ac7ff6-kube-api-access-gxf7c\") pod \"progression-no-metrics-node-0-0-btpnx\" (UID: \"fa6d4d52-6903-48d0-ac71-1ee527ac7ff6\") " pod="rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx" Jul 28 07:59:30.468429 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.468401 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx" Jul 28 07:59:30.599199 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.599176 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx"] Jul 28 07:59:30.601684 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:59:30.601645 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6d4d52_6903_48d0_ac71_1ee527ac7ff6.slice/crio-20b1e64e021b597dc13c6da96175ea9e197160bb44fb828f565051101ca5f511 WatchSource:0}: Error finding container 20b1e64e021b597dc13c6da96175ea9e197160bb44fb828f565051101ca5f511: Status 404 returned error can't find the container with id 20b1e64e021b597dc13c6da96175ea9e197160bb44fb828f565051101ca5f511 Jul 28 07:59:30.845481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.845362 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx" event={"ID":"fa6d4d52-6903-48d0-ac71-1ee527ac7ff6","Type":"ContainerStarted","Data":"3aa4ff67a6998fa55d6e3c014dae2672629c571a2377cc07204b8316d9b0862e"} Jul 28 07:59:30.845481 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.845419 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx" event={"ID":"fa6d4d52-6903-48d0-ac71-1ee527ac7ff6","Type":"ContainerStarted","Data":"20b1e64e021b597dc13c6da96175ea9e197160bb44fb828f565051101ca5f511"} Jul 28 07:59:30.862085 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:30.861990 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx" podStartSLOduration=0.861972541 podStartE2EDuration="861.972541ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:59:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:59:30.861089663 +0000 UTC m=+802.102277498" watchObservedRunningTime="2026-07-28 07:59:30.861972541 +0000 UTC m=+802.103160377" Jul 28 07:59:35.868282 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:35.868211 2561 generic.go:356] "Generic (PLEG): container finished" podID="fa6d4d52-6903-48d0-ac71-1ee527ac7ff6" containerID="3aa4ff67a6998fa55d6e3c014dae2672629c571a2377cc07204b8316d9b0862e" exitCode=0 Jul 28 07:59:35.868690 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:35.868282 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx" event={"ID":"fa6d4d52-6903-48d0-ac71-1ee527ac7ff6","Type":"ContainerDied","Data":"3aa4ff67a6998fa55d6e3c014dae2672629c571a2377cc07204b8316d9b0862e"} Jul 28 07:59:36.993075 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:36.993045 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx" Jul 28 07:59:37.079118 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:37.079085 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxf7c\" (UniqueName: \"kubernetes.io/projected/fa6d4d52-6903-48d0-ac71-1ee527ac7ff6-kube-api-access-gxf7c\") pod \"fa6d4d52-6903-48d0-ac71-1ee527ac7ff6\" (UID: \"fa6d4d52-6903-48d0-ac71-1ee527ac7ff6\") " Jul 28 07:59:37.081293 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:37.081263 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6d4d52-6903-48d0-ac71-1ee527ac7ff6-kube-api-access-gxf7c" (OuterVolumeSpecName: "kube-api-access-gxf7c") pod "fa6d4d52-6903-48d0-ac71-1ee527ac7ff6" (UID: "fa6d4d52-6903-48d0-ac71-1ee527ac7ff6"). InnerVolumeSpecName "kube-api-access-gxf7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:59:37.180350 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:37.180276 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxf7c\" (UniqueName: \"kubernetes.io/projected/fa6d4d52-6903-48d0-ac71-1ee527ac7ff6-kube-api-access-gxf7c\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 07:59:37.878302 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:37.878273 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx" Jul 28 07:59:37.878464 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:37.878278 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx" event={"ID":"fa6d4d52-6903-48d0-ac71-1ee527ac7ff6","Type":"ContainerDied","Data":"20b1e64e021b597dc13c6da96175ea9e197160bb44fb828f565051101ca5f511"} Jul 28 07:59:37.878464 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:37.878397 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20b1e64e021b597dc13c6da96175ea9e197160bb44fb828f565051101ca5f511" Jul 28 07:59:42.221581 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.221540 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:59:42.510815 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.510739 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8vhwv/must-gather-wj4qv"] Jul 28 07:59:42.511067 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.511055 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6d4d52-6903-48d0-ac71-1ee527ac7ff6" containerName="node" Jul 28 07:59:42.511107 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.511069 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6d4d52-6903-48d0-ac71-1ee527ac7ff6" containerName="node" Jul 28 07:59:42.511140 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.511116 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6d4d52-6903-48d0-ac71-1ee527ac7ff6" containerName="node" Jul 28 07:59:42.513196 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.513173 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8vhwv/must-gather-wj4qv" Jul 28 07:59:42.515799 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.515779 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8vhwv\"/\"kube-root-ca.crt\"" Jul 28 07:59:42.516850 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.516829 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8vhwv\"/\"default-dockercfg-jvt8d\"" Jul 28 07:59:42.516956 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.516839 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8vhwv\"/\"openshift-service-ca.crt\"" Jul 28 07:59:42.522802 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.522778 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8vhwv/must-gather-wj4qv"] Jul 28 07:59:42.526645 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.526622 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:59:42.581700 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.581671 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:59:42.624104 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.624057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bdddcb35-22be-476a-8519-9494c02859ca-must-gather-output\") pod \"must-gather-wj4qv\" (UID: \"bdddcb35-22be-476a-8519-9494c02859ca\") " pod="openshift-must-gather-8vhwv/must-gather-wj4qv" Jul 28 07:59:42.624286 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.624162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8dpq\" (UniqueName: \"kubernetes.io/projected/bdddcb35-22be-476a-8519-9494c02859ca-kube-api-access-n8dpq\") pod \"must-gather-wj4qv\" (UID: \"bdddcb35-22be-476a-8519-9494c02859ca\") " pod="openshift-must-gather-8vhwv/must-gather-wj4qv" Jul 28 07:59:42.725561 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.725522 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bdddcb35-22be-476a-8519-9494c02859ca-must-gather-output\") pod \"must-gather-wj4qv\" (UID: \"bdddcb35-22be-476a-8519-9494c02859ca\") " pod="openshift-must-gather-8vhwv/must-gather-wj4qv" Jul 28 07:59:42.725720 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.725600 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8dpq\" (UniqueName: \"kubernetes.io/projected/bdddcb35-22be-476a-8519-9494c02859ca-kube-api-access-n8dpq\") pod \"must-gather-wj4qv\" (UID: \"bdddcb35-22be-476a-8519-9494c02859ca\") " pod="openshift-must-gather-8vhwv/must-gather-wj4qv" Jul 28 07:59:42.725882 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.725859 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bdddcb35-22be-476a-8519-9494c02859ca-must-gather-output\") pod \"must-gather-wj4qv\" (UID: \"bdddcb35-22be-476a-8519-9494c02859ca\") " pod="openshift-must-gather-8vhwv/must-gather-wj4qv" Jul 28 07:59:42.734319 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.734290 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8dpq\" (UniqueName: \"kubernetes.io/projected/bdddcb35-22be-476a-8519-9494c02859ca-kube-api-access-n8dpq\") pod \"must-gather-wj4qv\" (UID: \"bdddcb35-22be-476a-8519-9494c02859ca\") " pod="openshift-must-gather-8vhwv/must-gather-wj4qv" Jul 28 07:59:42.823076 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.822982 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8vhwv/must-gather-wj4qv" Jul 28 07:59:42.953439 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.953406 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8vhwv/must-gather-wj4qv"] Jul 28 07:59:42.956731 ip-10-0-132-33 kubenswrapper[2561]: W0728 07:59:42.956698 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdddcb35_22be_476a_8519_9494c02859ca.slice/crio-b3108da5d84d3b75dce3128b3b11f80ebd35b5174e2a13dce1cf69d8a6e8ff48 WatchSource:0}: Error finding container b3108da5d84d3b75dce3128b3b11f80ebd35b5174e2a13dce1cf69d8a6e8ff48: Status 404 returned error can't find the container with id b3108da5d84d3b75dce3128b3b11f80ebd35b5174e2a13dce1cf69d8a6e8ff48 Jul 28 07:59:42.958526 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:42.958511 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 07:59:43.916245 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:43.916189 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8vhwv/must-gather-wj4qv" event={"ID":"bdddcb35-22be-476a-8519-9494c02859ca","Type":"ContainerStarted","Data":"b3108da5d84d3b75dce3128b3b11f80ebd35b5174e2a13dce1cf69d8a6e8ff48"} Jul 28 07:59:47.211512 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:47.211479 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx"] Jul 28 07:59:47.218515 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:47.218488 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-disabled-node-0-0-jsdgx"] Jul 28 07:59:47.222577 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:47.222549 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj"] Jul 28 07:59:47.228050 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:47.228019 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-enabled-node-0-0-mz4hj"] Jul 28 07:59:47.233190 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:47.233164 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd"] Jul 28 07:59:47.238172 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:47.238149 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-invalid-node-0-0-9jdrd"] Jul 28 07:59:47.256139 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:47.256102 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx"] Jul 28 07:59:47.260099 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:47.260071 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-pk5bf/progression-no-metrics-node-0-0-btpnx"] Jul 28 07:59:47.275589 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:47.275540 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="305b22bf-aa01-422f-9bff-df0ce3ca3b53" path="/var/lib/kubelet/pods/305b22bf-aa01-422f-9bff-df0ce3ca3b53/volumes" Jul 28 07:59:47.276099 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:47.275978 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="995fb9fd-1983-4c4e-a6d5-f91ac34241a1" path="/var/lib/kubelet/pods/995fb9fd-1983-4c4e-a6d5-f91ac34241a1/volumes" Jul 28 07:59:47.276403 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:47.276385 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cff797b6-4779-45d1-8051-86850fba593e" path="/var/lib/kubelet/pods/cff797b6-4779-45d1-8051-86850fba593e/volumes" Jul 28 07:59:47.276728 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:47.276710 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa6d4d52-6903-48d0-ac71-1ee527ac7ff6" path="/var/lib/kubelet/pods/fa6d4d52-6903-48d0-ac71-1ee527ac7ff6/volumes" Jul 28 07:59:47.397096 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:47.397034 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:59:49.314514 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:49.314425 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:59:49.415185 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:49.415153 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:59:49.954716 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:49.954677 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8vhwv/must-gather-wj4qv" event={"ID":"bdddcb35-22be-476a-8519-9494c02859ca","Type":"ContainerStarted","Data":"9095d1fbe6decac93c3e0fc690d24974ca76896c760270d621793fc41836939a"} Jul 28 07:59:49.954903 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:49.954836 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8vhwv/must-gather-wj4qv" event={"ID":"bdddcb35-22be-476a-8519-9494c02859ca","Type":"ContainerStarted","Data":"10d81a077f8a9f7e48cacb3144e231415fda07f18843cdd7a71f7fe5f8ee9dba"} Jul 28 07:59:49.973371 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:49.973319 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8vhwv/must-gather-wj4qv" podStartSLOduration=1.792740008 podStartE2EDuration="7.973302443s" totalImagesPullingTime="6.180562435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:59:49.972318632 +0000 UTC m=+821.213506469" watchObservedRunningTime="2026-07-28 07:59:49.973302443 +0000 UTC m=+821.214490277" Jul 28 07:59:53.482479 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:53.482438 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:59:53.543833 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:53.543798 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 07:59:58.750352 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:58.750321 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-58578cbcc6-sdtwm_e7d01c05-5ec4-4c90-91fd-3ecc9f836817/manager/0.log" Jul 28 07:59:59.227880 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:59.227833 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-58578cbcc6-sdtwm_e7d01c05-5ec4-4c90-91fd-3ecc9f836817/manager/0.log" Jul 28 07:59:59.715930 ip-10-0-132-33 kubenswrapper[2561]: I0728 07:59:59.715894 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-58578cbcc6-sdtwm_e7d01c05-5ec4-4c90-91fd-3ecc9f836817/manager/0.log" Jul 28 08:00:35.199253 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:35.199201 2561 generic.go:356] "Generic (PLEG): container finished" podID="bdddcb35-22be-476a-8519-9494c02859ca" containerID="10d81a077f8a9f7e48cacb3144e231415fda07f18843cdd7a71f7fe5f8ee9dba" exitCode=0 Jul 28 08:00:35.199596 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:35.199280 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8vhwv/must-gather-wj4qv" event={"ID":"bdddcb35-22be-476a-8519-9494c02859ca","Type":"ContainerDied","Data":"10d81a077f8a9f7e48cacb3144e231415fda07f18843cdd7a71f7fe5f8ee9dba"} Jul 28 08:00:35.199640 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:35.199603 2561 scope.go:117] "RemoveContainer" containerID="10d81a077f8a9f7e48cacb3144e231415fda07f18843cdd7a71f7fe5f8ee9dba" Jul 28 08:00:36.156214 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:36.156175 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8vhwv_must-gather-wj4qv_bdddcb35-22be-476a-8519-9494c02859ca/gather/0.log" Jul 28 08:00:36.569097 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:36.569064 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 08:00:36.774088 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:36.774044 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 08:00:36.843281 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:36.843188 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 08:00:39.737768 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:39.737736 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bwskd_764467bb-de90-44d5-bbe3-5a1bfc57a04a/global-pull-secret-syncer/0.log" Jul 28 08:00:39.830720 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:39.830684 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" Jul 28 08:00:39.953778 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:39.953747 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-33.ec2.internal_fcb9bcfc43c07955a28965fcba36e638/haproxy/0.log" Jul 28 08:00:41.537014 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:41.536974 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-8vhwv/must-gather-wj4qv"] Jul 28 08:00:41.537502 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:41.537202 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-8vhwv/must-gather-wj4qv" podUID="bdddcb35-22be-476a-8519-9494c02859ca" containerName="copy" containerID="cri-o://9095d1fbe6decac93c3e0fc690d24974ca76896c760270d621793fc41836939a" gracePeriod=2 Jul 28 08:00:41.543684 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:41.543659 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-8vhwv/must-gather-wj4qv"] Jul 28 08:00:41.544629 ip-10-0-132-33 kubenswrapper[2561]: E0728 08:00:41.544604 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"bdddcb35-22be-476a-8519-9494c02859ca\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-8vhwv\"/\"must-gather-wj4qv\": pods \"must-gather-wj4qv\" not found" pod="openshift-must-gather-8vhwv/must-gather-wj4qv" Jul 28 08:00:41.780027 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:41.780005 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8vhwv_must-gather-wj4qv_bdddcb35-22be-476a-8519-9494c02859ca/copy/0.log" Jul 28 08:00:41.783084 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:41.783065 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8vhwv/must-gather-wj4qv" Jul 28 08:00:41.785332 ip-10-0-132-33 kubenswrapper[2561]: E0728 08:00:41.785308 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-wj4qv\" is forbidden: User \"system:node:ip-10-0-132-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-8vhwv\": no relationship found between node 'ip-10-0-132-33.ec2.internal' and this object" podUID="bdddcb35-22be-476a-8519-9494c02859ca" pod="openshift-must-gather-8vhwv/must-gather-wj4qv" Jul 28 08:00:41.873386 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:41.873330 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8dpq\" (UniqueName: \"kubernetes.io/projected/bdddcb35-22be-476a-8519-9494c02859ca-kube-api-access-n8dpq\") pod \"bdddcb35-22be-476a-8519-9494c02859ca\" (UID: \"bdddcb35-22be-476a-8519-9494c02859ca\") " Jul 28 08:00:41.873386 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:41.873378 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bdddcb35-22be-476a-8519-9494c02859ca-must-gather-output\") pod \"bdddcb35-22be-476a-8519-9494c02859ca\" (UID: \"bdddcb35-22be-476a-8519-9494c02859ca\") " Jul 28 08:00:41.875609 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:41.875580 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdddcb35-22be-476a-8519-9494c02859ca-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "bdddcb35-22be-476a-8519-9494c02859ca" (UID: "bdddcb35-22be-476a-8519-9494c02859ca"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 08:00:41.875609 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:41.875596 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdddcb35-22be-476a-8519-9494c02859ca-kube-api-access-n8dpq" (OuterVolumeSpecName: "kube-api-access-n8dpq") pod "bdddcb35-22be-476a-8519-9494c02859ca" (UID: "bdddcb35-22be-476a-8519-9494c02859ca"). InnerVolumeSpecName "kube-api-access-n8dpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 08:00:41.974110 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:41.974087 2561 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bdddcb35-22be-476a-8519-9494c02859ca-must-gather-output\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 08:00:41.974110 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:41.974109 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8dpq\" (UniqueName: \"kubernetes.io/projected/bdddcb35-22be-476a-8519-9494c02859ca-kube-api-access-n8dpq\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\"" Jul 28 08:00:42.055392 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:42.055351 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 08:00:42.111848 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:42.111825 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d5b87_b2cd0036-f48f-420a-a174-ef97de31aede/konnectivity-agent/0.log" limit=1024 Jul 28 08:00:42.233486 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:42.233463 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8vhwv_must-gather-wj4qv_bdddcb35-22be-476a-8519-9494c02859ca/copy/0.log" Jul 28 08:00:42.233846 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:42.233818 2561 generic.go:356] "Generic (PLEG): container finished" podID="bdddcb35-22be-476a-8519-9494c02859ca" containerID="9095d1fbe6decac93c3e0fc690d24974ca76896c760270d621793fc41836939a" exitCode=143 Jul 28 08:00:42.233949 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:42.233866 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8vhwv/must-gather-wj4qv" Jul 28 08:00:42.233949 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:42.233914 2561 scope.go:117] "RemoveContainer" containerID="9095d1fbe6decac93c3e0fc690d24974ca76896c760270d621793fc41836939a" Jul 28 08:00:42.236192 ip-10-0-132-33 kubenswrapper[2561]: E0728 08:00:42.236165 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-wj4qv\" is forbidden: User \"system:node:ip-10-0-132-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-8vhwv\": no relationship found between node 'ip-10-0-132-33.ec2.internal' and this object" podUID="bdddcb35-22be-476a-8519-9494c02859ca" pod="openshift-must-gather-8vhwv/must-gather-wj4qv" Jul 28 08:00:42.242606 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:42.242587 2561 scope.go:117] "RemoveContainer" containerID="10d81a077f8a9f7e48cacb3144e231415fda07f18843cdd7a71f7fe5f8ee9dba" Jul 28 08:00:42.244322 ip-10-0-132-33 kubenswrapper[2561]: E0728 08:00:42.244296 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-wj4qv\" is forbidden: User \"system:node:ip-10-0-132-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-8vhwv\": no relationship found between node 'ip-10-0-132-33.ec2.internal' and this object" podUID="bdddcb35-22be-476a-8519-9494c02859ca" pod="openshift-must-gather-8vhwv/must-gather-wj4qv" Jul 28 08:00:42.253631 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:42.253615 2561 scope.go:117] "RemoveContainer" containerID="9095d1fbe6decac93c3e0fc690d24974ca76896c760270d621793fc41836939a" Jul 28 08:00:42.253851 ip-10-0-132-33 kubenswrapper[2561]: E0728 08:00:42.253833 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9095d1fbe6decac93c3e0fc690d24974ca76896c760270d621793fc41836939a\": container with ID starting with 9095d1fbe6decac93c3e0fc690d24974ca76896c760270d621793fc41836939a not found: ID does not exist" containerID="9095d1fbe6decac93c3e0fc690d24974ca76896c760270d621793fc41836939a" Jul 28 08:00:42.253895 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:42.253860 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9095d1fbe6decac93c3e0fc690d24974ca76896c760270d621793fc41836939a"} err="failed to get container status \"9095d1fbe6decac93c3e0fc690d24974ca76896c760270d621793fc41836939a\": rpc error: code = NotFound desc = could not find container \"9095d1fbe6decac93c3e0fc690d24974ca76896c760270d621793fc41836939a\": container with ID starting with 9095d1fbe6decac93c3e0fc690d24974ca76896c760270d621793fc41836939a not found: ID does not exist" Jul 28 08:00:42.253895 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:42.253875 2561 scope.go:117] "RemoveContainer" containerID="10d81a077f8a9f7e48cacb3144e231415fda07f18843cdd7a71f7fe5f8ee9dba" Jul 28 08:00:42.254124 ip-10-0-132-33 kubenswrapper[2561]: E0728 08:00:42.254102 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10d81a077f8a9f7e48cacb3144e231415fda07f18843cdd7a71f7fe5f8ee9dba\": container with ID starting with 10d81a077f8a9f7e48cacb3144e231415fda07f18843cdd7a71f7fe5f8ee9dba not found: ID does not exist" containerID="10d81a077f8a9f7e48cacb3144e231415fda07f18843cdd7a71f7fe5f8ee9dba" Jul 28 08:00:42.254168 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:42.254133 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10d81a077f8a9f7e48cacb3144e231415fda07f18843cdd7a71f7fe5f8ee9dba"} err="failed to get container status \"10d81a077f8a9f7e48cacb3144e231415fda07f18843cdd7a71f7fe5f8ee9dba\": rpc error: code = NotFound desc = could not find container \"10d81a077f8a9f7e48cacb3144e231415fda07f18843cdd7a71f7fe5f8ee9dba\": container with ID starting with 10d81a077f8a9f7e48cacb3144e231415fda07f18843cdd7a71f7fe5f8ee9dba not found: ID does not exist" Jul 28 08:00:43.273596 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:43.273562 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdddcb35-22be-476a-8519-9494c02859ca" path="/var/lib/kubelet/pods/bdddcb35-22be-476a-8519-9494c02859ca/volumes" Jul 28 08:00:44.422966 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:44.422937 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-7556r_743b8d26-92b5-4058-9043-2bb3a0351da5/kube-state-metrics/0.log" Jul 28 08:00:44.446698 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:44.446667 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-7556r_743b8d26-92b5-4058-9043-2bb3a0351da5/kube-rbac-proxy-main/0.log" Jul 28 08:00:44.474218 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:44.474191 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-7556r_743b8d26-92b5-4058-9043-2bb3a0351da5/kube-rbac-proxy-self/0.log" Jul 28 08:00:44.535979 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:44.535947 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-pt726_d3478cde-07c3-4558-aea3-f983d985111e/monitoring-plugin/0.log" Jul 28 08:00:44.657315 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:44.657244 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n7v5g_7c6e39ba-1087-4763-a4d1-099be0556ebf/node-exporter/0.log" Jul 28 08:00:44.680731 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:44.680709 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n7v5g_7c6e39ba-1087-4763-a4d1-099be0556ebf/kube-rbac-proxy/0.log" Jul 28 08:00:44.706564 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:44.706540 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n7v5g_7c6e39ba-1087-4763-a4d1-099be0556ebf/init-textfile/0.log" Jul 28 08:00:44.919999 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:44.919892 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0636b00-8b4a-4550-8b91-fef90a3a227c/prometheus/0.log" Jul 28 08:00:44.941921 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:44.941892 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0636b00-8b4a-4550-8b91-fef90a3a227c/config-reloader/0.log" Jul 28 08:00:44.969357 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:44.969339 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0636b00-8b4a-4550-8b91-fef90a3a227c/thanos-sidecar/0.log" Jul 28 08:00:44.999619 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:44.999593 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0636b00-8b4a-4550-8b91-fef90a3a227c/kube-rbac-proxy-web/0.log" Jul 28 08:00:45.026873 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:45.026851 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0636b00-8b4a-4550-8b91-fef90a3a227c/kube-rbac-proxy/0.log" Jul 28 08:00:45.050483 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:45.050466 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0636b00-8b4a-4550-8b91-fef90a3a227c/kube-rbac-proxy-thanos/0.log" Jul 28 08:00:45.074415 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:45.074390 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0636b00-8b4a-4550-8b91-fef90a3a227c/init-config-reloader/0.log" Jul 28 08:00:45.109605 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:45.109562 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-jdbnm_caae9db2-b8c9-423b-a702-8336eca7a405/prometheus-operator/0.log" Jul 28 08:00:45.129087 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:45.129066 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-jdbnm_caae9db2-b8c9-423b-a702-8336eca7a405/kube-rbac-proxy/0.log" Jul 28 08:00:45.162049 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:45.162022 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-xh6kx_3144c73f-b628-4b83-8901-fd394e288b8e/prometheus-operator-admission-webhook/0.log" Jul 28 08:00:45.204029 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:45.203958 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c889bf7f7-bwwlq_32521622-5cbd-4262-8393-1024b76a277c/telemeter-client/0.log" Jul 28 08:00:45.235119 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:45.235093 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c889bf7f7-bwwlq_32521622-5cbd-4262-8393-1024b76a277c/reload/0.log" Jul 28 08:00:45.263740 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:45.263711 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c889bf7f7-bwwlq_32521622-5cbd-4262-8393-1024b76a277c/kube-rbac-proxy/0.log" Jul 28 08:00:46.578089 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:46.578065 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-q8pt5_68e5ffc6-636f-43c1-a25d-5fc5d6a898b3/networking-console-plugin/0.log" Jul 28 08:00:47.632406 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.632372 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-9jf2w_e0243c88-c264-4b3a-a554-4a58d3b199e9/download-server/0.log" Jul 28 08:00:47.682052 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.682016 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t"] Jul 28 08:00:47.682385 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.682360 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdddcb35-22be-476a-8519-9494c02859ca" containerName="gather" Jul 28 08:00:47.682385 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.682377 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdddcb35-22be-476a-8519-9494c02859ca" containerName="gather" Jul 28 08:00:47.682385 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.682387 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdddcb35-22be-476a-8519-9494c02859ca" containerName="copy" Jul 28 08:00:47.682628 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.682394 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdddcb35-22be-476a-8519-9494c02859ca" containerName="copy" Jul 28 08:00:47.682628 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.682473 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdddcb35-22be-476a-8519-9494c02859ca" containerName="copy" Jul 28 08:00:47.682628 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.682494 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdddcb35-22be-476a-8519-9494c02859ca" containerName="gather" Jul 28 08:00:47.687769 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.687752 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.690406 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.690386 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kg4t5\"/\"openshift-service-ca.crt\"" Jul 28 08:00:47.690636 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.690621 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kg4t5\"/\"default-dockercfg-md7tx\"" Jul 28 08:00:47.691708 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.691684 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kg4t5\"/\"kube-root-ca.crt\"" Jul 28 08:00:47.697646 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.697625 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t"] Jul 28 08:00:47.823470 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.823435 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60201910-fdee-44e4-ba91-9be034ef3012-proc\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.823470 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.823472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60201910-fdee-44e4-ba91-9be034ef3012-sys\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.823674 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.823496 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60201910-fdee-44e4-ba91-9be034ef3012-lib-modules\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.823674 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.823571 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60201910-fdee-44e4-ba91-9be034ef3012-podres\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.823674 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.823597 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42p5s\" (UniqueName: \"kubernetes.io/projected/60201910-fdee-44e4-ba91-9be034ef3012-kube-api-access-42p5s\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.924580 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.924504 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60201910-fdee-44e4-ba91-9be034ef3012-proc\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.924580 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.924536 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60201910-fdee-44e4-ba91-9be034ef3012-sys\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.924580 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.924551 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60201910-fdee-44e4-ba91-9be034ef3012-lib-modules\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.924580 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.924571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60201910-fdee-44e4-ba91-9be034ef3012-podres\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.924812 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.924595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42p5s\" (UniqueName: \"kubernetes.io/projected/60201910-fdee-44e4-ba91-9be034ef3012-kube-api-access-42p5s\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.924812 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.924622 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60201910-fdee-44e4-ba91-9be034ef3012-proc\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.924812 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.924636 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60201910-fdee-44e4-ba91-9be034ef3012-sys\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.924812 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.924690 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60201910-fdee-44e4-ba91-9be034ef3012-lib-modules\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.924812 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.924700 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60201910-fdee-44e4-ba91-9be034ef3012-podres\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.933547 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.933522 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42p5s\" (UniqueName: \"kubernetes.io/projected/60201910-fdee-44e4-ba91-9be034ef3012-kube-api-access-42p5s\") pod \"perf-node-gather-daemonset-2x26t\" (UID: \"60201910-fdee-44e4-ba91-9be034ef3012\") " pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:47.998045 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:47.998019 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:48.123899 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:48.123866 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t"] Jul 28 08:00:48.126521 ip-10-0-132-33 kubenswrapper[2561]: W0728 08:00:48.126487 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod60201910_fdee_44e4_ba91_9be034ef3012.slice/crio-47a96a0ddb1d70bb2fc85b99f8415cb560334f8fed2b6ebf6d3bbf73b45d7a32 WatchSource:0}: Error finding container 47a96a0ddb1d70bb2fc85b99f8415cb560334f8fed2b6ebf6d3bbf73b45d7a32: Status 404 returned error can't find the container with id 47a96a0ddb1d70bb2fc85b99f8415cb560334f8fed2b6ebf6d3bbf73b45d7a32 Jul 28 08:00:48.262799 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:48.262765 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" event={"ID":"60201910-fdee-44e4-ba91-9be034ef3012","Type":"ContainerStarted","Data":"e917abfa8133444fecdebedf6ca1eb2d29202d27f0a1ed97f1d6c14fbfa2dd5f"} Jul 28 08:00:48.262934 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:48.262849 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" event={"ID":"60201910-fdee-44e4-ba91-9be034ef3012","Type":"ContainerStarted","Data":"47a96a0ddb1d70bb2fc85b99f8415cb560334f8fed2b6ebf6d3bbf73b45d7a32"} Jul 28 08:00:48.262998 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:48.262982 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:48.285422 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:48.285379 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" podStartSLOduration=1.2853661 podStartE2EDuration="1.2853661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 08:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:00:48.284479888 +0000 UTC m=+879.525667724" watchObservedRunningTime="2026-07-28 08:00:48.2853661 +0000 UTC m=+879.526553934" Jul 28 08:00:49.133096 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:49.133069 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g984h_63340f7d-b861-410c-99a0-b693430a7661/dns/0.log" Jul 28 08:00:49.155965 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:49.155941 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g984h_63340f7d-b861-410c-99a0-b693430a7661/kube-rbac-proxy/0.log" Jul 28 08:00:49.182001 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:49.181977 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9g4sg_f7f6e438-4728-48e0-8506-c771771bcb7b/dns-node-resolver/0.log" Jul 28 08:00:49.705485 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:49.705456 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t7gkh_c9a3c30e-bec9-4339-bb7a-caecdd1b0684/node-ca/0.log" Jul 28 08:00:50.849043 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:50.849014 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cx6cm_7dd19cbf-97b2-4f8e-998a-d61582de2d3a/serve-healthcheck-canary/0.log" Jul 28 08:00:51.262404 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:51.262368 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-kt56p_39253359-6c29-4f64-bff2-e7547420003a/insights-operator/1.log" Jul 28 08:00:51.273030 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:51.272998 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-kt56p_39253359-6c29-4f64-bff2-e7547420003a/insights-operator/0.log" Jul 28 08:00:51.369239 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:51.369212 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bjvdl_7050f880-6fe2-492e-ae4b-63d98dc2dfea/kube-rbac-proxy/0.log" Jul 28 08:00:51.393503 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:51.393478 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bjvdl_7050f880-6fe2-492e-ae4b-63d98dc2dfea/exporter/0.log" Jul 28 08:00:51.415932 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:51.415891 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bjvdl_7050f880-6fe2-492e-ae4b-63d98dc2dfea/extractor/0.log" Jul 28 08:00:54.279299 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:54.279273 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kg4t5/perf-node-gather-daemonset-2x26t" Jul 28 08:00:57.038116 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:57.038079 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6_3837e73f-948c-40bd-b62e-5b56d9c40be3/kube-storage-version-migrator-operator/1.log" Jul 28 08:00:57.042536 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:57.042505 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-7c8v6_3837e73f-948c-40bd-b62e-5b56d9c40be3/kube-storage-version-migrator-operator/0.log" Jul 28 08:00:58.074283 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:58.074250 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-477cl_e2861be1-fa8c-43ca-b153-958d17cba737/kube-multus/0.log" Jul 28 08:00:58.490002 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:58.489977 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhxs5_b04c48a0-8584-41c2-988e-c44e79c4a7a5/kube-multus-additional-cni-plugins/0.log" Jul 28 08:00:58.517205 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:58.517167 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhxs5_b04c48a0-8584-41c2-988e-c44e79c4a7a5/egress-router-binary-copy/0.log" Jul 28 08:00:58.547734 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:58.547701 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhxs5_b04c48a0-8584-41c2-988e-c44e79c4a7a5/cni-plugins/0.log" Jul 28 08:00:58.593581 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:58.593559 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhxs5_b04c48a0-8584-41c2-988e-c44e79c4a7a5/bond-cni-plugin/0.log" Jul 28 08:00:58.623141 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:58.623108 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhxs5_b04c48a0-8584-41c2-988e-c44e79c4a7a5/routeoverride-cni/0.log" Jul 28 08:00:58.662464 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:58.662435 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhxs5_b04c48a0-8584-41c2-988e-c44e79c4a7a5/whereabouts-cni-bincopy/0.log" Jul 28 08:00:58.690980 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:58.690948 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhxs5_b04c48a0-8584-41c2-988e-c44e79c4a7a5/whereabouts-cni/0.log" Jul 28 08:00:58.914772 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:58.914739 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dnr4f_c79dbe4b-fc12-4534-9cc4-be27338b0967/network-metrics-daemon/0.log" Jul 28 08:00:58.941430 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:00:58.941406 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dnr4f_c79dbe4b-fc12-4534-9cc4-be27338b0967/kube-rbac-proxy/0.log" Jul 28 08:01:00.198923 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:01:00.198892 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/ovn-controller/0.log" Jul 28 08:01:00.219242 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:01:00.219213 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/ovn-acl-logging/1.log" Jul 28 08:01:00.219400 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:01:00.219220 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/ovn-acl-logging/0.log" Jul 28 08:01:00.241162 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:01:00.241139 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/kube-rbac-proxy-node/0.log" Jul 28 08:01:00.265592 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:01:00.265568 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 08:01:00.284362 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:01:00.284333 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/northd/0.log" Jul 28 08:01:00.306354 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:01:00.306329 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/nbdb/0.log" Jul 28 08:01:00.327604 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:01:00.327577 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/sbdb/0.log" Jul 28 08:01:00.387207 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:01:00.387180 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmf27_685a74dc-0091-47e0-9a6a-0eab75ab6c43/ovnkube-controller/0.log" Jul 28 08:01:01.374511 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:01:01.374424 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-6b2tp_60942839-5c15-456e-902b-360596800feb/check-endpoints/0.log" Jul 28 08:01:01.397845 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:01:01.397821 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-47rf9_c00766d2-de01-45bb-a127-7ace967dbbc5/network-check-target-container/0.log" Jul 28 08:01:02.358654 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:01:02.358623 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-49pdt_bf6d0d35-3f02-44f3-9e18-845a18c19b4b/iptables-alerter/0.log" Jul 28 08:01:03.063313 ip-10-0-132-33 kubenswrapper[2561]: I0728 08:01:03.063284 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-jnhb4_ed93c8db-9165-4dce-a0cd-5f1c589ac5cf/tuned/0.log"