Sep 10 00:48:13.412647 ip-10-0-129-142 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 10 00:48:13.412659 ip-10-0-129-142 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 10 00:48:13.412668 ip-10-0-129-142 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 10 00:48:13.412883 ip-10-0-129-142 systemd[1]: Failed to start Kubernetes Kubelet. Sep 10 00:48:23.477724 ip-10-0-129-142 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 10 00:48:23.477738 ip-10-0-129-142 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot bd4e55d0d3464ccf958847e91968353d -- Sep 10 00:50:16.937678 ip-10-0-129-142 systemd[1]: Starting Kubernetes Kubelet... Sep 10 00:50:17.313397 ip-10-0-129-142 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 00:50:17.313397 ip-10-0-129-142 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 00:50:17.313397 ip-10-0-129-142 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 00:50:17.313397 ip-10-0-129-142 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 00:50:17.313397 ip-10-0-129-142 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 00:50:17.315237 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.315150 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 00:50:17.319688 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.319656 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:50:17.319842 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.319829 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:50:17.319944 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.319931 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:50:17.320070 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320052 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:50:17.320070 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320063 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:50:17.320070 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320066 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:50:17.320070 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320069 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:50:17.320070 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320073 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:50:17.320070 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320076 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:50:17.320070 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320079 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320082 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320092 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320095 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320099 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320102 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320104 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320107 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320110 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320112 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320115 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320118 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320121 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320123 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320126 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320128 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320131 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320134 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320137 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320140 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:50:17.320299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320142 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320145 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320148 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320150 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320152 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320160 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320162 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320165 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320168 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320170 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320173 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320175 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320178 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320181 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320184 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320189 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320193 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320196 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320199 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:50:17.320801 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320201 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320204 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320209 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320212 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320215 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320219 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320222 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320224 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320227 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320229 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320232 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320234 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320237 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320240 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320243 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320245 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320248 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320250 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320253 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:50:17.321273 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320255 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320258 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320261 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320263 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320266 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320270 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320275 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320279 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320282 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320285 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320288 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320291 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320293 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320296 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320298 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320301 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320306 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320311 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320314 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:50:17.321793 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320317 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320321 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320323 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320326 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320328 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320331 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320334 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320336 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320339 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320342 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320344 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320347 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.320349 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321752 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321760 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321764 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321767 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321770 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321773 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321775 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:50:17.322252 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321779 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321785 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321788 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321792 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321795 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321798 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321801 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321805 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321807 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321810 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321814 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321817 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321819 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321822 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321825 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321827 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321830 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321832 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321835 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:50:17.322763 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321837 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321841 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321845 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321848 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321851 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321854 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321857 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321859 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321862 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321865 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321867 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321870 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321872 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321876 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321879 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321882 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321885 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321887 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321890 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:50:17.323243 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321892 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321895 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321897 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321900 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321903 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321906 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321908 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321911 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321913 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321915 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321918 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321921 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321923 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321925 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321928 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321930 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321933 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321935 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321938 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321941 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:50:17.323726 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321943 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321946 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321948 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321952 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321955 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321958 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321960 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321963 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321966 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321968 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321971 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321973 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321976 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321978 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321981 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321983 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321986 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321988 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321992 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321994 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:50:17.324219 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321997 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.321999 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322002 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322004 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322006 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322009 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322011 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322014 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322017 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322021 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322023 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322026 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322028 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322030 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322456 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322462 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322465 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322469 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322471 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:50:17.324731 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322474 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322477 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322479 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322482 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322485 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322487 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322490 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322493 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322495 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322498 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322500 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322504 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322507 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322509 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322511 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322514 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322516 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322519 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322521 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322524 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:50:17.325200 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322526 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322529 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322531 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322533 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322536 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322538 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322540 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322543 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322545 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322548 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322551 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322554 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322557 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322559 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322562 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322564 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322567 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322570 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322573 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:50:17.325705 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322575 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322578 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322580 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322582 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322585 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322588 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322590 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322593 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322596 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322598 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322601 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322603 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322606 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322608 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322611 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322613 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322615 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322618 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322620 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322623 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:50:17.326167 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322625 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322628 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322630 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322633 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322636 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322638 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322641 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322643 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322645 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322648 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322650 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322653 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322655 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322657 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322662 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322666 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322669 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322672 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322676 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:50:17.326709 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322680 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322683 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322685 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322688 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322690 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322693 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322696 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322699 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322703 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322706 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322708 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322711 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322713 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322716 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322718 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.322720 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322795 2567 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322836 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322842 2567 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322847 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322851 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 00:50:17.327170 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322854 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322858 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322862 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322865 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322868 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322871 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322874 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322878 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322880 2567 flags.go:64] FLAG: --cgroup-root="" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322883 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322886 2567 flags.go:64] FLAG: --client-ca-file="" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322890 2567 flags.go:64] FLAG: --cloud-provider="external" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322893 2567 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322898 2567 flags.go:64] FLAG: --cluster-domain="" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322900 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322903 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322906 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322910 2567 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322913 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322916 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322919 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322922 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322925 2567 flags.go:64] FLAG: --contention-profiling="false" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322928 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 00:50:17.327689 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322931 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322934 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322937 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322941 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322944 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322947 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322949 2567 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322952 2567 flags.go:64] FLAG: --enable-server="true" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322955 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322959 2567 flags.go:64] FLAG: --event-burst="100" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322962 2567 flags.go:64] FLAG: --event-qps="50" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322964 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322967 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322970 2567 flags.go:64] FLAG: --eviction-hard="" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322974 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322976 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322979 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322982 2567 flags.go:64] FLAG: --eviction-soft="" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322985 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322988 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322991 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322994 2567 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322996 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.322999 2567 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323002 2567 flags.go:64] FLAG: --feature-gates="" Sep 10 00:50:17.328280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323005 2567 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323008 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323011 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323014 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323017 2567 flags.go:64] FLAG: --healthz-port="10248" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323019 2567 flags.go:64] FLAG: --help="false" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323022 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323025 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323028 2567 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323031 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323034 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323038 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323040 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323043 2567 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323046 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323049 2567 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323052 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323055 2567 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323058 2567 flags.go:64] FLAG: --kube-reserved="" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323060 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323063 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323066 2567 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323069 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323072 2567 flags.go:64] FLAG: --lock-file="" Sep 10 00:50:17.329008 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323074 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323079 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323082 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323088 2567 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323091 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323093 2567 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323096 2567 flags.go:64] FLAG: --logging-format="text" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323099 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323102 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323105 2567 flags.go:64] FLAG: --manifest-url="" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323108 2567 flags.go:64] FLAG: --manifest-url-header="" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323112 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323115 2567 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323118 2567 flags.go:64] FLAG: --max-pods="110" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323121 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323124 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323127 2567 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323130 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323132 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323137 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323139 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323146 2567 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323149 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323152 2567 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 00:50:17.329643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323155 2567 flags.go:64] FLAG: --pod-cidr="" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323158 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323163 2567 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323166 2567 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323169 2567 flags.go:64] FLAG: --pods-per-core="0" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323172 2567 flags.go:64] FLAG: --port="10250" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323175 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323178 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d32de983d79f0b38" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323181 2567 flags.go:64] FLAG: --qos-reserved="" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323185 2567 flags.go:64] FLAG: --read-only-port="10255" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323188 2567 flags.go:64] FLAG: --register-node="true" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323191 2567 flags.go:64] FLAG: --register-with-taints="" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323194 2567 flags.go:64] FLAG: --registry-burst="10" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323198 2567 flags.go:64] FLAG: --registry-qps="5" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323200 2567 flags.go:64] FLAG: --reserved-cpus="" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323203 2567 flags.go:64] FLAG: --reserved-memory="" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323207 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323210 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323213 2567 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323216 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323219 2567 flags.go:64] FLAG: --runonce="false" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323222 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323225 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323228 2567 flags.go:64] FLAG: --seccomp-default="false" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323231 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 00:50:17.330280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323233 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323236 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323239 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323243 2567 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323246 2567 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323248 2567 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323251 2567 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323254 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323258 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323260 2567 flags.go:64] FLAG: --system-cgroups="" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323263 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323268 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323271 2567 flags.go:64] FLAG: --tls-cert-file="" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323274 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323278 2567 flags.go:64] FLAG: --tls-min-version="" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323281 2567 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323284 2567 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323287 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323290 2567 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323293 2567 flags.go:64] FLAG: --v="2" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323297 2567 flags.go:64] FLAG: --version="false" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323301 2567 flags.go:64] FLAG: --vmodule="" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323305 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.323308 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 00:50:17.330904 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323449 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323454 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323457 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323460 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323463 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323466 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323469 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323472 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323475 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323478 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323481 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323485 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323487 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323490 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323492 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323495 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323498 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323500 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323502 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323505 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:50:17.331500 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323507 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323510 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323512 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323515 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323519 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323521 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323524 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323526 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323528 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323531 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323534 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323537 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323539 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323542 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323545 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323547 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323549 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323552 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323554 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323557 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:50:17.331998 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323559 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323561 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323564 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323568 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323571 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323573 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323576 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323578 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323581 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323583 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323586 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323588 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323590 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323593 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323596 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323598 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323602 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323604 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323606 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323609 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:50:17.332504 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323611 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323614 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323616 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323619 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323622 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323624 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323627 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323629 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323631 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323634 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323638 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323641 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323644 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323648 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323651 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323655 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323658 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323661 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323664 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:50:17.332996 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323667 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323669 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323672 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323675 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323677 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323679 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323682 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323684 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323687 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323690 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323693 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323695 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323699 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323702 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323705 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323708 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323710 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323713 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323716 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:50:17.333511 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.323718 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:50:17.333972 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.324335 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 00:50:17.333972 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.331039 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 00:50:17.333972 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.331055 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 00:50:17.333972 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.331762 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 00:50:17.333972 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.331770 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 00:50:17.333972 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331834 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:50:17.333972 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331839 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:50:17.333972 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331843 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:50:17.333972 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331847 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:50:17.333972 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331850 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:50:17.333972 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331852 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:50:17.333972 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331855 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:50:17.333972 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331858 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:50:17.333972 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331861 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331863 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331866 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331868 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331871 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331873 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331876 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331879 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331882 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331884 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331887 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331890 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331892 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331894 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331897 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331899 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331904 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331906 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331909 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:50:17.334328 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331911 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331915 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331918 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331920 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331923 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331925 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331928 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331930 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331933 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331935 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331938 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331941 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331944 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331947 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331950 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331952 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331955 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331957 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331960 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331962 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:50:17.334805 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331965 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331969 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331972 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331975 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331978 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331981 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331983 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331986 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331988 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331991 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331994 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331997 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.331999 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332002 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332006 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332009 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332012 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332015 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332017 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:50:17.335299 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332020 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332024 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332027 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332030 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332033 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332035 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332038 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332040 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332043 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332045 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332048 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332051 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332053 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332056 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332059 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332061 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332064 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332066 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332069 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332071 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:50:17.335771 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332074 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332076 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332079 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332081 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332085 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332089 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332091 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332094 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332097 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332099 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332102 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332104 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332107 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.332112 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332225 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 00:50:17.336276 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332229 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332232 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332235 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332239 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332242 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332245 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332248 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332251 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332254 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332256 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332259 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332261 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332264 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332266 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332269 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332271 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332273 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332276 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332278 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332281 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 00:50:17.336720 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332283 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332286 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332290 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332292 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332295 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332297 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332300 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332302 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332305 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332307 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332309 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332312 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332314 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332317 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332319 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332322 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332324 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332327 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332329 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332332 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 00:50:17.337187 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332334 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332336 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332340 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332343 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332346 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332349 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332351 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332354 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332356 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332359 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332361 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332364 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332366 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332369 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332372 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332375 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332377 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332380 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332399 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 00:50:17.337693 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332402 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332405 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332408 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332410 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332413 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332416 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332418 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332421 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332423 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332425 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332428 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332430 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332433 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332435 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332438 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332441 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332443 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332445 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332448 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332450 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 00:50:17.338144 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332453 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332456 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332458 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332460 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332463 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332465 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332468 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332471 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332473 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332477 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332480 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332484 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332487 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332490 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332493 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332496 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332499 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332501 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 00:50:17.338639 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:17.332504 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 00:50:17.339110 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.332509 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 00:50:17.339110 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.332612 2567 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 00:50:17.339110 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.334548 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 00:50:17.339110 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.335255 2567 server.go:1019] "Starting client certificate rotation" Sep 10 00:50:17.339110 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.335354 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 00:50:17.339110 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.335404 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 00:50:17.339110 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.338303 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 00:50:17.342205 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.342185 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 00:50:17.356083 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.356060 2567 log.go:25] "Validated CRI v1 runtime API" Sep 10 00:50:17.360166 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.360150 2567 log.go:25] "Validated CRI v1 image API" Sep 10 00:50:17.361065 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.361048 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 00:50:17.363083 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.363058 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 00:50:17.363150 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.363127 2567 fs.go:135] Filesystem UUIDs: map[4b9ce375-0862-46d2-82db-39c714c24a50:/dev/nvme0n1p4 6fadb032-9500-427c-b6cc-df341fe4db39:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Sep 10 00:50:17.363202 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.363143 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 00:50:17.368520 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.368411 2567 manager.go:216] Machine: {Timestamp:2026-09-10 00:50:17.366839697 +0000 UTC m=+0.317241808 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3079837 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec286acfc0aa539040de3201c526bdd4 SystemUUID:ec286acf-c0aa-5390-40de-3201c526bdd4 BootID:bd4e55d0-d346-4ccf-9588-47e91968353d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fa:ce:1b:97:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fa:ce:1b:97:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:80:ef:bc:a0:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 00:50:17.368520 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.368519 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 00:50:17.368614 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.368601 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 00:50:17.371532 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.371495 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 00:50:17.371713 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.371531 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-142.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 00:50:17.372356 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.372344 2567 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 00:50:17.372429 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.372367 2567 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 00:50:17.372429 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.372378 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 00:50:17.373005 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.372993 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 00:50:17.374443 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.374430 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 00:50:17.377935 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.377920 2567 state_mem.go:36] "Initialized new in-memory state store" Sep 10 00:50:17.378074 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.378063 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 00:50:17.378131 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.378103 2567 kubelet.go:486] "Attempting to sync node with API server" Sep 10 00:50:17.378131 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.378117 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 00:50:17.378212 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.378137 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 00:50:17.378212 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.378154 2567 kubelet.go:398] "Adding apiserver pod source" Sep 10 00:50:17.378212 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.378166 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 00:50:17.378610 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.378596 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 00:50:17.378671 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.378621 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 00:50:17.380678 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.380658 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 00:50:17.382925 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.382909 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mnvzp" Sep 10 00:50:17.383977 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.383922 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 00:50:17.384060 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.383999 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 00:50:17.384284 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.384270 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 00:50:17.384358 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.384291 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 00:50:17.384358 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.384301 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 00:50:17.384358 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.384310 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 00:50:17.384358 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.384329 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 00:50:17.384358 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.384338 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 00:50:17.384903 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.384892 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 00:50:17.384960 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.384907 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 00:50:17.384960 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.384940 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 00:50:17.384960 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.384951 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 00:50:17.385105 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.384965 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 00:50:17.385105 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.384979 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 00:50:17.385696 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.385673 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 00:50:17.385696 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.385696 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 00:50:17.397176 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.389457 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-142.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 00:50:17.397271 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.397034 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 00:50:17.397271 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.397041 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 00:50:17.397271 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.397196 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mnvzp" Sep 10 00:50:17.399642 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.399623 2567 server.go:1268] "Started kubelet" Sep 10 00:50:17.399762 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.399697 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 00:50:17.399894 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.399702 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 00:50:17.400011 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.399989 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 00:50:17.400465 ip-10-0-129-142 systemd[1]: Started Kubernetes Kubelet. Sep 10 00:50:17.401424 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.401406 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 00:50:17.401916 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.401895 2567 server.go:310] "Adding debug handlers to kubelet server" Sep 10 00:50:17.404482 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.404462 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 00:50:17.405153 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.405141 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 00:50:17.405206 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.405157 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 00:50:17.405265 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.405207 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-142.ec2.internal\" not found" Sep 10 00:50:17.405652 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.404591 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-142.ec2.internal.18d3cf4f82c5bf1e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-142.ec2.internal,UID:ip-10-0-129-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-142.ec2.internal,},FirstTimestamp:2026-09-10 00:50:17.399582494 +0000 UTC m=+0.349984664,LastTimestamp:2026-09-10 00:50:17.399582494 +0000 UTC m=+0.349984664,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-142.ec2.internal,}" Sep 10 00:50:17.405744 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.405704 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 00:50:17.405794 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.405744 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 00:50:17.405794 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.405759 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 00:50:17.405913 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.405900 2567 reconstruct.go:97] "Volume reconstruction finished" Sep 10 00:50:17.405913 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.405912 2567 reconciler.go:29] "Reconciler: start to sync state" Sep 10 00:50:17.406456 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.406440 2567 factory.go:55] Registering systemd factory Sep 10 00:50:17.406456 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.406455 2567 factory.go:223] Registration of the systemd container factory successfully Sep 10 00:50:17.406681 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.406661 2567 factory.go:153] Registering CRI-O factory Sep 10 00:50:17.406681 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.406677 2567 factory.go:223] Registration of the crio container factory successfully Sep 10 00:50:17.406780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.406718 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 00:50:17.406780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.406735 2567 factory.go:103] Registering Raw factory Sep 10 00:50:17.406780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.406746 2567 manager.go:1196] Started watching for new ooms in manager Sep 10 00:50:17.407281 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.407260 2567 manager.go:349] Starting recovery of all containers Sep 10 00:50:17.415269 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.415246 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:50:17.418867 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.418849 2567 manager.go:354] Recovery completed Sep 10 00:50:17.419139 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.419121 2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-142.ec2.internal\" not found" node="ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.425222 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.425207 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:50:17.426938 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.426917 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:50:17.427012 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.426952 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:50:17.427012 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.426961 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:50:17.427558 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.427496 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 00:50:17.427558 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.427507 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 00:50:17.427558 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.427528 2567 state_mem.go:36] "Initialized new in-memory state store" Sep 10 00:50:17.427558 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.427499 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:50:17.428285 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.428271 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:50:17.428362 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.428299 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:50:17.428362 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.428311 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:50:17.428559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.428543 2567 policy_none.go:49] "None policy: Start" Sep 10 00:50:17.428559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.428561 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 00:50:17.428651 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.428571 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 00:50:17.429523 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.429512 2567 policy_none.go:47] "Start" Sep 10 00:50:17.472085 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.471991 2567 manager.go:337] "Starting Device Plugin manager" Sep 10 00:50:17.472085 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.472052 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 00:50:17.472085 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.472066 2567 server.go:87] "Starting device plugin registration server" Sep 10 00:50:17.483361 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.472445 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 00:50:17.483361 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.472457 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 00:50:17.483361 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.472541 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 00:50:17.483361 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.472622 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 00:50:17.483361 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.472640 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 00:50:17.483361 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.473263 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 00:50:17.483361 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.473334 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-142.ec2.internal\" not found" Sep 10 00:50:17.519188 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.519146 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 00:50:17.520499 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.520481 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 00:50:17.520578 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.520537 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 00:50:17.520578 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.520562 2567 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 00:50:17.520652 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.520608 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 00:50:17.522323 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.522301 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:50:17.572829 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.572705 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:50:17.573734 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.573717 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:50:17.573811 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.573747 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:50:17.573811 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.573763 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:50:17.573811 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.573785 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.579321 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.579302 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.579454 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.579326 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-142.ec2.internal\": node \"ip-10-0-129-142.ec2.internal\" not found" Sep 10 00:50:17.591613 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.591595 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-142.ec2.internal\" not found" Sep 10 00:50:17.621308 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.621274 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-142.ec2.internal"] Sep 10 00:50:17.621473 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.621402 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:50:17.622840 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.622824 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:50:17.622923 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.622854 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:50:17.622923 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.622866 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:50:17.624085 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.624071 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:50:17.624219 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.624203 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.624268 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.624235 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:50:17.624878 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.624855 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:50:17.624947 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.624884 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:50:17.624947 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.624898 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:50:17.624947 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.624900 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:50:17.624947 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.624925 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:50:17.624947 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.624935 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:50:17.625972 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.625960 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.626012 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.625983 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 00:50:17.626757 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.626736 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasSufficientMemory" Sep 10 00:50:17.626837 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.626763 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 00:50:17.626837 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.626775 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeHasSufficientPID" Sep 10 00:50:17.649112 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.649087 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-142.ec2.internal\" not found" node="ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.653381 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.653360 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-142.ec2.internal\" not found" node="ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.692673 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.692647 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-142.ec2.internal\" not found" Sep 10 00:50:17.708133 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.708100 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5096d71129735a6c1c9788d4caba0e36-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal\" (UID: \"5096d71129735a6c1c9788d4caba0e36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.708133 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.708132 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a9995c1c97ee8b5062e519ab75540ba-config\") pod \"kube-apiserver-proxy-ip-10-0-129-142.ec2.internal\" (UID: \"2a9995c1c97ee8b5062e519ab75540ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.708295 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.708150 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5096d71129735a6c1c9788d4caba0e36-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal\" (UID: \"5096d71129735a6c1c9788d4caba0e36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.793286 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.793252 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-142.ec2.internal\" not found" Sep 10 00:50:17.808630 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.808587 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5096d71129735a6c1c9788d4caba0e36-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal\" (UID: \"5096d71129735a6c1c9788d4caba0e36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.808709 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.808642 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5096d71129735a6c1c9788d4caba0e36-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal\" (UID: \"5096d71129735a6c1c9788d4caba0e36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.808709 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.808661 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a9995c1c97ee8b5062e519ab75540ba-config\") pod \"kube-apiserver-proxy-ip-10-0-129-142.ec2.internal\" (UID: \"2a9995c1c97ee8b5062e519ab75540ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.808709 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.808697 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a9995c1c97ee8b5062e519ab75540ba-config\") pod \"kube-apiserver-proxy-ip-10-0-129-142.ec2.internal\" (UID: \"2a9995c1c97ee8b5062e519ab75540ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.808815 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.808693 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5096d71129735a6c1c9788d4caba0e36-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal\" (UID: \"5096d71129735a6c1c9788d4caba0e36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.808815 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.808752 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5096d71129735a6c1c9788d4caba0e36-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal\" (UID: \"5096d71129735a6c1c9788d4caba0e36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.894079 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.894012 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-142.ec2.internal\" not found" Sep 10 00:50:17.951489 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.951465 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.956525 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:17.956508 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-142.ec2.internal" Sep 10 00:50:17.995033 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:17.995000 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-142.ec2.internal\" not found" Sep 10 00:50:18.095551 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:18.095505 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-142.ec2.internal\" not found" Sep 10 00:50:18.196147 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:18.196068 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-142.ec2.internal\" not found" Sep 10 00:50:18.296591 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:18.296555 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-142.ec2.internal\" not found" Sep 10 00:50:18.335076 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:18.335040 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 00:50:18.335510 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:18.335200 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 00:50:18.335510 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:18.335240 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 00:50:18.397575 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:18.397536 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-142.ec2.internal\" not found" Sep 10 00:50:18.401006 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:18.400980 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 00:45:17 +0000 UTC" deadline="2028-06-26 13:25:35.24395323 +0000 UTC" Sep 10 00:50:18.401088 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:18.401006 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15732h35m16.842950411s" Sep 10 00:50:18.497876 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:18.497847 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-142.ec2.internal\" not found" Sep 10 00:50:18.598990 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:18.598962 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-142.ec2.internal\" not found" Sep 10 00:50:18.611405 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:18.611359 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5096d71129735a6c1c9788d4caba0e36.slice/crio-10dd2397ea3ec8c3f5bf5a91767ca005a8fb091a6a0452d4b9d68d8c61a6db34 WatchSource:0}: Error finding container 10dd2397ea3ec8c3f5bf5a91767ca005a8fb091a6a0452d4b9d68d8c61a6db34: Status 404 returned error can't find the container with id 10dd2397ea3ec8c3f5bf5a91767ca005a8fb091a6a0452d4b9d68d8c61a6db34 Sep 10 00:50:18.611629 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:18.611608 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a9995c1c97ee8b5062e519ab75540ba.slice/crio-bf95800b3ac6f7a3fc90dbc3b5b4f71e5e3683a5ab387b75292cc6e8b54bce8d WatchSource:0}: Error finding container bf95800b3ac6f7a3fc90dbc3b5b4f71e5e3683a5ab387b75292cc6e8b54bce8d: Status 404 returned error can't find the container with id bf95800b3ac6f7a3fc90dbc3b5b4f71e5e3683a5ab387b75292cc6e8b54bce8d Sep 10 00:50:18.615804 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:18.615779 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 00:50:18.677903 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:18.677870 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:50:18.705453 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:18.705432 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal" Sep 10 00:50:18.717920 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:18.717901 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 00:50:18.719931 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:18.719917 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-142.ec2.internal" Sep 10 00:50:18.729229 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:18.729206 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 00:50:18.981168 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:18.981141 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:50:19.197446 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.197337 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:50:19.378664 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.378569 2567 apiserver.go:52] "Watching apiserver" Sep 10 00:50:19.389984 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.389940 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 00:50:19.390599 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.390564 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-j8t49","kube-system/konnectivity-agent-r4r6n","kube-system/kube-apiserver-proxy-ip-10-0-129-142.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9","openshift-cluster-node-tuning-operator/tuned-7p45b","openshift-dns/node-resolver-bjdbl","openshift-image-registry/node-ca-pwbgq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal","openshift-multus/multus-additional-cni-plugins-wl9j4","openshift-multus/multus-gm7fp","openshift-multus/network-metrics-daemon-bf2vw","openshift-network-diagnostics/network-check-target-mvqfv","openshift-network-operator/iptables-alerter-zlt9j","openshift-ovn-kubernetes/ovnkube-node-lh25b"] Sep 10 00:50:19.392355 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.392327 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pwbgq" Sep 10 00:50:19.394097 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.394073 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zlt9j" Sep 10 00:50:19.395489 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.395159 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.395489 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.395238 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fv4tk\"" Sep 10 00:50:19.395489 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.395379 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 00:50:19.396048 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.396030 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 00:50:19.396147 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.396034 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 00:50:19.396831 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.396544 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.396831 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.396806 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:50:19.397062 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.397045 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 00:50:19.397132 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.397121 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-88wmw\"" Sep 10 00:50:19.397964 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.397589 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 00:50:19.397964 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.397854 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 00:50:19.398129 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.398064 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.399315 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.398764 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 00:50:19.399315 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.398828 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 00:50:19.399315 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.398855 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 00:50:19.399315 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.399088 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bjdbl" Sep 10 00:50:19.400486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.400321 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 00:50:19.400486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.400434 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 00:50:19.400698 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.400604 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 00:50:19.400858 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.400699 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l7rtj\"" Sep 10 00:50:19.400959 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.400928 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 00:50:19.401013 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.400988 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 00:50:19.401013 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.400929 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:50:19.401124 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.401110 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q7qsm\"" Sep 10 00:50:19.401278 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.401265 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 00:50:19.401319 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.401290 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g7x29\"" Sep 10 00:50:19.401382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.401350 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.401917 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.401876 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:19.401988 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:19.401936 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:19.402149 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.402135 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 00:50:19.402190 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.402155 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 00:50:19.402290 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.402270 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ft7rp\"" Sep 10 00:50:19.402833 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.402812 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r4r6n" Sep 10 00:50:19.404603 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.404577 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 00:50:19.404699 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.404675 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zdqf5\"" Sep 10 00:50:19.404943 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.404920 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 00:50:19.405077 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.404990 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 00:50:19.405169 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.405150 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 00:50:19.405371 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.405356 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.405424 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.405369 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 00:50:19.405858 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.405838 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:19.405937 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:19.405912 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:19.406584 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.406555 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rwhjs\"" Sep 10 00:50:19.406734 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.406557 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 00:50:19.406803 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.406741 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 00:50:19.407090 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.407069 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 00:50:19.407182 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.407156 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:19.407250 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:19.407215 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:19.408291 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.408271 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4755t\"" Sep 10 00:50:19.408526 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.408505 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419480 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-cnibin\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419589 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-systemd\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419652 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b60eed6-1260-4550-b2ff-b2c56076c290-dbus\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419670 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-sys-fs\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419689 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv6vr\" (UniqueName: \"kubernetes.io/projected/c6eca841-6472-4081-99af-183ba91640ec-kube-api-access-jv6vr\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419769 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-run-netns\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419786 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-run-k8s-cni-cncf-io\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419801 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-var-lib-cni-bin\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419817 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-system-cni-dir\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419834 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-cnibin\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419855 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-systemd-units\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419870 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-run-ovn\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419913 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-multus-conf-dir\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419954 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqswv\" (UniqueName: \"kubernetes.io/projected/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-kube-api-access-sqswv\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.419986 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28805ef6-3374-455b-8c2b-4ead9c24733d-iptables-alerter-script\") pod \"iptables-alerter-zlt9j\" (UID: \"28805ef6-3374-455b-8c2b-4ead9c24733d\") " pod="openshift-network-operator/iptables-alerter-zlt9j" Sep 10 00:50:19.419513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420017 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-lib-modules\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-var-lib-kubelet\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420076 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c6eca841-6472-4081-99af-183ba91640ec-env-overrides\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420163 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-kubelet\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420196 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-cni-netd\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420237 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c6eca841-6472-4081-99af-183ba91640ec-ovnkube-config\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420266 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-run-netns\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420305 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs\") pod \"network-metrics-daemon-bf2vw\" (UID: \"94aee17f-23d4-41f3-8b56-2d42b7c23fb0\") " pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420331 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-device-dir\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420355 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-log-socket\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420378 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-system-cni-dir\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420433 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-etc-kubernetes\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420476 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e00484bd-e5bd-440b-90c9-e7644bba6602-serviceca\") pod \"node-ca-pwbgq\" (UID: \"e00484bd-e5bd-440b-90c9-e7644bba6602\") " pod="openshift-image-registry/node-ca-pwbgq" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420504 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420538 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-host\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.421364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420562 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh4zd\" (UniqueName: \"kubernetes.io/projected/160d0953-51cb-4633-818b-329f8e30677a-kube-api-access-fh4zd\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420586 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b60eed6-1260-4550-b2ff-b2c56076c290-kubelet-config\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420611 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420656 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-run-systemd\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420680 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-node-log\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420714 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e00484bd-e5bd-440b-90c9-e7644bba6602-host\") pod \"node-ca-pwbgq\" (UID: \"e00484bd-e5bd-440b-90c9-e7644bba6602\") " pod="openshift-image-registry/node-ca-pwbgq" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420741 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8xlj\" (UniqueName: \"kubernetes.io/projected/e00484bd-e5bd-440b-90c9-e7644bba6602-kube-api-access-d8xlj\") pod \"node-ca-pwbgq\" (UID: \"e00484bd-e5bd-440b-90c9-e7644bba6602\") " pod="openshift-image-registry/node-ca-pwbgq" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420766 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-run\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420788 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-sys\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420814 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-slash\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420903 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-run-openvswitch\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420936 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6eca841-6472-4081-99af-183ba91640ec-ovn-node-metrics-cert\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420963 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-multus-cni-dir\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.420988 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-etc-selinux\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421012 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-modprobe-d\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.422238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421042 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-sysconfig\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421071 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d-konnectivity-ca\") pod \"konnectivity-agent-r4r6n\" (UID: \"b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d\") " pod="kube-system/konnectivity-agent-r4r6n" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421097 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-var-lib-cni-multus\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-registration-dir\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-sysctl-d\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421174 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421200 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421291 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-cni-bin\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421320 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-cni-binary-copy\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421346 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-multus-socket-dir-parent\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421370 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-var-lib-kubelet\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421395 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-multus-daemon-config\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421420 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwlnv\" (UniqueName: \"kubernetes.io/projected/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-kube-api-access-xwlnv\") pod \"network-metrics-daemon-bf2vw\" (UID: \"94aee17f-23d4-41f3-8b56-2d42b7c23fb0\") " pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421446 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/160d0953-51cb-4633-818b-329f8e30677a-tmp\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421495 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tnfn\" (UniqueName: \"kubernetes.io/projected/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-kube-api-access-8tnfn\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421521 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-var-lib-openvswitch\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.423001 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421546 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-etc-openvswitch\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421571 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-hostroot\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421594 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-run-multus-certs\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421626 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-kubernetes\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421654 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-sysctl-conf\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421369 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/160d0953-51cb-4633-818b-329f8e30677a-etc-tuned\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1152275-6e69-42b2-822d-45e0ecc53df8-tmp-dir\") pod \"node-resolver-bjdbl\" (UID: \"d1152275-6e69-42b2-822d-45e0ecc53df8\") " pod="openshift-dns/node-resolver-bjdbl" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421750 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9zkx\" (UniqueName: \"kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx\") pod \"network-check-target-mvqfv\" (UID: \"b68cbf13-c4cc-463e-b9bb-f184673d2bff\") " pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421796 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-socket-dir\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt2bl\" (UniqueName: \"kubernetes.io/projected/a476af72-c508-4a9e-a8f4-553dcedd7542-kube-api-access-vt2bl\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n96pb\" (UniqueName: \"kubernetes.io/projected/28805ef6-3374-455b-8c2b-4ead9c24733d-kube-api-access-n96pb\") pod \"iptables-alerter-zlt9j\" (UID: \"28805ef6-3374-455b-8c2b-4ead9c24733d\") " pod="openshift-network-operator/iptables-alerter-zlt9j" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421904 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c6eca841-6472-4081-99af-183ba91640ec-ovnkube-script-lib\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421928 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d-agent-certs\") pod \"konnectivity-agent-r4r6n\" (UID: \"b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d\") " pod="kube-system/konnectivity-agent-r4r6n" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421954 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1152275-6e69-42b2-822d-45e0ecc53df8-hosts-file\") pod \"node-resolver-bjdbl\" (UID: \"d1152275-6e69-42b2-822d-45e0ecc53df8\") " pod="openshift-dns/node-resolver-bjdbl" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.421979 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvg7j\" (UniqueName: \"kubernetes.io/projected/d1152275-6e69-42b2-822d-45e0ecc53df8-kube-api-access-mvg7j\") pod \"node-resolver-bjdbl\" (UID: \"d1152275-6e69-42b2-822d-45e0ecc53df8\") " pod="openshift-dns/node-resolver-bjdbl" Sep 10 00:50:19.423820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.422018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:19.424732 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.422051 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28805ef6-3374-455b-8c2b-4ead9c24733d-host-slash\") pod \"iptables-alerter-zlt9j\" (UID: \"28805ef6-3374-455b-8c2b-4ead9c24733d\") " pod="openshift-network-operator/iptables-alerter-zlt9j" Sep 10 00:50:19.440548 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.440515 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wdrgl" Sep 10 00:50:19.448967 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.448530 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wdrgl" Sep 10 00:50:19.507508 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.507480 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 00:50:19.523648 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523612 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-cni-bin\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.523648 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523650 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-cni-binary-copy\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.523902 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523679 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-multus-socket-dir-parent\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.523902 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523705 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-var-lib-kubelet\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.523902 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523728 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-cni-bin\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.523902 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523730 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-multus-daemon-config\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.523902 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523782 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwlnv\" (UniqueName: \"kubernetes.io/projected/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-kube-api-access-xwlnv\") pod \"network-metrics-daemon-bf2vw\" (UID: \"94aee17f-23d4-41f3-8b56-2d42b7c23fb0\") " pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:19.523902 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/160d0953-51cb-4633-818b-329f8e30677a-tmp\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.523902 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523833 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tnfn\" (UniqueName: \"kubernetes.io/projected/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-kube-api-access-8tnfn\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.523902 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523858 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-var-lib-openvswitch\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.523902 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523879 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-etc-openvswitch\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.523902 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-hostroot\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523922 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-run-multus-certs\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523939 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-kubernetes\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523957 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-sysctl-conf\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523978 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/160d0953-51cb-4633-818b-329f8e30677a-etc-tuned\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.523993 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1152275-6e69-42b2-822d-45e0ecc53df8-tmp-dir\") pod \"node-resolver-bjdbl\" (UID: \"d1152275-6e69-42b2-822d-45e0ecc53df8\") " pod="openshift-dns/node-resolver-bjdbl" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524010 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9zkx\" (UniqueName: \"kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx\") pod \"network-check-target-mvqfv\" (UID: \"b68cbf13-c4cc-463e-b9bb-f184673d2bff\") " pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-socket-dir\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524041 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt2bl\" (UniqueName: \"kubernetes.io/projected/a476af72-c508-4a9e-a8f4-553dcedd7542-kube-api-access-vt2bl\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524056 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n96pb\" (UniqueName: \"kubernetes.io/projected/28805ef6-3374-455b-8c2b-4ead9c24733d-kube-api-access-n96pb\") pod \"iptables-alerter-zlt9j\" (UID: \"28805ef6-3374-455b-8c2b-4ead9c24733d\") " pod="openshift-network-operator/iptables-alerter-zlt9j" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524074 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524094 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c6eca841-6472-4081-99af-183ba91640ec-ovnkube-script-lib\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524110 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d-agent-certs\") pod \"konnectivity-agent-r4r6n\" (UID: \"b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d\") " pod="kube-system/konnectivity-agent-r4r6n" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524125 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1152275-6e69-42b2-822d-45e0ecc53df8-hosts-file\") pod \"node-resolver-bjdbl\" (UID: \"d1152275-6e69-42b2-822d-45e0ecc53df8\") " pod="openshift-dns/node-resolver-bjdbl" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524141 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvg7j\" (UniqueName: \"kubernetes.io/projected/d1152275-6e69-42b2-822d-45e0ecc53df8-kube-api-access-mvg7j\") pod \"node-resolver-bjdbl\" (UID: \"d1152275-6e69-42b2-822d-45e0ecc53df8\") " pod="openshift-dns/node-resolver-bjdbl" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524159 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524174 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28805ef6-3374-455b-8c2b-4ead9c24733d-host-slash\") pod \"iptables-alerter-zlt9j\" (UID: \"28805ef6-3374-455b-8c2b-4ead9c24733d\") " pod="openshift-network-operator/iptables-alerter-zlt9j" Sep 10 00:50:19.524263 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524190 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-cnibin\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.525138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524206 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-systemd\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.525138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b60eed6-1260-4550-b2ff-b2c56076c290-dbus\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:19.525138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524476 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-sys-fs\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.525138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524489 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-systemd\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.525138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524506 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv6vr\" (UniqueName: \"kubernetes.io/projected/c6eca841-6472-4081-99af-183ba91640ec-kube-api-access-jv6vr\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.525138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524239 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-kubernetes\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.525138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524594 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-sys-fs\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.525138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524740 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-sysctl-conf\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.525138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524740 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-socket-dir\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.525138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524821 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-hostroot\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.525138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.524974 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-multus-daemon-config\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.525138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525056 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1152275-6e69-42b2-822d-45e0ecc53df8-hosts-file\") pod \"node-resolver-bjdbl\" (UID: \"d1152275-6e69-42b2-822d-45e0ecc53df8\") " pod="openshift-dns/node-resolver-bjdbl" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525202 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28805ef6-3374-455b-8c2b-4ead9c24733d-host-slash\") pod \"iptables-alerter-zlt9j\" (UID: \"28805ef6-3374-455b-8c2b-4ead9c24733d\") " pod="openshift-network-operator/iptables-alerter-zlt9j" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525212 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525337 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-multus-socket-dir-parent\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525347 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-cnibin\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525394 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-run-netns\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525423 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-run-k8s-cni-cncf-io\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525408 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525454 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-var-lib-cni-bin\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525509 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-system-cni-dir\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525599 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-cnibin\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-systemd-units\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525656 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-run-ovn\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-multus-conf-dir\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqswv\" (UniqueName: \"kubernetes.io/projected/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-kube-api-access-sqswv\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525738 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28805ef6-3374-455b-8c2b-4ead9c24733d-iptables-alerter-script\") pod \"iptables-alerter-zlt9j\" (UID: \"28805ef6-3374-455b-8c2b-4ead9c24733d\") " pod="openshift-network-operator/iptables-alerter-zlt9j" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525747 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-cni-binary-copy\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.525780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525771 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-lib-modules\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525797 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-var-lib-kubelet\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525820 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c6eca841-6472-4081-99af-183ba91640ec-ovnkube-script-lib\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525829 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-var-lib-openvswitch\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525829 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525877 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c6eca841-6472-4081-99af-183ba91640ec-env-overrides\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:19.525913 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525940 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-var-lib-kubelet\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:19.525989 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret podName:0b60eed6-1260-4550-b2ff-b2c56076c290 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:20.025966889 +0000 UTC m=+2.976368992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret") pod "global-pull-secret-syncer-j8t49" (UID: "0b60eed6-1260-4550-b2ff-b2c56076c290") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525992 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-var-lib-kubelet\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.525989 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-multus-conf-dir\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526025 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-system-cni-dir\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526056 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-etc-openvswitch\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526069 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-run-netns\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526102 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-run-k8s-cni-cncf-io\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526106 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-cnibin\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526141 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-var-lib-cni-bin\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.526641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526176 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-systemd-units\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526187 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-run-multus-certs\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526250 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b60eed6-1260-4550-b2ff-b2c56076c290-dbus\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526317 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1152275-6e69-42b2-822d-45e0ecc53df8-tmp-dir\") pod \"node-resolver-bjdbl\" (UID: \"d1152275-6e69-42b2-822d-45e0ecc53df8\") " pod="openshift-dns/node-resolver-bjdbl" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526348 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-lib-modules\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526510 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526689 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c6eca841-6472-4081-99af-183ba91640ec-env-overrides\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526704 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-run-ovn\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526749 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-kubelet\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526806 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-cni-netd\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526828 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-cni-netd\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526884 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c6eca841-6472-4081-99af-183ba91640ec-ovnkube-config\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526887 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-kubelet\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.526933 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-run-netns\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527040 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs\") pod \"network-metrics-daemon-bf2vw\" (UID: \"94aee17f-23d4-41f3-8b56-2d42b7c23fb0\") " pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527085 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-device-dir\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-log-socket\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527177 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-system-cni-dir\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.527595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527208 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-etc-kubernetes\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527235 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e00484bd-e5bd-440b-90c9-e7644bba6602-serviceca\") pod \"node-ca-pwbgq\" (UID: \"e00484bd-e5bd-440b-90c9-e7644bba6602\") " pod="openshift-image-registry/node-ca-pwbgq" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527302 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527331 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-host\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527360 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh4zd\" (UniqueName: \"kubernetes.io/projected/160d0953-51cb-4633-818b-329f8e30677a-kube-api-access-fh4zd\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527378 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28805ef6-3374-455b-8c2b-4ead9c24733d-iptables-alerter-script\") pod \"iptables-alerter-zlt9j\" (UID: \"28805ef6-3374-455b-8c2b-4ead9c24733d\") " pod="openshift-network-operator/iptables-alerter-zlt9j" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527419 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-run-netns\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527458 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c6eca841-6472-4081-99af-183ba91640ec-ovnkube-config\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527467 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-etc-kubernetes\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527476 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-log-socket\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527532 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-host\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:19.527545 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527386 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b60eed6-1260-4550-b2ff-b2c56076c290-kubelet-config\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527596 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b60eed6-1260-4550-b2ff-b2c56076c290-kubelet-config\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:19.527604 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs podName:94aee17f-23d4-41f3-8b56-2d42b7c23fb0 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:20.027587176 +0000 UTC m=+2.977989277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs") pod "network-metrics-daemon-bf2vw" (UID: "94aee17f-23d4-41f3-8b56-2d42b7c23fb0") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527601 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-device-dir\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527641 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-system-cni-dir\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.528486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527682 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527691 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527720 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-run-systemd\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527737 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-node-log\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e00484bd-e5bd-440b-90c9-e7644bba6602-host\") pod \"node-ca-pwbgq\" (UID: \"e00484bd-e5bd-440b-90c9-e7644bba6602\") " pod="openshift-image-registry/node-ca-pwbgq" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527780 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8xlj\" (UniqueName: \"kubernetes.io/projected/e00484bd-e5bd-440b-90c9-e7644bba6602-kube-api-access-d8xlj\") pod \"node-ca-pwbgq\" (UID: \"e00484bd-e5bd-440b-90c9-e7644bba6602\") " pod="openshift-image-registry/node-ca-pwbgq" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527795 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e00484bd-e5bd-440b-90c9-e7644bba6602-serviceca\") pod \"node-ca-pwbgq\" (UID: \"e00484bd-e5bd-440b-90c9-e7644bba6602\") " pod="openshift-image-registry/node-ca-pwbgq" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527805 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-run\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527858 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-run-systemd\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527903 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-sys\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527923 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-run\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527933 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527969 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-sys\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527969 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-slash\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528015 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e00484bd-e5bd-440b-90c9-e7644bba6602-host\") pod \"node-ca-pwbgq\" (UID: \"e00484bd-e5bd-440b-90c9-e7644bba6602\") " pod="openshift-image-registry/node-ca-pwbgq" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528023 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-run-openvswitch\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.527976 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528055 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-node-log\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.529382 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528061 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-run-openvswitch\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528092 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6eca841-6472-4081-99af-183ba91640ec-ovn-node-metrics-cert\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528107 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6eca841-6472-4081-99af-183ba91640ec-host-slash\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528147 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-multus-cni-dir\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528182 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-etc-selinux\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-modprobe-d\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528240 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-sysconfig\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528242 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-multus-cni-dir\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528308 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-modprobe-d\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528332 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-etc-selinux\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528388 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-sysconfig\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d-konnectivity-ca\") pod \"konnectivity-agent-r4r6n\" (UID: \"b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d\") " pod="kube-system/konnectivity-agent-r4r6n" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528474 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528497 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-var-lib-cni-multus\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528621 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-host-var-lib-cni-multus\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-registration-dir\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528694 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-sysctl-d\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.531838 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528722 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.532749 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.532749 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.528994 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d-konnectivity-ca\") pod \"konnectivity-agent-r4r6n\" (UID: \"b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d\") " pod="kube-system/konnectivity-agent-r4r6n" Sep 10 00:50:19.532749 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.529179 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a476af72-c508-4a9e-a8f4-553dcedd7542-registration-dir\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.532749 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.529227 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.532749 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.529336 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/160d0953-51cb-4633-818b-329f8e30677a-etc-sysctl-d\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.532749 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.529347 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.532749 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.531438 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6eca841-6472-4081-99af-183ba91640ec-ovn-node-metrics-cert\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.532749 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.531508 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal" event={"ID":"5096d71129735a6c1c9788d4caba0e36","Type":"ContainerStarted","Data":"10dd2397ea3ec8c3f5bf5a91767ca005a8fb091a6a0452d4b9d68d8c61a6db34"} Sep 10 00:50:19.533338 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.533314 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/160d0953-51cb-4633-818b-329f8e30677a-tmp\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.534560 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.533614 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d-agent-certs\") pod \"konnectivity-agent-r4r6n\" (UID: \"b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d\") " pod="kube-system/konnectivity-agent-r4r6n" Sep 10 00:50:19.534667 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.534632 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/160d0953-51cb-4633-818b-329f8e30677a-etc-tuned\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.535898 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:19.535708 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:50:19.535898 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:19.535743 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:50:19.535898 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:19.535759 2567 projected.go:196] Error preparing data for projected volume kube-api-access-d9zkx for pod openshift-network-diagnostics/network-check-target-mvqfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:19.535898 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:19.535832 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx podName:b68cbf13-c4cc-463e-b9bb-f184673d2bff nodeName:}" failed. No retries permitted until 2026-09-10 00:50:20.035812708 +0000 UTC m=+2.986214833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d9zkx" (UniqueName: "kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx") pod "network-check-target-mvqfv" (UID: "b68cbf13-c4cc-463e-b9bb-f184673d2bff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:19.539728 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.539100 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n96pb\" (UniqueName: \"kubernetes.io/projected/28805ef6-3374-455b-8c2b-4ead9c24733d-kube-api-access-n96pb\") pod \"iptables-alerter-zlt9j\" (UID: \"28805ef6-3374-455b-8c2b-4ead9c24733d\") " pod="openshift-network-operator/iptables-alerter-zlt9j" Sep 10 00:50:19.541041 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.540907 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-142.ec2.internal" event={"ID":"2a9995c1c97ee8b5062e519ab75540ba","Type":"ContainerStarted","Data":"bf95800b3ac6f7a3fc90dbc3b5b4f71e5e3683a5ab387b75292cc6e8b54bce8d"} Sep 10 00:50:19.541140 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.541015 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8xlj\" (UniqueName: \"kubernetes.io/projected/e00484bd-e5bd-440b-90c9-e7644bba6602-kube-api-access-d8xlj\") pod \"node-ca-pwbgq\" (UID: \"e00484bd-e5bd-440b-90c9-e7644bba6602\") " pod="openshift-image-registry/node-ca-pwbgq" Sep 10 00:50:19.542126 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.542071 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwlnv\" (UniqueName: \"kubernetes.io/projected/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-kube-api-access-xwlnv\") pod \"network-metrics-daemon-bf2vw\" (UID: \"94aee17f-23d4-41f3-8b56-2d42b7c23fb0\") " pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:19.543282 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.543171 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tnfn\" (UniqueName: \"kubernetes.io/projected/a9c8c435-a9c3-48e8-86a9-0671d814c4fa-kube-api-access-8tnfn\") pod \"multus-additional-cni-plugins-wl9j4\" (UID: \"a9c8c435-a9c3-48e8-86a9-0671d814c4fa\") " pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.543282 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.543230 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt2bl\" (UniqueName: \"kubernetes.io/projected/a476af72-c508-4a9e-a8f4-553dcedd7542-kube-api-access-vt2bl\") pod \"aws-ebs-csi-driver-node-jjml9\" (UID: \"a476af72-c508-4a9e-a8f4-553dcedd7542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.543744 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.543715 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqswv\" (UniqueName: \"kubernetes.io/projected/e8fc08e6-f72d-4bdb-bd82-f94d878a07c8-kube-api-access-sqswv\") pod \"multus-gm7fp\" (UID: \"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8\") " pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.544115 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.544096 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh4zd\" (UniqueName: \"kubernetes.io/projected/160d0953-51cb-4633-818b-329f8e30677a-kube-api-access-fh4zd\") pod \"tuned-7p45b\" (UID: \"160d0953-51cb-4633-818b-329f8e30677a\") " pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.545711 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.545687 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvg7j\" (UniqueName: \"kubernetes.io/projected/d1152275-6e69-42b2-822d-45e0ecc53df8-kube-api-access-mvg7j\") pod \"node-resolver-bjdbl\" (UID: \"d1152275-6e69-42b2-822d-45e0ecc53df8\") " pod="openshift-dns/node-resolver-bjdbl" Sep 10 00:50:19.548174 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.548146 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv6vr\" (UniqueName: \"kubernetes.io/projected/c6eca841-6472-4081-99af-183ba91640ec-kube-api-access-jv6vr\") pod \"ovnkube-node-lh25b\" (UID: \"c6eca841-6472-4081-99af-183ba91640ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.705638 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.705315 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pwbgq" Sep 10 00:50:19.718090 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.718051 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zlt9j" Sep 10 00:50:19.730373 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.730342 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:19.736351 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.736323 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" Sep 10 00:50:19.746399 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.746350 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7p45b" Sep 10 00:50:19.756181 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.756153 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bjdbl" Sep 10 00:50:19.763276 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.763243 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wl9j4" Sep 10 00:50:19.780406 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.780352 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r4r6n" Sep 10 00:50:19.787544 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.787510 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gm7fp" Sep 10 00:50:19.790849 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:19.790828 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 00:50:20.032227 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:20.032145 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:20.032227 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:20.032198 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs\") pod \"network-metrics-daemon-bf2vw\" (UID: \"94aee17f-23d4-41f3-8b56-2d42b7c23fb0\") " pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:20.032457 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:20.032317 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:20.032457 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:20.032317 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:20.032457 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:20.032389 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs podName:94aee17f-23d4-41f3-8b56-2d42b7c23fb0 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:21.032369436 +0000 UTC m=+3.982771536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs") pod "network-metrics-daemon-bf2vw" (UID: "94aee17f-23d4-41f3-8b56-2d42b7c23fb0") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:20.032457 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:20.032408 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret podName:0b60eed6-1260-4550-b2ff-b2c56076c290 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:21.03239875 +0000 UTC m=+3.982800854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret") pod "global-pull-secret-syncer-j8t49" (UID: "0b60eed6-1260-4550-b2ff-b2c56076c290") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:20.132999 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:20.132957 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9zkx\" (UniqueName: \"kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx\") pod \"network-check-target-mvqfv\" (UID: \"b68cbf13-c4cc-463e-b9bb-f184673d2bff\") " pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:20.133206 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:20.133157 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:50:20.133206 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:20.133184 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:50:20.133206 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:20.133196 2567 projected.go:196] Error preparing data for projected volume kube-api-access-d9zkx for pod openshift-network-diagnostics/network-check-target-mvqfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:20.133371 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:20.133281 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx podName:b68cbf13-c4cc-463e-b9bb-f184673d2bff nodeName:}" failed. No retries permitted until 2026-09-10 00:50:21.133258919 +0000 UTC m=+4.083661036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9zkx" (UniqueName: "kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx") pod "network-check-target-mvqfv" (UID: "b68cbf13-c4cc-463e-b9bb-f184673d2bff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:20.451432 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:20.451316 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 00:45:19 +0000 UTC" deadline="2028-06-18 03:39:10.041838174 +0000 UTC" Sep 10 00:50:20.451432 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:20.451349 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15530h48m49.590492765s" Sep 10 00:50:20.521073 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:20.521035 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:20.521245 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:20.521083 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:20.521245 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:20.521170 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:20.521384 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:20.521314 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:20.765198 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:20.765169 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28805ef6_3374_455b_8c2b_4ead9c24733d.slice/crio-0cb681dff378950f747dd89c9e26d0ab900839c692cdc49b493f29131b5d7e2d WatchSource:0}: Error finding container 0cb681dff378950f747dd89c9e26d0ab900839c692cdc49b493f29131b5d7e2d: Status 404 returned error can't find the container with id 0cb681dff378950f747dd89c9e26d0ab900839c692cdc49b493f29131b5d7e2d Sep 10 00:50:20.769006 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:20.768139 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8fc08e6_f72d_4bdb_bd82_f94d878a07c8.slice/crio-7671930f1be234d9482a16fec5ef3151c208a3f5a715402e7baf2b52064f6ef5 WatchSource:0}: Error finding container 7671930f1be234d9482a16fec5ef3151c208a3f5a715402e7baf2b52064f6ef5: Status 404 returned error can't find the container with id 7671930f1be234d9482a16fec5ef3151c208a3f5a715402e7baf2b52064f6ef5 Sep 10 00:50:20.769006 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:20.768896 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5992aa1_3bf0_435c_b9e0_a9fb16d6c16d.slice/crio-20b946e9874fb2c12de1560030861a88ab06d52174f351085e4439cc0071f302 WatchSource:0}: Error finding container 20b946e9874fb2c12de1560030861a88ab06d52174f351085e4439cc0071f302: Status 404 returned error can't find the container with id 20b946e9874fb2c12de1560030861a88ab06d52174f351085e4439cc0071f302 Sep 10 00:50:20.769790 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:20.769728 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c8c435_a9c3_48e8_86a9_0671d814c4fa.slice/crio-dd50aa9638aeaaae68c50b1d5cb75da52ee3ef3786c6eca1185ece443e55f7d6 WatchSource:0}: Error finding container dd50aa9638aeaaae68c50b1d5cb75da52ee3ef3786c6eca1185ece443e55f7d6: Status 404 returned error can't find the container with id dd50aa9638aeaaae68c50b1d5cb75da52ee3ef3786c6eca1185ece443e55f7d6 Sep 10 00:50:20.774126 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:20.774103 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode00484bd_e5bd_440b_90c9_e7644bba6602.slice/crio-b3e8ef314743460f96a875b30887a4efd84e94a88c7832600524265f2bbb5381 WatchSource:0}: Error finding container b3e8ef314743460f96a875b30887a4efd84e94a88c7832600524265f2bbb5381: Status 404 returned error can't find the container with id b3e8ef314743460f96a875b30887a4efd84e94a88c7832600524265f2bbb5381 Sep 10 00:50:20.774879 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:20.774842 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda476af72_c508_4a9e_a8f4_553dcedd7542.slice/crio-a08606f6180302666a059994ce34087f97a81b769f1f5bac62a1b3d920b98d81 WatchSource:0}: Error finding container a08606f6180302666a059994ce34087f97a81b769f1f5bac62a1b3d920b98d81: Status 404 returned error can't find the container with id a08606f6180302666a059994ce34087f97a81b769f1f5bac62a1b3d920b98d81 Sep 10 00:50:20.775861 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:20.775819 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160d0953_51cb_4633_818b_329f8e30677a.slice/crio-1684d39428c74e6b77ed177a4e2cc2c64cd02c9a40337d46e5f60fa690085aae WatchSource:0}: Error finding container 1684d39428c74e6b77ed177a4e2cc2c64cd02c9a40337d46e5f60fa690085aae: Status 404 returned error can't find the container with id 1684d39428c74e6b77ed177a4e2cc2c64cd02c9a40337d46e5f60fa690085aae Sep 10 00:50:21.040325 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.040296 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs\") pod \"network-metrics-daemon-bf2vw\" (UID: \"94aee17f-23d4-41f3-8b56-2d42b7c23fb0\") " pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:21.040479 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.040389 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:21.040542 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:21.040512 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:21.040542 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:21.040525 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:21.040660 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:21.040593 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs podName:94aee17f-23d4-41f3-8b56-2d42b7c23fb0 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:23.040570139 +0000 UTC m=+5.990972246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs") pod "network-metrics-daemon-bf2vw" (UID: "94aee17f-23d4-41f3-8b56-2d42b7c23fb0") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:21.040660 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:21.040613 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret podName:0b60eed6-1260-4550-b2ff-b2c56076c290 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:23.040603475 +0000 UTC m=+5.991005582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret") pod "global-pull-secret-syncer-j8t49" (UID: "0b60eed6-1260-4550-b2ff-b2c56076c290") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:21.141682 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.141640 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9zkx\" (UniqueName: \"kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx\") pod \"network-check-target-mvqfv\" (UID: \"b68cbf13-c4cc-463e-b9bb-f184673d2bff\") " pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:21.141881 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:21.141786 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:50:21.141881 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:21.141802 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:50:21.141881 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:21.141814 2567 projected.go:196] Error preparing data for projected volume kube-api-access-d9zkx for pod openshift-network-diagnostics/network-check-target-mvqfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:21.142009 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:21.141880 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx podName:b68cbf13-c4cc-463e-b9bb-f184673d2bff nodeName:}" failed. No retries permitted until 2026-09-10 00:50:23.141857339 +0000 UTC m=+6.092259440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9zkx" (UniqueName: "kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx") pod "network-check-target-mvqfv" (UID: "b68cbf13-c4cc-463e-b9bb-f184673d2bff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:21.451583 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.451451 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 00:45:19 +0000 UTC" deadline="2028-04-01 00:13:31.460551494 +0000 UTC" Sep 10 00:50:21.451583 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.451507 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13655h23m10.009050371s" Sep 10 00:50:21.535155 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.531622 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:21.535155 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:21.531801 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:21.565620 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.565577 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7p45b" event={"ID":"160d0953-51cb-4633-818b-329f8e30677a","Type":"ContainerStarted","Data":"1684d39428c74e6b77ed177a4e2cc2c64cd02c9a40337d46e5f60fa690085aae"} Sep 10 00:50:21.584014 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.583970 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" event={"ID":"a476af72-c508-4a9e-a8f4-553dcedd7542","Type":"ContainerStarted","Data":"a08606f6180302666a059994ce34087f97a81b769f1f5bac62a1b3d920b98d81"} Sep 10 00:50:21.595852 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.595816 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9j4" event={"ID":"a9c8c435-a9c3-48e8-86a9-0671d814c4fa","Type":"ContainerStarted","Data":"dd50aa9638aeaaae68c50b1d5cb75da52ee3ef3786c6eca1185ece443e55f7d6"} Sep 10 00:50:21.605650 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.605611 2567 generic.go:356] "Generic (PLEG): container finished" podID="5096d71129735a6c1c9788d4caba0e36" containerID="9de45429d54c12826eda9c4bf4d062cd9fd3f6b3f37eb6ab3724ce426140d277" exitCode=0 Sep 10 00:50:21.605816 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.605725 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal" event={"ID":"5096d71129735a6c1c9788d4caba0e36","Type":"ContainerDied","Data":"9de45429d54c12826eda9c4bf4d062cd9fd3f6b3f37eb6ab3724ce426140d277"} Sep 10 00:50:21.621919 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.621822 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bjdbl" event={"ID":"d1152275-6e69-42b2-822d-45e0ecc53df8","Type":"ContainerStarted","Data":"63f39a93337428f2d1d69a836dd158821f3283c41fe91993c0f2b0a620b9e596"} Sep 10 00:50:21.635114 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.635007 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pwbgq" event={"ID":"e00484bd-e5bd-440b-90c9-e7644bba6602","Type":"ContainerStarted","Data":"b3e8ef314743460f96a875b30887a4efd84e94a88c7832600524265f2bbb5381"} Sep 10 00:50:21.642497 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.638750 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r4r6n" event={"ID":"b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d","Type":"ContainerStarted","Data":"20b946e9874fb2c12de1560030861a88ab06d52174f351085e4439cc0071f302"} Sep 10 00:50:21.647775 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.647737 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gm7fp" event={"ID":"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8","Type":"ContainerStarted","Data":"7671930f1be234d9482a16fec5ef3151c208a3f5a715402e7baf2b52064f6ef5"} Sep 10 00:50:21.651750 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.651718 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zlt9j" event={"ID":"28805ef6-3374-455b-8c2b-4ead9c24733d","Type":"ContainerStarted","Data":"0cb681dff378950f747dd89c9e26d0ab900839c692cdc49b493f29131b5d7e2d"} Sep 10 00:50:21.654799 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.654768 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-142.ec2.internal" event={"ID":"2a9995c1c97ee8b5062e519ab75540ba","Type":"ContainerStarted","Data":"b0a8240c00fc5f936eed21ded973fb8e32cfb57e9209b73f08646a94a0b904c2"} Sep 10 00:50:21.662079 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:21.662041 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" event={"ID":"c6eca841-6472-4081-99af-183ba91640ec","Type":"ContainerStarted","Data":"80f27f14e8eb83197693c100ab0fc4d89f84387ff92e6b47566865992a8f4efd"} Sep 10 00:50:22.521767 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:22.521730 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:22.522276 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:22.521851 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:22.522276 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:22.522224 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:22.522404 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:22.522342 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:22.682576 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:22.682536 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal" event={"ID":"5096d71129735a6c1c9788d4caba0e36","Type":"ContainerStarted","Data":"4015f44e252c443ae21fe73494ea2e8a173b97697dec511ab2e4caa03d8e593b"} Sep 10 00:50:22.698647 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:22.698581 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-142.ec2.internal" podStartSLOduration=3.698557974 podStartE2EDuration="3.698557974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:22.698328838 +0000 UTC m=+5.648730964" watchObservedRunningTime="2026-09-10 00:50:22.698557974 +0000 UTC m=+5.648960100" Sep 10 00:50:22.699493 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:22.699433 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-142.ec2.internal" podStartSLOduration=3.6994157899999998 podStartE2EDuration="3.69941579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:21.672578466 +0000 UTC m=+4.622980592" watchObservedRunningTime="2026-09-10 00:50:22.69941579 +0000 UTC m=+5.649817916" Sep 10 00:50:23.057966 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:23.057922 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:23.058173 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:23.058006 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs\") pod \"network-metrics-daemon-bf2vw\" (UID: \"94aee17f-23d4-41f3-8b56-2d42b7c23fb0\") " pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:23.058251 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:23.058196 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:23.058308 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:23.058269 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs podName:94aee17f-23d4-41f3-8b56-2d42b7c23fb0 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:27.058247111 +0000 UTC m=+10.008649216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs") pod "network-metrics-daemon-bf2vw" (UID: "94aee17f-23d4-41f3-8b56-2d42b7c23fb0") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:23.058825 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:23.058800 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:23.058900 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:23.058869 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret podName:0b60eed6-1260-4550-b2ff-b2c56076c290 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:27.058852616 +0000 UTC m=+10.009254720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret") pod "global-pull-secret-syncer-j8t49" (UID: "0b60eed6-1260-4550-b2ff-b2c56076c290") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:23.159514 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:23.158822 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9zkx\" (UniqueName: \"kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx\") pod \"network-check-target-mvqfv\" (UID: \"b68cbf13-c4cc-463e-b9bb-f184673d2bff\") " pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:23.159514 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:23.159035 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:50:23.159514 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:23.159055 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:50:23.159514 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:23.159069 2567 projected.go:196] Error preparing data for projected volume kube-api-access-d9zkx for pod openshift-network-diagnostics/network-check-target-mvqfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:23.159514 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:23.159136 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx podName:b68cbf13-c4cc-463e-b9bb-f184673d2bff nodeName:}" failed. No retries permitted until 2026-09-10 00:50:27.159115963 +0000 UTC m=+10.109518067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9zkx" (UniqueName: "kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx") pod "network-check-target-mvqfv" (UID: "b68cbf13-c4cc-463e-b9bb-f184673d2bff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:23.524011 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:23.523917 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:23.524527 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:23.524056 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:24.522237 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:24.521640 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:24.522237 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:24.521651 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:24.522237 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:24.521790 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:24.522237 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:24.521886 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:25.522195 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:25.522159 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:25.522682 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:25.522301 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:26.521599 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:26.521238 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:26.521599 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:26.521268 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:26.521822 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:26.521633 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:26.521822 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:26.521694 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:27.094205 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:27.094161 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs\") pod \"network-metrics-daemon-bf2vw\" (UID: \"94aee17f-23d4-41f3-8b56-2d42b7c23fb0\") " pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:27.094624 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:27.094250 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:27.094624 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:27.094352 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:27.094624 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:27.094418 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret podName:0b60eed6-1260-4550-b2ff-b2c56076c290 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:35.09440282 +0000 UTC m=+18.044804932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret") pod "global-pull-secret-syncer-j8t49" (UID: "0b60eed6-1260-4550-b2ff-b2c56076c290") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:27.094753 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:27.094739 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:27.094787 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:27.094781 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs podName:94aee17f-23d4-41f3-8b56-2d42b7c23fb0 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:35.094769555 +0000 UTC m=+18.045171653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs") pod "network-metrics-daemon-bf2vw" (UID: "94aee17f-23d4-41f3-8b56-2d42b7c23fb0") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:27.195668 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:27.195050 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9zkx\" (UniqueName: \"kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx\") pod \"network-check-target-mvqfv\" (UID: \"b68cbf13-c4cc-463e-b9bb-f184673d2bff\") " pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:27.195668 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:27.195253 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:50:27.195668 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:27.195271 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:50:27.195668 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:27.195282 2567 projected.go:196] Error preparing data for projected volume kube-api-access-d9zkx for pod openshift-network-diagnostics/network-check-target-mvqfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:27.195668 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:27.195347 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx podName:b68cbf13-c4cc-463e-b9bb-f184673d2bff nodeName:}" failed. No retries permitted until 2026-09-10 00:50:35.19531649 +0000 UTC m=+18.145718589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9zkx" (UniqueName: "kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx") pod "network-check-target-mvqfv" (UID: "b68cbf13-c4cc-463e-b9bb-f184673d2bff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:27.524684 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:27.524607 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:27.524881 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:27.524742 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:28.521442 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:28.520748 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:28.521442 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:28.520881 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:28.521442 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:28.521244 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:28.521442 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:28.521372 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:29.523709 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:29.523627 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:29.524138 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:29.523764 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:30.521369 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:30.521314 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:30.521577 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:30.521450 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:30.521577 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:30.521492 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:30.521704 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:30.521581 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:31.521192 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:31.521156 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:31.521665 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:31.521312 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:32.521750 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:32.521718 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:32.522218 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:32.521716 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:32.522218 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:32.521863 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:32.522218 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:32.521902 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:33.520875 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:33.520842 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:33.521024 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:33.520993 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:34.521739 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:34.521696 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:34.522196 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:34.521830 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:34.522196 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:34.521887 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:34.522196 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:34.522022 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:35.154933 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:35.154902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:35.154933 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:35.154938 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs\") pod \"network-metrics-daemon-bf2vw\" (UID: \"94aee17f-23d4-41f3-8b56-2d42b7c23fb0\") " pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:35.155148 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:35.155037 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:35.155148 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:35.155036 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:35.155148 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:35.155094 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs podName:94aee17f-23d4-41f3-8b56-2d42b7c23fb0 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:51.155077535 +0000 UTC m=+34.105479636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs") pod "network-metrics-daemon-bf2vw" (UID: "94aee17f-23d4-41f3-8b56-2d42b7c23fb0") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:35.155148 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:35.155108 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret podName:0b60eed6-1260-4550-b2ff-b2c56076c290 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:51.155101584 +0000 UTC m=+34.105503682 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret") pod "global-pull-secret-syncer-j8t49" (UID: "0b60eed6-1260-4550-b2ff-b2c56076c290") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:35.255981 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:35.255950 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9zkx\" (UniqueName: \"kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx\") pod \"network-check-target-mvqfv\" (UID: \"b68cbf13-c4cc-463e-b9bb-f184673d2bff\") " pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:35.256127 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:35.256108 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:50:35.256127 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:35.256125 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:50:35.256194 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:35.256134 2567 projected.go:196] Error preparing data for projected volume kube-api-access-d9zkx for pod openshift-network-diagnostics/network-check-target-mvqfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:35.256194 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:35.256186 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx podName:b68cbf13-c4cc-463e-b9bb-f184673d2bff nodeName:}" failed. No retries permitted until 2026-09-10 00:50:51.256168113 +0000 UTC m=+34.206570212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9zkx" (UniqueName: "kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx") pod "network-check-target-mvqfv" (UID: "b68cbf13-c4cc-463e-b9bb-f184673d2bff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:35.520982 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:35.520898 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:35.521142 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:35.521020 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:36.520775 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:36.520739 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:36.520775 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:36.520766 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:36.521252 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:36.520877 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:36.521252 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:36.521010 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:37.522319 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:37.522283 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:37.522756 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:37.522416 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:38.520932 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:38.520899 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:38.521131 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:38.521028 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:38.521131 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:38.521087 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:38.521250 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:38.521216 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:39.521073 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.520945 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:39.521609 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:39.521165 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:39.719448 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.719411 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bjdbl" event={"ID":"d1152275-6e69-42b2-822d-45e0ecc53df8","Type":"ContainerStarted","Data":"44d90f07cf8552025cfdc3b2f18f41aa84b082f402daadad2357cba0c7260f05"} Sep 10 00:50:39.720802 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.720763 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pwbgq" event={"ID":"e00484bd-e5bd-440b-90c9-e7644bba6602","Type":"ContainerStarted","Data":"e68c746b4fc5a25d16bef8117c3ac5cd4b6105cc847e4762ccdac6eee2e27201"} Sep 10 00:50:39.722256 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.722232 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r4r6n" event={"ID":"b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d","Type":"ContainerStarted","Data":"c78921e72f258a44cc59d68da8a0b6540d36c50f4c8c6b87ea7c4622d5af024f"} Sep 10 00:50:39.723706 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.723679 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gm7fp" event={"ID":"e8fc08e6-f72d-4bdb-bd82-f94d878a07c8","Type":"ContainerStarted","Data":"3a1f454ef2f974608bb46189fdad0f40c20335617940b23dc0e6c7c417fb33eb"} Sep 10 00:50:39.726115 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.726099 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/ovn-acl-logging/0.log" Sep 10 00:50:39.726448 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.726431 2567 generic.go:356] "Generic (PLEG): container finished" podID="c6eca841-6472-4081-99af-183ba91640ec" containerID="0b43f23a4486a1396b50df5ed167d4c82c4aa7049d1c80d19c000b56c60a8236" exitCode=1 Sep 10 00:50:39.726519 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.726488 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" event={"ID":"c6eca841-6472-4081-99af-183ba91640ec","Type":"ContainerStarted","Data":"e2825307b25b5786b15a5a75fce2e5c000b459cf27bdd4772ab818d907bc2c8d"} Sep 10 00:50:39.726561 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.726538 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" event={"ID":"c6eca841-6472-4081-99af-183ba91640ec","Type":"ContainerStarted","Data":"0aaf5acf3a7867ced3445fb836830fb8310c4546b60a43522c113ad21d61a15e"} Sep 10 00:50:39.726604 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.726572 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" event={"ID":"c6eca841-6472-4081-99af-183ba91640ec","Type":"ContainerStarted","Data":"8a1a5f902b726871025ed54c9aa9962de8c85fbaaf5c6ccbfaedf0f7071118bc"} Sep 10 00:50:39.726645 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.726616 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" event={"ID":"c6eca841-6472-4081-99af-183ba91640ec","Type":"ContainerDied","Data":"0b43f23a4486a1396b50df5ed167d4c82c4aa7049d1c80d19c000b56c60a8236"} Sep 10 00:50:39.726684 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.726647 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" event={"ID":"c6eca841-6472-4081-99af-183ba91640ec","Type":"ContainerStarted","Data":"ab8dfd5ff1be54e4c926c3ed05b81bde3da2b7053bd7de1f9c6a5243fdd25ea6"} Sep 10 00:50:39.727751 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.727730 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7p45b" event={"ID":"160d0953-51cb-4633-818b-329f8e30677a","Type":"ContainerStarted","Data":"46b7aa8a2e22a0937e2fce17125b69791faaed6564a7d9ddb0bcadb017f27bc0"} Sep 10 00:50:39.729049 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.729030 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" event={"ID":"a476af72-c508-4a9e-a8f4-553dcedd7542","Type":"ContainerStarted","Data":"74517ccb0034f3eaafb2a5f93e5d3aff182c76b9cdda3512fd684b256ca8618d"} Sep 10 00:50:39.730437 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.730417 2567 generic.go:356] "Generic (PLEG): container finished" podID="a9c8c435-a9c3-48e8-86a9-0671d814c4fa" containerID="840785105c65cc8e819661c21e55d004e8bada17f53ebcfccd204cc504fc5b03" exitCode=0 Sep 10 00:50:39.730583 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.730444 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9j4" event={"ID":"a9c8c435-a9c3-48e8-86a9-0671d814c4fa","Type":"ContainerDied","Data":"840785105c65cc8e819661c21e55d004e8bada17f53ebcfccd204cc504fc5b03"} Sep 10 00:50:39.734298 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.734264 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bjdbl" podStartSLOduration=3.639061506 podStartE2EDuration="21.734252873s" totalImagesPullingTime="18.095191367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:39.734081953 +0000 UTC m=+22.684484073" watchObservedRunningTime="2026-09-10 00:50:39.734252873 +0000 UTC m=+22.684654993" Sep 10 00:50:39.763204 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.763159 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7p45b" podStartSLOduration=3.616765574 podStartE2EDuration="21.76314661s" totalImagesPullingTime="18.146381036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:39.763037081 +0000 UTC m=+22.713439202" watchObservedRunningTime="2026-09-10 00:50:39.76314661 +0000 UTC m=+22.713548730" Sep 10 00:50:39.763345 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.763285 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pwbgq" podStartSLOduration=3.63259486 podStartE2EDuration="21.763280424s" totalImagesPullingTime="18.130685564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:39.747048832 +0000 UTC m=+22.697450952" watchObservedRunningTime="2026-09-10 00:50:39.763280424 +0000 UTC m=+22.713682545" Sep 10 00:50:39.800802 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.800758 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r4r6n" podStartSLOduration=3.6983808209999998 podStartE2EDuration="21.800741089s" totalImagesPullingTime="18.102360268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:39.800021847 +0000 UTC m=+22.750423967" watchObservedRunningTime="2026-09-10 00:50:39.800741089 +0000 UTC m=+22.751143393" Sep 10 00:50:39.816772 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:39.816599 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gm7fp" podStartSLOduration=3.640668138 podStartE2EDuration="21.816578269s" totalImagesPullingTime="18.175910131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:39.816127366 +0000 UTC m=+22.766529488" watchObservedRunningTime="2026-09-10 00:50:39.816578269 +0000 UTC m=+22.766980391" Sep 10 00:50:40.521681 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:40.521505 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:40.522142 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:40.521558 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:40.522142 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:40.521749 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:40.522142 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:40.521828 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:40.605733 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:40.605706 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 00:50:40.735699 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:40.735657 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" event={"ID":"a476af72-c508-4a9e-a8f4-553dcedd7542","Type":"ContainerStarted","Data":"8895339f43352d74d438f635f4ac6b58576e224b7ab9ae0c56c35af6040031b4"} Sep 10 00:50:40.737474 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:40.737436 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zlt9j" event={"ID":"28805ef6-3374-455b-8c2b-4ead9c24733d","Type":"ContainerStarted","Data":"f5eca776ebd87b48f3d0e87e893ae115ddcd9038e36930a7714fc9f717ab02f0"} Sep 10 00:50:40.740660 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:40.740625 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/ovn-acl-logging/0.log" Sep 10 00:50:40.741130 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:40.741107 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" event={"ID":"c6eca841-6472-4081-99af-183ba91640ec","Type":"ContainerStarted","Data":"a5e6a0b2fc1356c26e3d4a7b47a08b0d00fb0f560176d3395cb25c39cb84a536"} Sep 10 00:50:40.752664 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:40.752613 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zlt9j" podStartSLOduration=4.591804469 podStartE2EDuration="22.75259697s" totalImagesPullingTime="18.160792501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:40.752597629 +0000 UTC m=+23.702999749" watchObservedRunningTime="2026-09-10 00:50:40.75259697 +0000 UTC m=+23.702999090" Sep 10 00:50:41.490282 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:41.490160 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T00:50:40.605728747Z","UUID":"66e2f186-c8b3-42b5-867a-8405e6a0c790","Handler":null,"Name":"","Endpoint":""} Sep 10 00:50:41.491999 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:41.491978 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 00:50:41.492117 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:41.492015 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 00:50:41.521509 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:41.521477 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:41.521664 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:41.521594 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:41.746041 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:41.745940 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" event={"ID":"a476af72-c508-4a9e-a8f4-553dcedd7542","Type":"ContainerStarted","Data":"e251020d88d51abedad760f02047f4bdd4a66220d292a89392c32ca4ea8a6bc2"} Sep 10 00:50:41.763679 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:41.763630 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjml9" podStartSLOduration=3.527429303 podStartE2EDuration="23.763609679s" totalImagesPullingTime="20.236180376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:41.762903721 +0000 UTC m=+24.713305843" watchObservedRunningTime="2026-09-10 00:50:41.763609679 +0000 UTC m=+24.714011802" Sep 10 00:50:42.032105 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:42.032021 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r4r6n" Sep 10 00:50:42.032671 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:42.032631 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r4r6n" Sep 10 00:50:42.521621 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:42.521591 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:42.521966 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:42.521591 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:42.521966 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:42.521733 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:42.521966 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:42.521759 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:42.752113 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:42.752089 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/ovn-acl-logging/0.log" Sep 10 00:50:42.752559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:42.752536 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" event={"ID":"c6eca841-6472-4081-99af-183ba91640ec","Type":"ContainerStarted","Data":"64669259f5d527b6aa8316a35f03fb1b8aaf8192ae531d635e0b9cf2a488b2c5"} Sep 10 00:50:43.521036 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:43.521002 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:43.521247 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:43.521120 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:44.521415 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:44.521216 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:44.521770 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:44.521276 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:44.521770 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:44.521505 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:44.521770 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:44.521567 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:44.760644 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:44.760614 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/ovn-acl-logging/0.log" Sep 10 00:50:44.761025 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:44.761000 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" event={"ID":"c6eca841-6472-4081-99af-183ba91640ec","Type":"ContainerStarted","Data":"0d92c51e30d580d57ac9e329b74a355b8676dc53cde6e85fe68be55fc96cd5d0"} Sep 10 00:50:44.761311 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:44.761289 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:44.761501 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:44.761484 2567 scope.go:117] "RemoveContainer" containerID="0b43f23a4486a1396b50df5ed167d4c82c4aa7049d1c80d19c000b56c60a8236" Sep 10 00:50:44.763077 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:44.763052 2567 generic.go:356] "Generic (PLEG): container finished" podID="a9c8c435-a9c3-48e8-86a9-0671d814c4fa" containerID="abfd6580f5ce4aac26b0de181e51f27076b618f105c4a9724a9203a3a0ab190c" exitCode=0 Sep 10 00:50:44.763077 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:44.763083 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9j4" event={"ID":"a9c8c435-a9c3-48e8-86a9-0671d814c4fa","Type":"ContainerDied","Data":"abfd6580f5ce4aac26b0de181e51f27076b618f105c4a9724a9203a3a0ab190c"} Sep 10 00:50:44.780665 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:44.780645 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:45.521336 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:45.521297 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:45.521527 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:45.521485 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:45.769136 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:45.769065 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/ovn-acl-logging/0.log" Sep 10 00:50:45.769460 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:45.769426 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" event={"ID":"c6eca841-6472-4081-99af-183ba91640ec","Type":"ContainerStarted","Data":"a982bf24cb47ee08920070fdb8963e21e981b89d71b4fa058ee2d6ccf52cac5f"} Sep 10 00:50:45.769731 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:45.769703 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:45.769811 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:45.769775 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:45.771699 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:45.771675 2567 generic.go:356] "Generic (PLEG): container finished" podID="a9c8c435-a9c3-48e8-86a9-0671d814c4fa" containerID="d7977cef3dfdb2c19122f567d32c634f8f5ace70d0db024d3e6ea6136cfbeaf5" exitCode=0 Sep 10 00:50:45.771774 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:45.771720 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9j4" event={"ID":"a9c8c435-a9c3-48e8-86a9-0671d814c4fa","Type":"ContainerDied","Data":"d7977cef3dfdb2c19122f567d32c634f8f5ace70d0db024d3e6ea6136cfbeaf5"} Sep 10 00:50:45.785502 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:45.785482 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:50:45.797970 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:45.797904 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" podStartSLOduration=9.367215707 podStartE2EDuration="27.797883686s" totalImagesPullingTime="18.430667979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:45.796518269 +0000 UTC m=+28.746920390" watchObservedRunningTime="2026-09-10 00:50:45.797883686 +0000 UTC m=+28.748285808" Sep 10 00:50:45.995809 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:45.995779 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r4r6n" Sep 10 00:50:45.995972 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:45.995959 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 10 00:50:45.996495 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:45.996480 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r4r6n" Sep 10 00:50:46.209153 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:46.208962 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mvqfv"] Sep 10 00:50:46.209341 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:46.209251 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:46.209415 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:46.209347 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:46.212073 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:46.212044 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j8t49"] Sep 10 00:50:46.212206 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:46.212156 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:46.212271 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:46.212253 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:46.212915 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:46.212891 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bf2vw"] Sep 10 00:50:46.213042 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:46.213012 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:46.213144 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:46.213122 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:46.776429 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:46.776274 2567 generic.go:356] "Generic (PLEG): container finished" podID="a9c8c435-a9c3-48e8-86a9-0671d814c4fa" containerID="114c418d5c76ffd8b45b1f058072a0f8a85c82b805154513e0d081e48d0f4673" exitCode=0 Sep 10 00:50:46.776429 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:46.776344 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9j4" event={"ID":"a9c8c435-a9c3-48e8-86a9-0671d814c4fa","Type":"ContainerDied","Data":"114c418d5c76ffd8b45b1f058072a0f8a85c82b805154513e0d081e48d0f4673"} Sep 10 00:50:47.521624 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:47.521581 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:47.521827 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:47.521690 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:48.521716 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:48.521686 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:48.522149 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:48.521814 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:48.522149 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:48.521858 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:48.522149 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:48.522001 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:49.521284 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:49.521253 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:49.521494 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:49.521398 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:50.521450 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:50.521361 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:50.521947 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:50.521510 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqfv" podUID="b68cbf13-c4cc-463e-b9bb-f184673d2bff" Sep 10 00:50:50.521947 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:50.521585 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:50.521947 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:50.521684 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bf2vw" podUID="94aee17f-23d4-41f3-8b56-2d42b7c23fb0" Sep 10 00:50:51.177479 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.177353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:51.177479 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.177450 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs\") pod \"network-metrics-daemon-bf2vw\" (UID: \"94aee17f-23d4-41f3-8b56-2d42b7c23fb0\") " pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:51.177746 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:51.177521 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:51.177746 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:51.177601 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:51.177746 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:51.177605 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret podName:0b60eed6-1260-4550-b2ff-b2c56076c290 nodeName:}" failed. No retries permitted until 2026-09-10 00:51:23.177582587 +0000 UTC m=+66.127984691 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret") pod "global-pull-secret-syncer-j8t49" (UID: "0b60eed6-1260-4550-b2ff-b2c56076c290") : object "kube-system"/"original-pull-secret" not registered Sep 10 00:50:51.177746 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:51.177675 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs podName:94aee17f-23d4-41f3-8b56-2d42b7c23fb0 nodeName:}" failed. No retries permitted until 2026-09-10 00:51:23.17765658 +0000 UTC m=+66.128058687 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs") pod "network-metrics-daemon-bf2vw" (UID: "94aee17f-23d4-41f3-8b56-2d42b7c23fb0") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 00:50:51.277815 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.277781 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9zkx\" (UniqueName: \"kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx\") pod \"network-check-target-mvqfv\" (UID: \"b68cbf13-c4cc-463e-b9bb-f184673d2bff\") " pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:51.277993 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:51.277957 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 00:50:51.277993 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:51.277982 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 00:50:51.277993 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:51.277992 2567 projected.go:196] Error preparing data for projected volume kube-api-access-d9zkx for pod openshift-network-diagnostics/network-check-target-mvqfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:51.278126 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:51.278045 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx podName:b68cbf13-c4cc-463e-b9bb-f184673d2bff nodeName:}" failed. No retries permitted until 2026-09-10 00:51:23.278028398 +0000 UTC m=+66.228430497 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9zkx" (UniqueName: "kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx") pod "network-check-target-mvqfv" (UID: "b68cbf13-c4cc-463e-b9bb-f184673d2bff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 00:50:51.521866 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.521789 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:51.522296 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:51.521882 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8t49" podUID="0b60eed6-1260-4550-b2ff-b2c56076c290" Sep 10 00:50:51.821373 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.821346 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-142.ec2.internal" event="NodeReady" Sep 10 00:50:51.821543 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.821528 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 00:50:51.907672 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.907639 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nqcjp"] Sep 10 00:50:51.931629 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.931591 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-k6lf2"] Sep 10 00:50:51.931803 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.931757 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:51.935737 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.935678 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 00:50:51.935957 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.935933 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fhnl9\"" Sep 10 00:50:51.936060 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.935970 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 00:50:51.950114 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.950082 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl"] Sep 10 00:50:51.950246 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.950186 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-k6lf2" Sep 10 00:50:51.953190 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.953161 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-72bkx\"" Sep 10 00:50:51.953190 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.953181 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 10 00:50:51.953413 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.953348 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:50:51.971986 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.971961 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dmrkj"] Sep 10 00:50:51.972097 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.972074 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" Sep 10 00:50:51.975227 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.975190 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 10 00:50:51.975348 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.975321 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 10 00:50:51.975441 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.975345 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:50:51.975498 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.975439 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fg78h\"" Sep 10 00:50:51.984089 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.984062 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7795776d6f-4k82m"] Sep 10 00:50:51.984089 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.984078 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dmrkj" Sep 10 00:50:51.986090 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.986033 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-2v4lf"] Sep 10 00:50:51.986191 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.986161 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:51.987065 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.987038 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 00:50:51.987603 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.987586 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 00:50:51.987886 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.987855 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2"] Sep 10 00:50:51.987886 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.987862 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j4fzs\"" Sep 10 00:50:51.988039 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.987929 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 00:50:51.988039 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.987950 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-2v4lf" Sep 10 00:50:51.990982 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.989235 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 00:50:51.990982 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.989295 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 00:50:51.990982 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.989554 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 00:50:51.990982 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.989704 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tmd2k\"" Sep 10 00:50:51.994420 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.991754 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-k6lf2"] Sep 10 00:50:51.994420 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.991793 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nqcjp"] Sep 10 00:50:51.994420 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.991818 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl"] Sep 10 00:50:51.994420 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.991850 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dmrkj"] Sep 10 00:50:51.994420 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.991873 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2"] Sep 10 00:50:51.994420 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.991892 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7795776d6f-4k82m"] Sep 10 00:50:51.994420 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.991915 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-2v4lf"] Sep 10 00:50:51.994420 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.992003 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" Sep 10 00:50:51.994858 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.994775 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 00:50:51.995307 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.994944 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 00:50:51.995307 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.995032 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-z5c6d\"" Sep 10 00:50:51.996475 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.996451 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 10 00:50:51.996559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.996514 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 10 00:50:51.996559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.996527 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 10 00:50:51.996874 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.996856 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:50:51.997992 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.997972 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7ljnl\"" Sep 10 00:50:51.998244 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:51.998231 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 00:50:52.005940 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.005921 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-587b6fb4b6-v9vlg"] Sep 10 00:50:52.008374 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.008359 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.011282 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.011269 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 10 00:50:52.011610 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.011593 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 10 00:50:52.011664 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.011593 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 10 00:50:52.011714 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.011697 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 10 00:50:52.011854 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.011842 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 00:50:52.011981 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.011968 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 00:50:52.012299 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.012287 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vdctx\"" Sep 10 00:50:52.023537 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.023513 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-587b6fb4b6-v9vlg"] Sep 10 00:50:52.085526 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085503 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxjkq\" (UniqueName: \"kubernetes.io/projected/5bc421f3-3586-4513-9aaf-9c354af84cf6-kube-api-access-nxjkq\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.085647 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085534 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mqrpl\" (UID: \"dc59a045-bc0f-4c3c-8b39-d7d689498cf2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" Sep 10 00:50:52.085647 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085555 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.085647 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085570 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c14eedb9-50cd-4c46-ad0b-4db012506ceb-installation-pull-secrets\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.085647 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085597 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c11ce5f8-8d74-4158-9702-24fba4e2b2e4-cert\") pod \"ingress-canary-dmrkj\" (UID: \"c11ce5f8-8d74-4158-9702-24fba4e2b2e4\") " pod="openshift-ingress-canary/ingress-canary-dmrkj" Sep 10 00:50:52.085647 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085614 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fc14129-390a-444d-a5d4-2006d4eaaf82-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c6qn2\" (UID: \"1fc14129-390a-444d-a5d4-2006d4eaaf82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" Sep 10 00:50:52.085647 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c14eedb9-50cd-4c46-ad0b-4db012506ceb-image-registry-private-configuration\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.085647 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085646 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-bound-sa-token\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.085894 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085672 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:52.085894 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085730 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c14eedb9-50cd-4c46-ad0b-4db012506ceb-ca-trust-extracted\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.085894 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085764 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k9ml\" (UniqueName: \"kubernetes.io/projected/1fc14129-390a-444d-a5d4-2006d4eaaf82-kube-api-access-6k9ml\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c6qn2\" (UID: \"1fc14129-390a-444d-a5d4-2006d4eaaf82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" Sep 10 00:50:52.085894 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085805 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-default-certificate\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.085894 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085820 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8k2v\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-kube-api-access-z8k2v\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.085894 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085858 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c19780d9-7056-4298-a7d7-972ee1a17408-config-volume\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:52.085894 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c19780d9-7056-4298-a7d7-972ee1a17408-tmp-dir\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:52.085894 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085890 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1fc14129-390a-444d-a5d4-2006d4eaaf82-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c6qn2\" (UID: \"1fc14129-390a-444d-a5d4-2006d4eaaf82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" Sep 10 00:50:52.086216 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085905 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js22m\" (UniqueName: \"kubernetes.io/projected/850b4cbf-8df1-46fa-bc90-ef1b2b2aa3c6-kube-api-access-js22m\") pod \"volume-data-source-validator-695c895bd6-k6lf2\" (UID: \"850b4cbf-8df1-46fa-bc90-ef1b2b2aa3c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-k6lf2" Sep 10 00:50:52.086216 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085919 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-stats-auth\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.086216 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085939 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrg4k\" (UniqueName: \"kubernetes.io/projected/438648da-d082-49d7-adf6-09a52abf1f97-kube-api-access-mrg4k\") pod \"network-check-source-685456655f-2v4lf\" (UID: \"438648da-d082-49d7-adf6-09a52abf1f97\") " pod="openshift-network-diagnostics/network-check-source-685456655f-2v4lf" Sep 10 00:50:52.086216 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085954 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gqgl\" (UniqueName: \"kubernetes.io/projected/c19780d9-7056-4298-a7d7-972ee1a17408-kube-api-access-5gqgl\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:52.086216 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085968 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.086216 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.085995 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-certificates\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.086216 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.086035 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c14eedb9-50cd-4c46-ad0b-4db012506ceb-trusted-ca\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.086216 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.086072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kvrj\" (UniqueName: \"kubernetes.io/projected/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-kube-api-access-2kvrj\") pod \"cluster-samples-operator-7cdcfcf76c-mqrpl\" (UID: \"dc59a045-bc0f-4c3c-8b39-d7d689498cf2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" Sep 10 00:50:52.086216 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.086105 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvlfp\" (UniqueName: \"kubernetes.io/projected/c11ce5f8-8d74-4158-9702-24fba4e2b2e4-kube-api-access-wvlfp\") pod \"ingress-canary-dmrkj\" (UID: \"c11ce5f8-8d74-4158-9702-24fba4e2b2e4\") " pod="openshift-ingress-canary/ingress-canary-dmrkj" Sep 10 00:50:52.086216 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.086129 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.186828 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.186789 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-default-certificate\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.186828 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.186827 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8k2v\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-kube-api-access-z8k2v\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.187055 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.186855 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c19780d9-7056-4298-a7d7-972ee1a17408-config-volume\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:52.187055 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.186878 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c19780d9-7056-4298-a7d7-972ee1a17408-tmp-dir\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:52.187055 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.186902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1fc14129-390a-444d-a5d4-2006d4eaaf82-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c6qn2\" (UID: \"1fc14129-390a-444d-a5d4-2006d4eaaf82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" Sep 10 00:50:52.187055 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.186920 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js22m\" (UniqueName: \"kubernetes.io/projected/850b4cbf-8df1-46fa-bc90-ef1b2b2aa3c6-kube-api-access-js22m\") pod \"volume-data-source-validator-695c895bd6-k6lf2\" (UID: \"850b4cbf-8df1-46fa-bc90-ef1b2b2aa3c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-k6lf2" Sep 10 00:50:52.187055 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.186935 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-stats-auth\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.187055 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.186965 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrg4k\" (UniqueName: \"kubernetes.io/projected/438648da-d082-49d7-adf6-09a52abf1f97-kube-api-access-mrg4k\") pod \"network-check-source-685456655f-2v4lf\" (UID: \"438648da-d082-49d7-adf6-09a52abf1f97\") " pod="openshift-network-diagnostics/network-check-source-685456655f-2v4lf" Sep 10 00:50:52.187055 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.186990 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gqgl\" (UniqueName: \"kubernetes.io/projected/c19780d9-7056-4298-a7d7-972ee1a17408-kube-api-access-5gqgl\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:52.187055 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187016 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.187055 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187043 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-certificates\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.187480 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187065 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c14eedb9-50cd-4c46-ad0b-4db012506ceb-trusted-ca\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.187480 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187091 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kvrj\" (UniqueName: \"kubernetes.io/projected/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-kube-api-access-2kvrj\") pod \"cluster-samples-operator-7cdcfcf76c-mqrpl\" (UID: \"dc59a045-bc0f-4c3c-8b39-d7d689498cf2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" Sep 10 00:50:52.187480 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187118 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvlfp\" (UniqueName: \"kubernetes.io/projected/c11ce5f8-8d74-4158-9702-24fba4e2b2e4-kube-api-access-wvlfp\") pod \"ingress-canary-dmrkj\" (UID: \"c11ce5f8-8d74-4158-9702-24fba4e2b2e4\") " pod="openshift-ingress-canary/ingress-canary-dmrkj" Sep 10 00:50:52.187480 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187140 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.187480 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxjkq\" (UniqueName: \"kubernetes.io/projected/5bc421f3-3586-4513-9aaf-9c354af84cf6-kube-api-access-nxjkq\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.187480 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187204 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mqrpl\" (UID: \"dc59a045-bc0f-4c3c-8b39-d7d689498cf2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" Sep 10 00:50:52.187480 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187227 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.187480 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187479 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c14eedb9-50cd-4c46-ad0b-4db012506ceb-installation-pull-secrets\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.187797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187505 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c11ce5f8-8d74-4158-9702-24fba4e2b2e4-cert\") pod \"ingress-canary-dmrkj\" (UID: \"c11ce5f8-8d74-4158-9702-24fba4e2b2e4\") " pod="openshift-ingress-canary/ingress-canary-dmrkj" Sep 10 00:50:52.187797 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.187540 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle podName:5bc421f3-3586-4513-9aaf-9c354af84cf6 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:52.687521996 +0000 UTC m=+35.637924099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle") pod "router-default-587b6fb4b6-v9vlg" (UID: "5bc421f3-3586-4513-9aaf-9c354af84cf6") : configmap references non-existent config key: service-ca.crt Sep 10 00:50:52.187797 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.187736 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 00:50:52.187953 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.187813 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls podName:dc59a045-bc0f-4c3c-8b39-d7d689498cf2 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:52.687796912 +0000 UTC m=+35.638199014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-mqrpl" (UID: "dc59a045-bc0f-4c3c-8b39-d7d689498cf2") : secret "samples-operator-tls" not found Sep 10 00:50:52.187953 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187832 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fc14129-390a-444d-a5d4-2006d4eaaf82-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c6qn2\" (UID: \"1fc14129-390a-444d-a5d4-2006d4eaaf82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" Sep 10 00:50:52.187953 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187857 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c14eedb9-50cd-4c46-ad0b-4db012506ceb-image-registry-private-configuration\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.187953 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187881 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-bound-sa-token\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.187953 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.187882 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:50:52.187953 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.187905 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7795776d6f-4k82m: secret "image-registry-tls" not found Sep 10 00:50:52.187953 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187910 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:52.187953 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187937 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c14eedb9-50cd-4c46-ad0b-4db012506ceb-ca-trust-extracted\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.187953 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.187953 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls podName:c14eedb9-50cd-4c46-ad0b-4db012506ceb nodeName:}" failed. No retries permitted until 2026-09-10 00:50:52.687936918 +0000 UTC m=+35.638339016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls") pod "image-registry-7795776d6f-4k82m" (UID: "c14eedb9-50cd-4c46-ad0b-4db012506ceb") : secret "image-registry-tls" not found Sep 10 00:50:52.188402 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187993 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k9ml\" (UniqueName: \"kubernetes.io/projected/1fc14129-390a-444d-a5d4-2006d4eaaf82-kube-api-access-6k9ml\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c6qn2\" (UID: \"1fc14129-390a-444d-a5d4-2006d4eaaf82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" Sep 10 00:50:52.188402 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.188109 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-certificates\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.188402 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.188192 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c14eedb9-50cd-4c46-ad0b-4db012506ceb-ca-trust-extracted\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.188402 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187854 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c19780d9-7056-4298-a7d7-972ee1a17408-config-volume\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:52.188402 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.187357 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c19780d9-7056-4298-a7d7-972ee1a17408-tmp-dir\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:52.188402 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.188290 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:50:52.188402 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.188308 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 00:50:52.188402 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.188325 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls podName:c19780d9-7056-4298-a7d7-972ee1a17408 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:52.688311903 +0000 UTC m=+35.638714001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls") pod "dns-default-nqcjp" (UID: "c19780d9-7056-4298-a7d7-972ee1a17408") : secret "dns-default-metrics-tls" not found Sep 10 00:50:52.188402 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.188345 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs podName:5bc421f3-3586-4513-9aaf-9c354af84cf6 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:52.688333027 +0000 UTC m=+35.638735165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs") pod "router-default-587b6fb4b6-v9vlg" (UID: "5bc421f3-3586-4513-9aaf-9c354af84cf6") : secret "router-metrics-certs-default" not found Sep 10 00:50:52.188815 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.188544 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c14eedb9-50cd-4c46-ad0b-4db012506ceb-trusted-ca\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.188974 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.188931 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fc14129-390a-444d-a5d4-2006d4eaaf82-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c6qn2\" (UID: \"1fc14129-390a-444d-a5d4-2006d4eaaf82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" Sep 10 00:50:52.191564 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.191537 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1fc14129-390a-444d-a5d4-2006d4eaaf82-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c6qn2\" (UID: \"1fc14129-390a-444d-a5d4-2006d4eaaf82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" Sep 10 00:50:52.191769 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.191745 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c14eedb9-50cd-4c46-ad0b-4db012506ceb-image-registry-private-configuration\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.191832 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.191774 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c11ce5f8-8d74-4158-9702-24fba4e2b2e4-cert\") pod \"ingress-canary-dmrkj\" (UID: \"c11ce5f8-8d74-4158-9702-24fba4e2b2e4\") " pod="openshift-ingress-canary/ingress-canary-dmrkj" Sep 10 00:50:52.191832 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.191770 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-stats-auth\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.191906 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.191828 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c14eedb9-50cd-4c46-ad0b-4db012506ceb-installation-pull-secrets\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.191906 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.191862 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-default-certificate\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.199750 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.199289 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8k2v\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-kube-api-access-z8k2v\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.200552 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.200514 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kvrj\" (UniqueName: \"kubernetes.io/projected/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-kube-api-access-2kvrj\") pod \"cluster-samples-operator-7cdcfcf76c-mqrpl\" (UID: \"dc59a045-bc0f-4c3c-8b39-d7d689498cf2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" Sep 10 00:50:52.201019 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.200970 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gqgl\" (UniqueName: \"kubernetes.io/projected/c19780d9-7056-4298-a7d7-972ee1a17408-kube-api-access-5gqgl\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:52.201123 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.201102 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-bound-sa-token\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.202046 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.202026 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxjkq\" (UniqueName: \"kubernetes.io/projected/5bc421f3-3586-4513-9aaf-9c354af84cf6-kube-api-access-nxjkq\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.202319 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.202296 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js22m\" (UniqueName: \"kubernetes.io/projected/850b4cbf-8df1-46fa-bc90-ef1b2b2aa3c6-kube-api-access-js22m\") pod \"volume-data-source-validator-695c895bd6-k6lf2\" (UID: \"850b4cbf-8df1-46fa-bc90-ef1b2b2aa3c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-k6lf2" Sep 10 00:50:52.202546 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.202522 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k9ml\" (UniqueName: \"kubernetes.io/projected/1fc14129-390a-444d-a5d4-2006d4eaaf82-kube-api-access-6k9ml\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c6qn2\" (UID: \"1fc14129-390a-444d-a5d4-2006d4eaaf82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" Sep 10 00:50:52.202595 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.202545 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvlfp\" (UniqueName: \"kubernetes.io/projected/c11ce5f8-8d74-4158-9702-24fba4e2b2e4-kube-api-access-wvlfp\") pod \"ingress-canary-dmrkj\" (UID: \"c11ce5f8-8d74-4158-9702-24fba4e2b2e4\") " pod="openshift-ingress-canary/ingress-canary-dmrkj" Sep 10 00:50:52.202652 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.202637 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrg4k\" (UniqueName: \"kubernetes.io/projected/438648da-d082-49d7-adf6-09a52abf1f97-kube-api-access-mrg4k\") pod \"network-check-source-685456655f-2v4lf\" (UID: \"438648da-d082-49d7-adf6-09a52abf1f97\") " pod="openshift-network-diagnostics/network-check-source-685456655f-2v4lf" Sep 10 00:50:52.259304 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.259272 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-k6lf2" Sep 10 00:50:52.333003 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.332970 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dmrkj" Sep 10 00:50:52.344754 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.344734 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-2v4lf" Sep 10 00:50:52.350864 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.350845 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" Sep 10 00:50:52.521556 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.521527 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:50:52.521556 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.521563 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:50:52.524441 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.524417 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 00:50:52.525133 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.524741 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mhb4c\"" Sep 10 00:50:52.525133 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.524842 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rcm88\"" Sep 10 00:50:52.534104 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.534080 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-k6lf2"] Sep 10 00:50:52.537422 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:52.537379 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850b4cbf_8df1_46fa_bc90_ef1b2b2aa3c6.slice/crio-21adad8feb0a8a6947737bfd0ce3a84cade9e311ac26ea9259f8d1f56d52eed1 WatchSource:0}: Error finding container 21adad8feb0a8a6947737bfd0ce3a84cade9e311ac26ea9259f8d1f56d52eed1: Status 404 returned error can't find the container with id 21adad8feb0a8a6947737bfd0ce3a84cade9e311ac26ea9259f8d1f56d52eed1 Sep 10 00:50:52.600031 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.600006 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dmrkj"] Sep 10 00:50:52.603088 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:52.603055 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11ce5f8_8d74_4158_9702_24fba4e2b2e4.slice/crio-8a4e9f5a258c39e755c97e1335a83e3f51f693ed1365ab51ae913944e2918fe0 WatchSource:0}: Error finding container 8a4e9f5a258c39e755c97e1335a83e3f51f693ed1365ab51ae913944e2918fe0: Status 404 returned error can't find the container with id 8a4e9f5a258c39e755c97e1335a83e3f51f693ed1365ab51ae913944e2918fe0 Sep 10 00:50:52.619123 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.619104 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-2v4lf"] Sep 10 00:50:52.621419 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:52.621396 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438648da_d082_49d7_adf6_09a52abf1f97.slice/crio-e8e76963abde666f648809ae67bee30354ef00b1c084beaae10b46e43cf42060 WatchSource:0}: Error finding container e8e76963abde666f648809ae67bee30354ef00b1c084beaae10b46e43cf42060: Status 404 returned error can't find the container with id e8e76963abde666f648809ae67bee30354ef00b1c084beaae10b46e43cf42060 Sep 10 00:50:52.628480 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.628456 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2"] Sep 10 00:50:52.630879 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:50:52.630858 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc14129_390a_444d_a5d4_2006d4eaaf82.slice/crio-8149cfa2143e1552e2d63dfd8f47ac81d000a6d3f8536e40c46e362ca21e74c7 WatchSource:0}: Error finding container 8149cfa2143e1552e2d63dfd8f47ac81d000a6d3f8536e40c46e362ca21e74c7: Status 404 returned error can't find the container with id 8149cfa2143e1552e2d63dfd8f47ac81d000a6d3f8536e40c46e362ca21e74c7 Sep 10 00:50:52.693014 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.692980 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:52.693183 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.693076 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:52.693183 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.693101 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.693183 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.693135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mqrpl\" (UID: \"dc59a045-bc0f-4c3c-8b39-d7d689498cf2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" Sep 10 00:50:52.693183 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.693164 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:52.693183 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.693136 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:50:52.693419 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.693230 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:50:52.693419 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.693240 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 00:50:52.693419 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.693249 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7795776d6f-4k82m: secret "image-registry-tls" not found Sep 10 00:50:52.693419 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.693254 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 00:50:52.693419 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.693234 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle podName:5bc421f3-3586-4513-9aaf-9c354af84cf6 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:53.693214416 +0000 UTC m=+36.643616515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle") pod "router-default-587b6fb4b6-v9vlg" (UID: "5bc421f3-3586-4513-9aaf-9c354af84cf6") : configmap references non-existent config key: service-ca.crt Sep 10 00:50:52.693419 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.693311 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs podName:5bc421f3-3586-4513-9aaf-9c354af84cf6 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:53.693293933 +0000 UTC m=+36.643696048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs") pod "router-default-587b6fb4b6-v9vlg" (UID: "5bc421f3-3586-4513-9aaf-9c354af84cf6") : secret "router-metrics-certs-default" not found Sep 10 00:50:52.693419 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.693338 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls podName:c19780d9-7056-4298-a7d7-972ee1a17408 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:53.693319701 +0000 UTC m=+36.643721806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls") pod "dns-default-nqcjp" (UID: "c19780d9-7056-4298-a7d7-972ee1a17408") : secret "dns-default-metrics-tls" not found Sep 10 00:50:52.693419 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.693352 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls podName:c14eedb9-50cd-4c46-ad0b-4db012506ceb nodeName:}" failed. No retries permitted until 2026-09-10 00:50:53.693344364 +0000 UTC m=+36.643746463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls") pod "image-registry-7795776d6f-4k82m" (UID: "c14eedb9-50cd-4c46-ad0b-4db012506ceb") : secret "image-registry-tls" not found Sep 10 00:50:52.693419 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:52.693373 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls podName:dc59a045-bc0f-4c3c-8b39-d7d689498cf2 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:53.693365754 +0000 UTC m=+36.643767857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-mqrpl" (UID: "dc59a045-bc0f-4c3c-8b39-d7d689498cf2") : secret "samples-operator-tls" not found Sep 10 00:50:52.792863 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.792827 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" event={"ID":"1fc14129-390a-444d-a5d4-2006d4eaaf82","Type":"ContainerStarted","Data":"8149cfa2143e1552e2d63dfd8f47ac81d000a6d3f8536e40c46e362ca21e74c7"} Sep 10 00:50:52.795760 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.795728 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-k6lf2" event={"ID":"850b4cbf-8df1-46fa-bc90-ef1b2b2aa3c6","Type":"ContainerStarted","Data":"21adad8feb0a8a6947737bfd0ce3a84cade9e311ac26ea9259f8d1f56d52eed1"} Sep 10 00:50:52.799072 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.799047 2567 generic.go:356] "Generic (PLEG): container finished" podID="a9c8c435-a9c3-48e8-86a9-0671d814c4fa" containerID="f576eee077be9c95706ec2c62b331494074beb9f2757d80e8bb80b97bf919140" exitCode=0 Sep 10 00:50:52.799183 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.799124 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9j4" event={"ID":"a9c8c435-a9c3-48e8-86a9-0671d814c4fa","Type":"ContainerDied","Data":"f576eee077be9c95706ec2c62b331494074beb9f2757d80e8bb80b97bf919140"} Sep 10 00:50:52.800230 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.800207 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-2v4lf" event={"ID":"438648da-d082-49d7-adf6-09a52abf1f97","Type":"ContainerStarted","Data":"e8e76963abde666f648809ae67bee30354ef00b1c084beaae10b46e43cf42060"} Sep 10 00:50:52.801253 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:52.801232 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dmrkj" event={"ID":"c11ce5f8-8d74-4158-9702-24fba4e2b2e4","Type":"ContainerStarted","Data":"8a4e9f5a258c39e755c97e1335a83e3f51f693ed1365ab51ae913944e2918fe0"} Sep 10 00:50:53.521184 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:53.521149 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:50:53.525015 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:53.524986 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 00:50:53.700928 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:53.700886 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:53.701111 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:53.700940 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:53.701111 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:53.700991 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mqrpl\" (UID: \"dc59a045-bc0f-4c3c-8b39-d7d689498cf2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" Sep 10 00:50:53.701111 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:53.701019 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:53.701111 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:53.701088 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:53.701341 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:53.701306 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:50:53.701409 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:53.701375 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls podName:c19780d9-7056-4298-a7d7-972ee1a17408 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:55.70135746 +0000 UTC m=+38.651759576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls") pod "dns-default-nqcjp" (UID: "c19780d9-7056-4298-a7d7-972ee1a17408") : secret "dns-default-metrics-tls" not found Sep 10 00:50:53.701757 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:53.701738 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:50:53.701757 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:53.701751 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7795776d6f-4k82m: secret "image-registry-tls" not found Sep 10 00:50:53.701899 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:53.701818 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls podName:c14eedb9-50cd-4c46-ad0b-4db012506ceb nodeName:}" failed. No retries permitted until 2026-09-10 00:50:55.701805499 +0000 UTC m=+38.652207610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls") pod "image-registry-7795776d6f-4k82m" (UID: "c14eedb9-50cd-4c46-ad0b-4db012506ceb") : secret "image-registry-tls" not found Sep 10 00:50:53.701899 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:53.701872 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle podName:5bc421f3-3586-4513-9aaf-9c354af84cf6 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:55.701863722 +0000 UTC m=+38.652265822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle") pod "router-default-587b6fb4b6-v9vlg" (UID: "5bc421f3-3586-4513-9aaf-9c354af84cf6") : configmap references non-existent config key: service-ca.crt Sep 10 00:50:53.702014 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:53.701910 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 00:50:53.702014 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:53.701929 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls podName:dc59a045-bc0f-4c3c-8b39-d7d689498cf2 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:55.701923999 +0000 UTC m=+38.652326098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-mqrpl" (UID: "dc59a045-bc0f-4c3c-8b39-d7d689498cf2") : secret "samples-operator-tls" not found Sep 10 00:50:53.702014 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:53.701959 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 00:50:53.702014 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:53.701980 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs podName:5bc421f3-3586-4513-9aaf-9c354af84cf6 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:55.701973413 +0000 UTC m=+38.652375512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs") pod "router-default-587b6fb4b6-v9vlg" (UID: "5bc421f3-3586-4513-9aaf-9c354af84cf6") : secret "router-metrics-certs-default" not found Sep 10 00:50:53.809849 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:53.809767 2567 generic.go:356] "Generic (PLEG): container finished" podID="a9c8c435-a9c3-48e8-86a9-0671d814c4fa" containerID="1a70f61857ea03aad224b76c6c09e227af852128cb75f39219551102b898b477" exitCode=0 Sep 10 00:50:53.809849 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:53.809823 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9j4" event={"ID":"a9c8c435-a9c3-48e8-86a9-0671d814c4fa","Type":"ContainerDied","Data":"1a70f61857ea03aad224b76c6c09e227af852128cb75f39219551102b898b477"} Sep 10 00:50:54.818559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:54.818294 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wl9j4" event={"ID":"a9c8c435-a9c3-48e8-86a9-0671d814c4fa","Type":"ContainerStarted","Data":"86b3df4719d165e260f011e27703ad0b431e093e496318ebdaf64f00d74099f9"} Sep 10 00:50:54.820333 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:54.820302 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-k6lf2" event={"ID":"850b4cbf-8df1-46fa-bc90-ef1b2b2aa3c6","Type":"ContainerStarted","Data":"74a761b30332b64d265de086be1c8af2c3ddd9072dad4e81989e672a4498b751"} Sep 10 00:50:54.841994 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:54.841938 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wl9j4" podStartSLOduration=7.718590266 podStartE2EDuration="36.841916168s" totalImagesPullingTime="29.123325902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:54.839774645 +0000 UTC m=+37.790176803" watchObservedRunningTime="2026-09-10 00:50:54.841916168 +0000 UTC m=+37.792318290" Sep 10 00:50:55.719614 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:55.719571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:55.719792 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:55.719630 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:55.719792 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:55.719743 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:50:55.719792 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:55.719768 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7795776d6f-4k82m: secret "image-registry-tls" not found Sep 10 00:50:55.719893 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:55.719751 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle podName:5bc421f3-3586-4513-9aaf-9c354af84cf6 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:59.719732309 +0000 UTC m=+42.670134408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle") pod "router-default-587b6fb4b6-v9vlg" (UID: "5bc421f3-3586-4513-9aaf-9c354af84cf6") : configmap references non-existent config key: service-ca.crt Sep 10 00:50:55.719893 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:55.719839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mqrpl\" (UID: \"dc59a045-bc0f-4c3c-8b39-d7d689498cf2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" Sep 10 00:50:55.719893 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:55.719876 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:55.720012 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:55.719920 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:55.720012 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:55.719962 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 00:50:55.720012 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:55.720008 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls podName:dc59a045-bc0f-4c3c-8b39-d7d689498cf2 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:59.719994365 +0000 UTC m=+42.670396480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-mqrpl" (UID: "dc59a045-bc0f-4c3c-8b39-d7d689498cf2") : secret "samples-operator-tls" not found Sep 10 00:50:55.720167 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:55.720062 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:50:55.720167 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:55.720064 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls podName:c14eedb9-50cd-4c46-ad0b-4db012506ceb nodeName:}" failed. No retries permitted until 2026-09-10 00:50:59.720054704 +0000 UTC m=+42.670456802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls") pod "image-registry-7795776d6f-4k82m" (UID: "c14eedb9-50cd-4c46-ad0b-4db012506ceb") : secret "image-registry-tls" not found Sep 10 00:50:55.720167 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:55.720112 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls podName:c19780d9-7056-4298-a7d7-972ee1a17408 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:59.720095856 +0000 UTC m=+42.670497960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls") pod "dns-default-nqcjp" (UID: "c19780d9-7056-4298-a7d7-972ee1a17408") : secret "dns-default-metrics-tls" not found Sep 10 00:50:55.720167 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:55.720145 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 00:50:55.720317 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:55.720208 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs podName:5bc421f3-3586-4513-9aaf-9c354af84cf6 nodeName:}" failed. No retries permitted until 2026-09-10 00:50:59.720191143 +0000 UTC m=+42.670593277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs") pod "router-default-587b6fb4b6-v9vlg" (UID: "5bc421f3-3586-4513-9aaf-9c354af84cf6") : secret "router-metrics-certs-default" not found Sep 10 00:50:57.829509 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:57.829474 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-2v4lf" event={"ID":"438648da-d082-49d7-adf6-09a52abf1f97","Type":"ContainerStarted","Data":"a4ccceff9d51962add1dd4b5c19c0d9e033bbf27dd7a014d3993a0aa54d0daeb"} Sep 10 00:50:57.831187 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:57.831159 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dmrkj" event={"ID":"c11ce5f8-8d74-4158-9702-24fba4e2b2e4","Type":"ContainerStarted","Data":"bdc9fa7a6aff4c49649d299f3160153e961b4a1d136ca442bc91e5fb6f32e38d"} Sep 10 00:50:57.832865 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:57.832840 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" event={"ID":"1fc14129-390a-444d-a5d4-2006d4eaaf82","Type":"ContainerStarted","Data":"286ce3c89d3aa6f08424b784731f3284a90c6a9970ba63dcc5f619fee4257fb6"} Sep 10 00:50:57.844557 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:57.844499 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-k6lf2" podStartSLOduration=5.27837074 podStartE2EDuration="6.844480666s" totalImagesPullingTime="1.566109926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:54.854793092 +0000 UTC m=+37.805195221" watchObservedRunningTime="2026-09-10 00:50:57.844480666 +0000 UTC m=+40.794882782" Sep 10 00:50:57.845180 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:57.845152 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-2v4lf" podStartSLOduration=2.004648472 podStartE2EDuration="6.845139648s" totalImagesPullingTime="4.840491176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:57.843739089 +0000 UTC m=+40.794141207" watchObservedRunningTime="2026-09-10 00:50:57.845139648 +0000 UTC m=+40.795541770" Sep 10 00:50:57.861834 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:57.861792 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" podStartSLOduration=2.025916427 podStartE2EDuration="6.861776428s" totalImagesPullingTime="4.835860001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:57.861101529 +0000 UTC m=+40.811503651" watchObservedRunningTime="2026-09-10 00:50:57.861776428 +0000 UTC m=+40.812178549" Sep 10 00:50:57.880607 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:57.880548 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dmrkj" podStartSLOduration=2.022057794 podStartE2EDuration="6.880531231s" totalImagesPullingTime="4.858473437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:50:57.879432683 +0000 UTC m=+40.829834806" watchObservedRunningTime="2026-09-10 00:50:57.880531231 +0000 UTC m=+40.830933352" Sep 10 00:50:58.992509 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:58.992480 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wzwq6"] Sep 10 00:50:59.017830 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.017798 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wzwq6"] Sep 10 00:50:59.017967 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.017914 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.021707 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.021669 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 00:50:59.021856 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.021749 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rgq8h\"" Sep 10 00:50:59.021856 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.021777 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 00:50:59.021963 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.021749 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 00:50:59.023108 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.023085 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 00:50:59.147930 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.147891 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc8552a4-95dc-440b-9551-0531b59ebdec-data-volume\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.148085 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.147981 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7268h\" (UniqueName: \"kubernetes.io/projected/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-api-access-7268h\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.148085 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.148003 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.148085 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.148032 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc8552a4-95dc-440b-9551-0531b59ebdec-crio-socket\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.148085 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.148050 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.248743 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.248643 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc8552a4-95dc-440b-9551-0531b59ebdec-data-volume\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.248743 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.248711 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7268h\" (UniqueName: \"kubernetes.io/projected/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-api-access-7268h\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.248743 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.248739 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.249012 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.248777 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc8552a4-95dc-440b-9551-0531b59ebdec-crio-socket\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.249012 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.248802 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.249012 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.248854 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:50:59.249012 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.248914 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:50:59.249012 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.248928 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm podName:cc8552a4-95dc-440b-9551-0531b59ebdec nodeName:}" failed. No retries permitted until 2026-09-10 00:50:59.748907795 +0000 UTC m=+42.699309893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wzwq6" (UID: "cc8552a4-95dc-440b-9551-0531b59ebdec") : configmap "kube-rbac-proxy" not found Sep 10 00:50:59.249012 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.248961 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls podName:cc8552a4-95dc-440b-9551-0531b59ebdec nodeName:}" failed. No retries permitted until 2026-09-10 00:50:59.748952005 +0000 UTC m=+42.699354106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wzwq6" (UID: "cc8552a4-95dc-440b-9551-0531b59ebdec") : secret "insights-runtime-extractor-tls" not found Sep 10 00:50:59.249221 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.249018 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc8552a4-95dc-440b-9551-0531b59ebdec-data-volume\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.249221 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.249014 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc8552a4-95dc-440b-9551-0531b59ebdec-crio-socket\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.258855 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.258832 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7268h\" (UniqueName: \"kubernetes.io/projected/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-api-access-7268h\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.754003 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.753953 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.754003 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.754008 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:50:59.754264 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.754039 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:59.754264 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.754066 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:50:59.754264 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.754095 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:50:59.754264 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.754119 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:50:59.754264 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.754122 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:50:59.754264 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.754149 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7795776d6f-4k82m: secret "image-registry-tls" not found Sep 10 00:50:59.754264 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.754166 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mqrpl\" (UID: \"dc59a045-bc0f-4c3c-8b39-d7d689498cf2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" Sep 10 00:50:59.754264 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.754188 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls podName:cc8552a4-95dc-440b-9551-0531b59ebdec nodeName:}" failed. No retries permitted until 2026-09-10 00:51:00.754165884 +0000 UTC m=+43.704567998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wzwq6" (UID: "cc8552a4-95dc-440b-9551-0531b59ebdec") : secret "insights-runtime-extractor-tls" not found Sep 10 00:50:59.754264 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.754208 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls podName:c14eedb9-50cd-4c46-ad0b-4db012506ceb nodeName:}" failed. No retries permitted until 2026-09-10 00:51:07.75419852 +0000 UTC m=+50.704600621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls") pod "image-registry-7795776d6f-4k82m" (UID: "c14eedb9-50cd-4c46-ad0b-4db012506ceb") : secret "image-registry-tls" not found Sep 10 00:50:59.754264 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.754207 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 00:50:59.754264 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.754232 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 00:50:59.754264 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.754237 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle podName:5bc421f3-3586-4513-9aaf-9c354af84cf6 nodeName:}" failed. No retries permitted until 2026-09-10 00:51:07.754217409 +0000 UTC m=+50.704619529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle") pod "router-default-587b6fb4b6-v9vlg" (UID: "5bc421f3-3586-4513-9aaf-9c354af84cf6") : configmap references non-existent config key: service-ca.crt Sep 10 00:50:59.754264 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.754274 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs podName:5bc421f3-3586-4513-9aaf-9c354af84cf6 nodeName:}" failed. No retries permitted until 2026-09-10 00:51:07.754256673 +0000 UTC m=+50.704658773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs") pod "router-default-587b6fb4b6-v9vlg" (UID: "5bc421f3-3586-4513-9aaf-9c354af84cf6") : secret "router-metrics-certs-default" not found Sep 10 00:50:59.754684 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.754296 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:50:59.754684 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.754298 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls podName:dc59a045-bc0f-4c3c-8b39-d7d689498cf2 nodeName:}" failed. No retries permitted until 2026-09-10 00:51:07.754288282 +0000 UTC m=+50.704690385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-mqrpl" (UID: "dc59a045-bc0f-4c3c-8b39-d7d689498cf2") : secret "samples-operator-tls" not found Sep 10 00:50:59.754684 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.754353 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls podName:c19780d9-7056-4298-a7d7-972ee1a17408 nodeName:}" failed. No retries permitted until 2026-09-10 00:51:07.754345246 +0000 UTC m=+50.704747344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls") pod "dns-default-nqcjp" (UID: "c19780d9-7056-4298-a7d7-972ee1a17408") : secret "dns-default-metrics-tls" not found Sep 10 00:50:59.754684 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:50:59.754410 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:50:59.754684 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.754484 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:50:59.754684 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:50:59.754512 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm podName:cc8552a4-95dc-440b-9551-0531b59ebdec nodeName:}" failed. No retries permitted until 2026-09-10 00:51:00.75450128 +0000 UTC m=+43.704903393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wzwq6" (UID: "cc8552a4-95dc-440b-9551-0531b59ebdec") : configmap "kube-rbac-proxy" not found Sep 10 00:51:00.749118 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:00.749093 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bjdbl_d1152275-6e69-42b2-822d-45e0ecc53df8/dns-node-resolver/0.log" Sep 10 00:51:00.761556 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:00.761528 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:51:00.761659 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:00.761582 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:51:00.761659 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:00.761642 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:51:00.761749 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:00.761706 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm podName:cc8552a4-95dc-440b-9551-0531b59ebdec nodeName:}" failed. No retries permitted until 2026-09-10 00:51:02.761691559 +0000 UTC m=+45.712093658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wzwq6" (UID: "cc8552a4-95dc-440b-9551-0531b59ebdec") : configmap "kube-rbac-proxy" not found Sep 10 00:51:00.761749 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:00.761738 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:51:00.761834 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:00.761796 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls podName:cc8552a4-95dc-440b-9551-0531b59ebdec nodeName:}" failed. No retries permitted until 2026-09-10 00:51:02.761783088 +0000 UTC m=+45.712185186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wzwq6" (UID: "cc8552a4-95dc-440b-9551-0531b59ebdec") : secret "insights-runtime-extractor-tls" not found Sep 10 00:51:01.747166 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:01.747136 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pwbgq_e00484bd-e5bd-440b-90c9-e7644bba6602/node-ca/0.log" Sep 10 00:51:02.547559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:02.547528 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dmrkj_c11ce5f8-8d74-4158-9702-24fba4e2b2e4/serve-healthcheck-canary/0.log" Sep 10 00:51:02.779734 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:02.779698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:51:02.779905 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:02.779763 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:51:02.779905 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:02.779832 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:51:02.779905 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:02.779905 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm podName:cc8552a4-95dc-440b-9551-0531b59ebdec nodeName:}" failed. No retries permitted until 2026-09-10 00:51:06.779889022 +0000 UTC m=+49.730291122 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wzwq6" (UID: "cc8552a4-95dc-440b-9551-0531b59ebdec") : configmap "kube-rbac-proxy" not found Sep 10 00:51:02.780020 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:02.779922 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:51:02.780020 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:02.779966 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls podName:cc8552a4-95dc-440b-9551-0531b59ebdec nodeName:}" failed. No retries permitted until 2026-09-10 00:51:06.779954032 +0000 UTC m=+49.730356144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wzwq6" (UID: "cc8552a4-95dc-440b-9551-0531b59ebdec") : secret "insights-runtime-extractor-tls" not found Sep 10 00:51:06.813401 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:06.813314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:51:06.813807 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:06.813429 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:51:06.813807 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:06.813460 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 00:51:06.813807 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:06.813534 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm podName:cc8552a4-95dc-440b-9551-0531b59ebdec nodeName:}" failed. No retries permitted until 2026-09-10 00:51:14.813518069 +0000 UTC m=+57.763920180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wzwq6" (UID: "cc8552a4-95dc-440b-9551-0531b59ebdec") : configmap "kube-rbac-proxy" not found Sep 10 00:51:06.813807 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:06.813568 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:51:06.813807 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:06.813625 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls podName:cc8552a4-95dc-440b-9551-0531b59ebdec nodeName:}" failed. No retries permitted until 2026-09-10 00:51:14.813612546 +0000 UTC m=+57.764014649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wzwq6" (UID: "cc8552a4-95dc-440b-9551-0531b59ebdec") : secret "insights-runtime-extractor-tls" not found Sep 10 00:51:07.822684 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:07.822649 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:51:07.823102 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:07.822714 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mqrpl\" (UID: \"dc59a045-bc0f-4c3c-8b39-d7d689498cf2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" Sep 10 00:51:07.823102 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:07.822772 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:51:07.823102 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:07.822790 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:51:07.823102 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:07.822812 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 00:51:07.823102 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:07.822815 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:51:07.823102 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:07.822903 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls podName:c19780d9-7056-4298-a7d7-972ee1a17408 nodeName:}" failed. No retries permitted until 2026-09-10 00:51:23.822877154 +0000 UTC m=+66.773279268 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls") pod "dns-default-nqcjp" (UID: "c19780d9-7056-4298-a7d7-972ee1a17408") : secret "dns-default-metrics-tls" not found Sep 10 00:51:07.823102 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:07.822928 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 00:51:07.823102 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:07.822943 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7795776d6f-4k82m: secret "image-registry-tls" not found Sep 10 00:51:07.823102 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:07.822973 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 00:51:07.823102 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:07.823002 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls podName:c14eedb9-50cd-4c46-ad0b-4db012506ceb nodeName:}" failed. No retries permitted until 2026-09-10 00:51:23.822985552 +0000 UTC m=+66.773387666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls") pod "image-registry-7795776d6f-4k82m" (UID: "c14eedb9-50cd-4c46-ad0b-4db012506ceb") : secret "image-registry-tls" not found Sep 10 00:51:07.823102 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:07.823019 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs podName:5bc421f3-3586-4513-9aaf-9c354af84cf6 nodeName:}" failed. No retries permitted until 2026-09-10 00:51:23.823010442 +0000 UTC m=+66.773412543 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs") pod "router-default-587b6fb4b6-v9vlg" (UID: "5bc421f3-3586-4513-9aaf-9c354af84cf6") : secret "router-metrics-certs-default" not found Sep 10 00:51:07.823102 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:07.823031 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle podName:5bc421f3-3586-4513-9aaf-9c354af84cf6 nodeName:}" failed. No retries permitted until 2026-09-10 00:51:23.823026082 +0000 UTC m=+66.773428181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle") pod "router-default-587b6fb4b6-v9vlg" (UID: "5bc421f3-3586-4513-9aaf-9c354af84cf6") : configmap references non-existent config key: service-ca.crt Sep 10 00:51:07.825348 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:07.825319 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc59a045-bc0f-4c3c-8b39-d7d689498cf2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mqrpl\" (UID: \"dc59a045-bc0f-4c3c-8b39-d7d689498cf2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" Sep 10 00:51:07.881260 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:07.881233 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" Sep 10 00:51:08.162413 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:08.162368 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl"] Sep 10 00:51:08.861286 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:08.861255 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" event={"ID":"dc59a045-bc0f-4c3c-8b39-d7d689498cf2","Type":"ContainerStarted","Data":"5fe14edc915bddac1ee833fc5129b087ca7324c2c7ea10a6426a7c75133ba077"} Sep 10 00:51:10.869770 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:10.869737 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" event={"ID":"dc59a045-bc0f-4c3c-8b39-d7d689498cf2","Type":"ContainerStarted","Data":"32f26e2153a10027849b5f5caba2270980911466fab3ee3daef681f4afa6f94a"} Sep 10 00:51:10.870156 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:10.869788 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" event={"ID":"dc59a045-bc0f-4c3c-8b39-d7d689498cf2","Type":"ContainerStarted","Data":"1482af09d31db7b0c8323b3a41a69e3af7d4023397638b06f4ecaf0ea9c5d563"} Sep 10 00:51:10.885881 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:10.885839 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mqrpl" podStartSLOduration=17.610869613 podStartE2EDuration="19.885825412s" totalImagesPullingTime="2.274955799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:10.88569266 +0000 UTC m=+53.836094781" watchObservedRunningTime="2026-09-10 00:51:10.885825412 +0000 UTC m=+53.836227532" Sep 10 00:51:14.882670 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:14.882637 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:51:14.883124 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:14.882687 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:51:14.883124 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:14.882882 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 00:51:14.883124 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:14.882952 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls podName:cc8552a4-95dc-440b-9551-0531b59ebdec nodeName:}" failed. No retries permitted until 2026-09-10 00:51:30.882936066 +0000 UTC m=+73.833338164 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wzwq6" (UID: "cc8552a4-95dc-440b-9551-0531b59ebdec") : secret "insights-runtime-extractor-tls" not found Sep 10 00:51:14.883291 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:14.883271 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc8552a4-95dc-440b-9551-0531b59ebdec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:51:17.789719 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:17.789689 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lh25b" Sep 10 00:51:23.248606 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.248564 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs\") pod \"network-metrics-daemon-bf2vw\" (UID: \"94aee17f-23d4-41f3-8b56-2d42b7c23fb0\") " pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:51:23.248606 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.248611 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:51:23.251661 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.251640 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 00:51:23.252771 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.252754 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 00:51:23.261316 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.261291 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b60eed6-1260-4550-b2ff-b2c56076c290-original-pull-secret\") pod \"global-pull-secret-syncer-j8t49\" (UID: \"0b60eed6-1260-4550-b2ff-b2c56076c290\") " pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:51:23.261475 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.261449 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94aee17f-23d4-41f3-8b56-2d42b7c23fb0-metrics-certs\") pod \"network-metrics-daemon-bf2vw\" (UID: \"94aee17f-23d4-41f3-8b56-2d42b7c23fb0\") " pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:51:23.349627 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.349589 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9zkx\" (UniqueName: \"kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx\") pod \"network-check-target-mvqfv\" (UID: \"b68cbf13-c4cc-463e-b9bb-f184673d2bff\") " pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:51:23.352342 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.352308 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9zkx\" (UniqueName: \"kubernetes.io/projected/b68cbf13-c4cc-463e-b9bb-f184673d2bff-kube-api-access-d9zkx\") pod \"network-check-target-mvqfv\" (UID: \"b68cbf13-c4cc-463e-b9bb-f184673d2bff\") " pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:51:23.438161 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.438132 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mhb4c\"" Sep 10 00:51:23.444058 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.444036 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rcm88\"" Sep 10 00:51:23.446133 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.446116 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bf2vw" Sep 10 00:51:23.452582 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.452566 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:51:23.533881 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.533660 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8t49" Sep 10 00:51:23.745105 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.745058 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bf2vw"] Sep 10 00:51:23.747650 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:51:23.747621 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94aee17f_23d4_41f3_8b56_2d42b7c23fb0.slice/crio-6839665566e58d363e4b4b44bca7f0bd452db45063d6896af622d8f33de61a31 WatchSource:0}: Error finding container 6839665566e58d363e4b4b44bca7f0bd452db45063d6896af622d8f33de61a31: Status 404 returned error can't find the container with id 6839665566e58d363e4b4b44bca7f0bd452db45063d6896af622d8f33de61a31 Sep 10 00:51:23.768875 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.768781 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mvqfv"] Sep 10 00:51:23.771281 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:51:23.771217 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68cbf13_c4cc_463e_b9bb_f184673d2bff.slice/crio-b4604735e7532432df9a8362b674e00990bc9c696e47e7237a69546ae0cc2295 WatchSource:0}: Error finding container b4604735e7532432df9a8362b674e00990bc9c696e47e7237a69546ae0cc2295: Status 404 returned error can't find the container with id b4604735e7532432df9a8362b674e00990bc9c696e47e7237a69546ae0cc2295 Sep 10 00:51:23.818561 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.818514 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j8t49"] Sep 10 00:51:23.826470 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:51:23.826438 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b60eed6_1260_4550_b2ff_b2c56076c290.slice/crio-dea65296f40a8d8f0b1e73d2759486952e00db2ffa28439443d4b8ca34bbc1e0 WatchSource:0}: Error finding container dea65296f40a8d8f0b1e73d2759486952e00db2ffa28439443d4b8ca34bbc1e0: Status 404 returned error can't find the container with id dea65296f40a8d8f0b1e73d2759486952e00db2ffa28439443d4b8ca34bbc1e0 Sep 10 00:51:23.854031 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.854007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:51:23.854164 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.854042 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:51:23.854164 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.854101 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:51:23.854164 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.854120 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:51:23.854763 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.854732 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc421f3-3586-4513-9aaf-9c354af84cf6-service-ca-bundle\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:51:23.856460 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.856442 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c19780d9-7056-4298-a7d7-972ee1a17408-metrics-tls\") pod \"dns-default-nqcjp\" (UID: \"c19780d9-7056-4298-a7d7-972ee1a17408\") " pod="openshift-dns/dns-default-nqcjp" Sep 10 00:51:23.856607 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.856587 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls\") pod \"image-registry-7795776d6f-4k82m\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:51:23.856653 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.856605 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bc421f3-3586-4513-9aaf-9c354af84cf6-metrics-certs\") pod \"router-default-587b6fb4b6-v9vlg\" (UID: \"5bc421f3-3586-4513-9aaf-9c354af84cf6\") " pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:51:23.911402 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.911364 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mvqfv" event={"ID":"b68cbf13-c4cc-463e-b9bb-f184673d2bff","Type":"ContainerStarted","Data":"f55329b0d239fd4e62282c4f5b95d00d2656bfd4269ba5039621df96ed61d656"} Sep 10 00:51:23.911568 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.911428 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mvqfv" event={"ID":"b68cbf13-c4cc-463e-b9bb-f184673d2bff","Type":"ContainerStarted","Data":"b4604735e7532432df9a8362b674e00990bc9c696e47e7237a69546ae0cc2295"} Sep 10 00:51:23.911568 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.911457 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:51:23.912669 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.912644 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bf2vw" event={"ID":"94aee17f-23d4-41f3-8b56-2d42b7c23fb0","Type":"ContainerStarted","Data":"6839665566e58d363e4b4b44bca7f0bd452db45063d6896af622d8f33de61a31"} Sep 10 00:51:23.913767 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.913738 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j8t49" event={"ID":"0b60eed6-1260-4550-b2ff-b2c56076c290","Type":"ContainerStarted","Data":"dea65296f40a8d8f0b1e73d2759486952e00db2ffa28439443d4b8ca34bbc1e0"} Sep 10 00:51:23.927529 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:23.927490 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mvqfv" podStartSLOduration=65.927477983 podStartE2EDuration="1m5.927477983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:23.926077813 +0000 UTC m=+66.876479937" watchObservedRunningTime="2026-09-10 00:51:23.927477983 +0000 UTC m=+66.877880154" Sep 10 00:51:24.047201 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.047120 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fhnl9\"" Sep 10 00:51:24.054696 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.054677 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqcjp" Sep 10 00:51:24.143513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.143253 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tmd2k\"" Sep 10 00:51:24.150568 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.150497 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:51:24.158332 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.158309 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vdctx\"" Sep 10 00:51:24.166642 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.166622 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:51:24.350874 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.350785 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nqcjp"] Sep 10 00:51:24.352847 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:51:24.352816 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19780d9_7056_4298_a7d7_972ee1a17408.slice/crio-0d28a5a5f6927d7c889d348ff32f8cd7fa23438cae619dbb26c75de97abb5585 WatchSource:0}: Error finding container 0d28a5a5f6927d7c889d348ff32f8cd7fa23438cae619dbb26c75de97abb5585: Status 404 returned error can't find the container with id 0d28a5a5f6927d7c889d348ff32f8cd7fa23438cae619dbb26c75de97abb5585 Sep 10 00:51:24.442510 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.442480 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7795776d6f-4k82m"] Sep 10 00:51:24.444645 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:51:24.444608 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14eedb9_50cd_4c46_ad0b_4db012506ceb.slice/crio-aaa80e052277db99fbf80c6547b0f75ff57ed73115b9aa5e005aec5c09b5e175 WatchSource:0}: Error finding container aaa80e052277db99fbf80c6547b0f75ff57ed73115b9aa5e005aec5c09b5e175: Status 404 returned error can't find the container with id aaa80e052277db99fbf80c6547b0f75ff57ed73115b9aa5e005aec5c09b5e175 Sep 10 00:51:24.464246 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.464217 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-587b6fb4b6-v9vlg"] Sep 10 00:51:24.466496 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:51:24.466474 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc421f3_3586_4513_9aaf_9c354af84cf6.slice/crio-1a994a66d0410c1fabff42c92b940da47508bc6ab02032a1ab361f166c8f6cb2 WatchSource:0}: Error finding container 1a994a66d0410c1fabff42c92b940da47508bc6ab02032a1ab361f166c8f6cb2: Status 404 returned error can't find the container with id 1a994a66d0410c1fabff42c92b940da47508bc6ab02032a1ab361f166c8f6cb2 Sep 10 00:51:24.842690 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.842649 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7795776d6f-4k82m"] Sep 10 00:51:24.878350 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.878318 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-wqn5x"] Sep 10 00:51:24.907423 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.907275 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84cc88496f-wks9z"] Sep 10 00:51:24.908536 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.908514 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-wqn5x" Sep 10 00:51:24.911792 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.911766 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 00:51:24.911928 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.911860 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-szmb4\"" Sep 10 00:51:24.911928 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.911873 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 00:51:24.935454 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.935422 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-wqn5x"] Sep 10 00:51:24.935620 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.935468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" event={"ID":"5bc421f3-3586-4513-9aaf-9c354af84cf6","Type":"ContainerStarted","Data":"1a644126019f9ee32b74bac05e6b731524756271afa633ad0da7be6b3207a054"} Sep 10 00:51:24.935620 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.935494 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:24.935620 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.935504 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:51:24.935620 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.935529 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84cc88496f-wks9z"] Sep 10 00:51:24.935620 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.935550 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" event={"ID":"5bc421f3-3586-4513-9aaf-9c354af84cf6","Type":"ContainerStarted","Data":"1a994a66d0410c1fabff42c92b940da47508bc6ab02032a1ab361f166c8f6cb2"} Sep 10 00:51:24.935620 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.935573 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7795776d6f-4k82m" event={"ID":"c14eedb9-50cd-4c46-ad0b-4db012506ceb","Type":"ContainerStarted","Data":"0bebc503571cda4460fe1709c0eff56e1e8fc55f6f4c59f75b3cf2feb33f29d6"} Sep 10 00:51:24.935620 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.935591 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7795776d6f-4k82m" event={"ID":"c14eedb9-50cd-4c46-ad0b-4db012506ceb","Type":"ContainerStarted","Data":"aaa80e052277db99fbf80c6547b0f75ff57ed73115b9aa5e005aec5c09b5e175"} Sep 10 00:51:24.935620 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.935609 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqcjp" event={"ID":"c19780d9-7056-4298-a7d7-972ee1a17408","Type":"ContainerStarted","Data":"0d28a5a5f6927d7c889d348ff32f8cd7fa23438cae619dbb26c75de97abb5585"} Sep 10 00:51:24.953486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.953436 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7795776d6f-4k82m" podStartSLOduration=33.953418677 podStartE2EDuration="33.953418677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:24.952434488 +0000 UTC m=+67.902836609" watchObservedRunningTime="2026-09-10 00:51:24.953418677 +0000 UTC m=+67.903820799" Sep 10 00:51:24.965576 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.964595 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v78xv\" (UniqueName: \"kubernetes.io/projected/58f9776d-a47a-428e-9e08-4a80ff705aed-kube-api-access-v78xv\") pod \"downloads-85d98c998f-wqn5x\" (UID: \"58f9776d-a47a-428e-9e08-4a80ff705aed\") " pod="openshift-console/downloads-85d98c998f-wqn5x" Sep 10 00:51:24.974458 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:24.974411 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" podStartSLOduration=33.974376999 podStartE2EDuration="33.974376999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:24.973216589 +0000 UTC m=+67.923618702" watchObservedRunningTime="2026-09-10 00:51:24.974376999 +0000 UTC m=+67.924779120" Sep 10 00:51:25.065123 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.065082 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-registry-tls\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.065292 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.065143 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrtzv\" (UniqueName: \"kubernetes.io/projected/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-kube-api-access-jrtzv\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.065292 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.065167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-installation-pull-secrets\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.065292 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.065192 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-trusted-ca\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.065292 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.065210 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-bound-sa-token\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.065292 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.065238 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-registry-certificates\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.065292 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.065288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v78xv\" (UniqueName: \"kubernetes.io/projected/58f9776d-a47a-428e-9e08-4a80ff705aed-kube-api-access-v78xv\") pod \"downloads-85d98c998f-wqn5x\" (UID: \"58f9776d-a47a-428e-9e08-4a80ff705aed\") " pod="openshift-console/downloads-85d98c998f-wqn5x" Sep 10 00:51:25.065643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.065353 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-ca-trust-extracted\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.065643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.065373 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-image-registry-private-configuration\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.078004 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.077974 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v78xv\" (UniqueName: \"kubernetes.io/projected/58f9776d-a47a-428e-9e08-4a80ff705aed-kube-api-access-v78xv\") pod \"downloads-85d98c998f-wqn5x\" (UID: \"58f9776d-a47a-428e-9e08-4a80ff705aed\") " pod="openshift-console/downloads-85d98c998f-wqn5x" Sep 10 00:51:25.167073 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.166422 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-image-registry-private-configuration\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.167073 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.166481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-registry-tls\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.167073 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.166517 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrtzv\" (UniqueName: \"kubernetes.io/projected/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-kube-api-access-jrtzv\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.167073 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.166546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-installation-pull-secrets\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.167073 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.166576 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-trusted-ca\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.167073 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.166599 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-bound-sa-token\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.167073 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.166627 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-registry-certificates\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.167073 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.166725 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-ca-trust-extracted\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.167735 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.167578 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-ca-trust-extracted\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.167735 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.167637 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:51:25.168173 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.168149 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-trusted-ca\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.169461 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.169409 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-registry-certificates\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.170309 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.170248 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-installation-pull-secrets\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.170457 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.170322 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-registry-tls\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.170457 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.170423 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-image-registry-private-configuration\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.171580 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.171559 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:51:25.176087 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.176066 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-bound-sa-token\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.176547 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.176525 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrtzv\" (UniqueName: \"kubernetes.io/projected/37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7-kube-api-access-jrtzv\") pod \"image-registry-84cc88496f-wks9z\" (UID: \"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7\") " pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.220785 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.220752 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-wqn5x" Sep 10 00:51:25.246118 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.246081 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:25.542550 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.542522 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-wqn5x"] Sep 10 00:51:25.573311 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.573285 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84cc88496f-wks9z"] Sep 10 00:51:25.904638 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:51:25.904600 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c55d8d_4b21_4a1d_998e_bfcf5b40c6e7.slice/crio-ecf3a874b9bf74e125f59a06aeb757e2b90d57e518760d1ae46f9d8775ce1f97 WatchSource:0}: Error finding container ecf3a874b9bf74e125f59a06aeb757e2b90d57e518760d1ae46f9d8775ce1f97: Status 404 returned error can't find the container with id ecf3a874b9bf74e125f59a06aeb757e2b90d57e518760d1ae46f9d8775ce1f97 Sep 10 00:51:25.932640 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.932607 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84cc88496f-wks9z" event={"ID":"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7","Type":"ContainerStarted","Data":"ecf3a874b9bf74e125f59a06aeb757e2b90d57e518760d1ae46f9d8775ce1f97"} Sep 10 00:51:25.933931 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.933908 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-wqn5x" event={"ID":"58f9776d-a47a-428e-9e08-4a80ff705aed","Type":"ContainerStarted","Data":"8b5ac8752f0608247886c66921a47879960317591c03bb6d5f282f792e3ef140"} Sep 10 00:51:25.934267 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.934246 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:51:25.935667 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:25.935632 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-587b6fb4b6-v9vlg" Sep 10 00:51:27.948642 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:27.948596 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bf2vw" event={"ID":"94aee17f-23d4-41f3-8b56-2d42b7c23fb0","Type":"ContainerStarted","Data":"4704117fa80938882a1de2fcc795183af8a33f4c1c9b8f8e1ae6caf954fcc69f"} Sep 10 00:51:27.950603 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:27.950575 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84cc88496f-wks9z" event={"ID":"37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7","Type":"ContainerStarted","Data":"48d53cc3559f1f39e9aaa9d308887ee0042408d5a23623ce319d1d45be5b8b89"} Sep 10 00:51:27.951015 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:27.950985 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:27.973339 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:27.973179 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-84cc88496f-wks9z" podStartSLOduration=3.973162804 podStartE2EDuration="3.973162804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:51:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:27.971600305 +0000 UTC m=+70.922002450" watchObservedRunningTime="2026-09-10 00:51:27.973162804 +0000 UTC m=+70.923564921" Sep 10 00:51:28.957146 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:28.957115 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bf2vw" event={"ID":"94aee17f-23d4-41f3-8b56-2d42b7c23fb0","Type":"ContainerStarted","Data":"46d8fc8b29daaa20745658e9458feaa868c7011f31ab9664482249accc813e3b"} Sep 10 00:51:28.958943 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:28.958906 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqcjp" event={"ID":"c19780d9-7056-4298-a7d7-972ee1a17408","Type":"ContainerStarted","Data":"754ebf7523155c1f500b94b1cbd6bb5844d29d8a3f7efbc83d4ccaef7ce226f7"} Sep 10 00:51:28.973204 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:28.973156 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bf2vw" podStartSLOduration=67.811676554 podStartE2EDuration="1m10.973135101s" totalImagesPullingTime="3.161458547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:28.972631943 +0000 UTC m=+71.923034067" watchObservedRunningTime="2026-09-10 00:51:28.973135101 +0000 UTC m=+71.923537223" Sep 10 00:51:29.964236 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:29.964191 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j8t49" event={"ID":"0b60eed6-1260-4550-b2ff-b2c56076c290","Type":"ContainerStarted","Data":"d67c27115b88b758acfec28064797e5d27c835f4f42c18e3b37cee5b2c00fa46"} Sep 10 00:51:29.965985 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:29.965958 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqcjp" event={"ID":"c19780d9-7056-4298-a7d7-972ee1a17408","Type":"ContainerStarted","Data":"707d1ed6f0512e9f1fd64fae4b4310df936d02c8a5acadd55862c0dca52ebc36"} Sep 10 00:51:29.979910 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:29.979853 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j8t49" podStartSLOduration=66.850582206 podStartE2EDuration="1m11.979832257s" totalImagesPullingTime="5.129250051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:29.978900583 +0000 UTC m=+72.929302705" watchObservedRunningTime="2026-09-10 00:51:29.979832257 +0000 UTC m=+72.930234379" Sep 10 00:51:29.996356 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:29.996306 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nqcjp" podStartSLOduration=36.434830023 podStartE2EDuration="38.996284319s" totalImagesPullingTime="2.561454296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:50:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:29.995428283 +0000 UTC m=+72.945830405" watchObservedRunningTime="2026-09-10 00:51:29.996284319 +0000 UTC m=+72.946686443" Sep 10 00:51:30.913994 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:30.913956 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:51:30.916607 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:30.916574 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc8552a4-95dc-440b-9551-0531b59ebdec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wzwq6\" (UID: \"cc8552a4-95dc-440b-9551-0531b59ebdec\") " pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:51:30.969802 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:30.969766 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nqcjp" Sep 10 00:51:31.135025 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:31.134990 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rgq8h\"" Sep 10 00:51:31.142373 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:31.142349 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wzwq6" Sep 10 00:51:31.424645 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:31.424535 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wzwq6"] Sep 10 00:51:31.427403 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:51:31.427343 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8552a4_95dc_440b_9551_0531b59ebdec.slice/crio-5e862ced4ff940eea7dcffbee68445209214739c351a57fc5e629f83684b9149 WatchSource:0}: Error finding container 5e862ced4ff940eea7dcffbee68445209214739c351a57fc5e629f83684b9149: Status 404 returned error can't find the container with id 5e862ced4ff940eea7dcffbee68445209214739c351a57fc5e629f83684b9149 Sep 10 00:51:31.975232 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:31.975197 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wzwq6" event={"ID":"cc8552a4-95dc-440b-9551-0531b59ebdec","Type":"ContainerStarted","Data":"4fd3319c3b1b7bb9ebe947dcc752875ddecf8ceea059caa8534db6f626cf9da7"} Sep 10 00:51:31.975726 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:31.975256 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wzwq6" event={"ID":"cc8552a4-95dc-440b-9551-0531b59ebdec","Type":"ContainerStarted","Data":"5e862ced4ff940eea7dcffbee68445209214739c351a57fc5e629f83684b9149"} Sep 10 00:51:32.980366 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:32.980330 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wzwq6" event={"ID":"cc8552a4-95dc-440b-9551-0531b59ebdec","Type":"ContainerStarted","Data":"81fc06361973d3e71a004bf97036a0d752e5db741a9837495a324540833432c8"} Sep 10 00:51:34.990293 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:34.990253 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wzwq6" event={"ID":"cc8552a4-95dc-440b-9551-0531b59ebdec","Type":"ContainerStarted","Data":"6356c628c5bbc8452961d9a867c4a61eb6a23de53aa61c741c017609387559c5"} Sep 10 00:51:35.010052 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:35.009985 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wzwq6" podStartSLOduration=34.528715993 podStartE2EDuration="37.009969666s" totalImagesPullingTime="2.481253673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:50:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:35.007792765 +0000 UTC m=+77.958194887" watchObservedRunningTime="2026-09-10 00:51:35.009969666 +0000 UTC m=+77.960371787" Sep 10 00:51:36.471575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.471541 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fglkf"] Sep 10 00:51:36.473957 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.473929 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.476961 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.476936 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 00:51:36.477314 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.477288 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 00:51:36.477423 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.477355 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 00:51:36.477423 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.477357 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gs6kj\"" Sep 10 00:51:36.478305 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.478281 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 00:51:36.478404 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.478330 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 00:51:36.478453 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.478444 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 00:51:36.555070 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.555031 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-tls\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.555070 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.555077 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62e96854-4728-4df8-a48d-a03bfcfc1b97-sys\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.555310 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.555103 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-textfile\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.555310 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.555134 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62e96854-4728-4df8-a48d-a03bfcfc1b97-metrics-client-ca\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.555310 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.555174 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64fnw\" (UniqueName: \"kubernetes.io/projected/62e96854-4728-4df8-a48d-a03bfcfc1b97-kube-api-access-64fnw\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.555310 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.555197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-wtmp\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.555310 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.555238 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.555310 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.555283 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-accelerators-collector-config\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.555645 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.555335 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62e96854-4728-4df8-a48d-a03bfcfc1b97-root\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656081 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656028 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-accelerators-collector-config\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656081 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656091 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62e96854-4728-4df8-a48d-a03bfcfc1b97-root\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656314 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656120 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-tls\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656314 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656141 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62e96854-4728-4df8-a48d-a03bfcfc1b97-sys\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656314 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-textfile\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656314 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656171 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62e96854-4728-4df8-a48d-a03bfcfc1b97-metrics-client-ca\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656314 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656186 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64fnw\" (UniqueName: \"kubernetes.io/projected/62e96854-4728-4df8-a48d-a03bfcfc1b97-kube-api-access-64fnw\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656314 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656206 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-wtmp\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656314 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656233 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656314 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656236 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62e96854-4728-4df8-a48d-a03bfcfc1b97-root\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656314 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656286 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62e96854-4728-4df8-a48d-a03bfcfc1b97-sys\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656784 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656408 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-wtmp\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656784 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656609 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-textfile\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656784 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656761 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-accelerators-collector-config\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.656902 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.656803 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62e96854-4728-4df8-a48d-a03bfcfc1b97-metrics-client-ca\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.658610 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.658589 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-tls\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.658724 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.658706 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62e96854-4728-4df8-a48d-a03bfcfc1b97-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.664677 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.664657 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64fnw\" (UniqueName: \"kubernetes.io/projected/62e96854-4728-4df8-a48d-a03bfcfc1b97-kube-api-access-64fnw\") pod \"node-exporter-fglkf\" (UID: \"62e96854-4728-4df8-a48d-a03bfcfc1b97\") " pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.786337 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:36.786251 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fglkf" Sep 10 00:51:36.800188 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:51:36.800156 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62e96854_4728_4df8_a48d_a03bfcfc1b97.slice/crio-98fc7910e276a276bf1ac9c1cc46303668536192cb467c1a0b0f5eb073cacf8f WatchSource:0}: Error finding container 98fc7910e276a276bf1ac9c1cc46303668536192cb467c1a0b0f5eb073cacf8f: Status 404 returned error can't find the container with id 98fc7910e276a276bf1ac9c1cc46303668536192cb467c1a0b0f5eb073cacf8f Sep 10 00:51:37.000584 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.000554 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fglkf" event={"ID":"62e96854-4728-4df8-a48d-a03bfcfc1b97","Type":"ContainerStarted","Data":"98fc7910e276a276bf1ac9c1cc46303668536192cb467c1a0b0f5eb073cacf8f"} Sep 10 00:51:37.586739 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.586708 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 00:51:37.589742 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.589718 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.593400 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.593359 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 00:51:37.593544 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.593410 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 00:51:37.593544 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.593437 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 00:51:37.593544 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.593507 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 00:51:37.593544 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.593365 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 00:51:37.593761 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.593365 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 00:51:37.593761 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.593371 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 00:51:37.594037 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.594018 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s2x22\"" Sep 10 00:51:37.594135 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.594090 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 00:51:37.594826 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.594806 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 00:51:37.608403 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.608364 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 00:51:37.666331 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.666293 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.666331 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.666334 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.666591 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.666366 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.666591 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.666448 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.666591 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.666523 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.666591 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.666559 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.666764 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.666602 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-web-config\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.666764 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.666665 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.666764 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.666693 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.666764 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.666735 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4kzx\" (UniqueName: \"kubernetes.io/projected/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-kube-api-access-s4kzx\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.666764 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.666760 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-config-out\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.666945 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.666788 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.666945 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.666833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.767256 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.767214 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-web-config\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.767256 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.767253 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.767536 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.767287 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.767536 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.767316 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4kzx\" (UniqueName: \"kubernetes.io/projected/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-kube-api-access-s4kzx\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.767536 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.767354 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-config-out\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.767536 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.767419 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.767536 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.767460 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.767536 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.767496 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.767536 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.767518 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.767878 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.767545 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.767878 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.767573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.767878 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.767615 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.767878 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.767651 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.767878 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:37.767778 2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 10 00:51:37.767878 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:37.767847 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-main-tls podName:1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf nodeName:}" failed. No retries permitted until 2026-09-10 00:51:38.267826392 +0000 UTC m=+81.218228559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf") : secret "alertmanager-main-tls" not found Sep 10 00:51:37.768430 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.768402 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.769275 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.769255 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.771117 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:51:37.770664 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-trusted-ca-bundle podName:1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf nodeName:}" failed. No retries permitted until 2026-09-10 00:51:38.270644053 +0000 UTC m=+81.221046167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf") : configmap references non-existent config key: ca-bundle.crt Sep 10 00:51:37.771117 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.771052 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-web-config\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.771550 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.771529 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-config-out\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.771948 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.771877 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.772151 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.771975 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.772835 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.772812 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.772835 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.772838 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.773031 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.772891 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.773716 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.773689 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:37.788399 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:37.788347 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4kzx\" (UniqueName: \"kubernetes.io/projected/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-kube-api-access-s4kzx\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:38.011899 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.011858 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fglkf" event={"ID":"62e96854-4728-4df8-a48d-a03bfcfc1b97","Type":"ContainerStarted","Data":"f5e7dd4f89abd2a547cf9549d1c0a98cb02f59022e25713331c92029b4284789"} Sep 10 00:51:38.273407 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.273282 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:38.273407 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.273358 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:38.274243 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.274204 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:38.276320 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.276299 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:38.502195 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.502079 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:51:38.550781 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.550753 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn"] Sep 10 00:51:38.554192 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.554159 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.557663 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.557052 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 10 00:51:38.557663 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.557071 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 10 00:51:38.557663 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.557137 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 10 00:51:38.557663 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.557056 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 10 00:51:38.557663 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.557185 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-22p7fa9fk30qp\"" Sep 10 00:51:38.557663 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.557138 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 10 00:51:38.557663 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.557494 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ttbjr\"" Sep 10 00:51:38.570650 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.570625 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn"] Sep 10 00:51:38.678999 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.678963 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-grpc-tls\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.679364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.679008 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.679364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.679039 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwblq\" (UniqueName: \"kubernetes.io/projected/411eaa81-989a-4693-8805-98451096721b-kube-api-access-zwblq\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.679364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.679065 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.679364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.679085 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/411eaa81-989a-4693-8805-98451096721b-metrics-client-ca\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.679364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.679106 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-tls\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.679364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.679219 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.679364 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.679254 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.779929 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.779906 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 00:51:38.780288 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.780156 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.780288 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.780211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.780288 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.780274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-grpc-tls\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.780559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.780317 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.780559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.780349 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwblq\" (UniqueName: \"kubernetes.io/projected/411eaa81-989a-4693-8805-98451096721b-kube-api-access-zwblq\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.780559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.780379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.780559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.780426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/411eaa81-989a-4693-8805-98451096721b-metrics-client-ca\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.780559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.780454 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-tls\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.782031 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.781950 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/411eaa81-989a-4693-8805-98451096721b-metrics-client-ca\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.783475 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:51:38.783436 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4fdc3a_3bba_41ed_97a2_f9f7d24afbdf.slice/crio-28b1ccc95a498234d52969e326776bd89f54b3043f680123d8db932e60df69f0 WatchSource:0}: Error finding container 28b1ccc95a498234d52969e326776bd89f54b3043f680123d8db932e60df69f0: Status 404 returned error can't find the container with id 28b1ccc95a498234d52969e326776bd89f54b3043f680123d8db932e60df69f0 Sep 10 00:51:38.783874 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.783825 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.785271 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.785245 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.785750 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.785703 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.786217 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.786195 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.786308 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.786240 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-grpc-tls\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.787169 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.787146 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/411eaa81-989a-4693-8805-98451096721b-secret-thanos-querier-tls\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.790126 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.790103 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwblq\" (UniqueName: \"kubernetes.io/projected/411eaa81-989a-4693-8805-98451096721b-kube-api-access-zwblq\") pod \"thanos-querier-5d6cf59c49-bf5rn\" (UID: \"411eaa81-989a-4693-8805-98451096721b\") " pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.838883 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.838846 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65d74f956f-qfkt8"] Sep 10 00:51:38.841661 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.841638 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:38.844923 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.844886 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 00:51:38.844923 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.844890 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 00:51:38.844923 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.844915 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 00:51:38.845160 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.844956 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jlrnr\"" Sep 10 00:51:38.845160 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.845000 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 00:51:38.845160 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.844889 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 00:51:38.850288 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.850272 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 00:51:38.853040 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.853017 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d74f956f-qfkt8"] Sep 10 00:51:38.869518 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.869494 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:38.982948 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.982903 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84e85a9b-0d6b-4357-b896-c346134d8b43-console-oauth-config\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:38.982948 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.982946 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-oauth-serving-cert\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:38.983187 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.983054 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-service-ca\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:38.983187 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.983101 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-trusted-ca-bundle\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:38.983187 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.983131 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv6cj\" (UniqueName: \"kubernetes.io/projected/84e85a9b-0d6b-4357-b896-c346134d8b43-kube-api-access-jv6cj\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:38.983187 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.983168 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84e85a9b-0d6b-4357-b896-c346134d8b43-console-serving-cert\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:38.983316 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:38.983233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-console-config\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.018705 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.018671 2567 generic.go:356] "Generic (PLEG): container finished" podID="62e96854-4728-4df8-a48d-a03bfcfc1b97" containerID="f5e7dd4f89abd2a547cf9549d1c0a98cb02f59022e25713331c92029b4284789" exitCode=0 Sep 10 00:51:39.018889 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.018768 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fglkf" event={"ID":"62e96854-4728-4df8-a48d-a03bfcfc1b97","Type":"ContainerDied","Data":"f5e7dd4f89abd2a547cf9549d1c0a98cb02f59022e25713331c92029b4284789"} Sep 10 00:51:39.020148 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.020120 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerStarted","Data":"28b1ccc95a498234d52969e326776bd89f54b3043f680123d8db932e60df69f0"} Sep 10 00:51:39.084641 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.084613 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv6cj\" (UniqueName: \"kubernetes.io/projected/84e85a9b-0d6b-4357-b896-c346134d8b43-kube-api-access-jv6cj\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.084787 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.084677 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84e85a9b-0d6b-4357-b896-c346134d8b43-console-serving-cert\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.084787 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.084734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-console-config\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.084787 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.084775 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84e85a9b-0d6b-4357-b896-c346134d8b43-console-oauth-config\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.084932 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.084795 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-oauth-serving-cert\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.084932 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.084858 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-service-ca\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.084932 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.084873 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-trusted-ca-bundle\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.086138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.085624 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-oauth-serving-cert\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.086138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.085943 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-trusted-ca-bundle\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.086653 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.086633 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-console-config\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.087249 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.087225 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-service-ca\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.087986 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.087962 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84e85a9b-0d6b-4357-b896-c346134d8b43-console-oauth-config\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.088093 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.088073 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84e85a9b-0d6b-4357-b896-c346134d8b43-console-serving-cert\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.093785 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.093761 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv6cj\" (UniqueName: \"kubernetes.io/projected/84e85a9b-0d6b-4357-b896-c346134d8b43-kube-api-access-jv6cj\") pod \"console-65d74f956f-qfkt8\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:39.151510 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.151479 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn"] Sep 10 00:51:39.151811 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:39.151794 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:51:40.029006 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:40.028967 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fglkf" event={"ID":"62e96854-4728-4df8-a48d-a03bfcfc1b97","Type":"ContainerStarted","Data":"6f93f4736bf4ee8eaaafd050fd66050d541d4e3f2c6fc1226c450992d1176ba4"} Sep 10 00:51:40.029436 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:40.029058 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fglkf" event={"ID":"62e96854-4728-4df8-a48d-a03bfcfc1b97","Type":"ContainerStarted","Data":"a5f3e1fcc3bd039894b140bb37aadd096cf1d75e30bc8ec018b325b4fd784387"} Sep 10 00:51:40.052643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:40.052556 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fglkf" podStartSLOduration=2.858738618 podStartE2EDuration="4.052533742s" totalImagesPullingTime="1.112826637s" totalInitContainerRuntime="80.968487ms" isStatefulPod=true podCreationTimestamp="2026-09-10 00:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:40.050403377 +0000 UTC m=+83.000805494" watchObservedRunningTime="2026-09-10 00:51:40.052533742 +0000 UTC m=+83.002935874" Sep 10 00:51:40.977803 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:40.977766 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nqcjp" Sep 10 00:51:40.988585 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:40.988559 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f44cdff77-qkch5"] Sep 10 00:51:40.992094 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:40.992072 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:40.995669 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:40.995646 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 00:51:40.995800 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:40.995778 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-88q03e79env4m\"" Sep 10 00:51:41.002624 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.002606 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 00:51:41.002741 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.002608 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 00:51:41.002912 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.002893 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-spngd\"" Sep 10 00:51:41.003020 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.002974 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 00:51:41.016623 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.016594 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f44cdff77-qkch5"] Sep 10 00:51:41.103748 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.103713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dff4ff7-87f4-4892-b811-162f7f256099-client-ca-bundle\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.104194 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.103776 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6dff4ff7-87f4-4892-b811-162f7f256099-secret-metrics-server-client-certs\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.104194 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.103816 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dff4ff7-87f4-4892-b811-162f7f256099-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.104194 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.103843 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6dff4ff7-87f4-4892-b811-162f7f256099-metrics-server-audit-profiles\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.104194 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.103891 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6dff4ff7-87f4-4892-b811-162f7f256099-audit-log\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.104194 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.103931 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6dff4ff7-87f4-4892-b811-162f7f256099-secret-metrics-server-tls\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.104194 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.103986 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwvrp\" (UniqueName: \"kubernetes.io/projected/6dff4ff7-87f4-4892-b811-162f7f256099-kube-api-access-jwvrp\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.205165 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.205133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwvrp\" (UniqueName: \"kubernetes.io/projected/6dff4ff7-87f4-4892-b811-162f7f256099-kube-api-access-jwvrp\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.205357 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.205205 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dff4ff7-87f4-4892-b811-162f7f256099-client-ca-bundle\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.205357 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.205240 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6dff4ff7-87f4-4892-b811-162f7f256099-secret-metrics-server-client-certs\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.205357 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.205261 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dff4ff7-87f4-4892-b811-162f7f256099-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.205357 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.205278 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6dff4ff7-87f4-4892-b811-162f7f256099-metrics-server-audit-profiles\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.205357 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.205304 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6dff4ff7-87f4-4892-b811-162f7f256099-audit-log\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.205357 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.205352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6dff4ff7-87f4-4892-b811-162f7f256099-secret-metrics-server-tls\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.206809 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.206198 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6dff4ff7-87f4-4892-b811-162f7f256099-audit-log\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.206809 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.206521 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dff4ff7-87f4-4892-b811-162f7f256099-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.207480 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.207454 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6dff4ff7-87f4-4892-b811-162f7f256099-metrics-server-audit-profiles\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.208406 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.208358 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6dff4ff7-87f4-4892-b811-162f7f256099-secret-metrics-server-tls\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.210171 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.210135 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6dff4ff7-87f4-4892-b811-162f7f256099-secret-metrics-server-client-certs\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.210284 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.210135 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dff4ff7-87f4-4892-b811-162f7f256099-client-ca-bundle\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.220473 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.220448 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwvrp\" (UniqueName: \"kubernetes.io/projected/6dff4ff7-87f4-4892-b811-162f7f256099-kube-api-access-jwvrp\") pod \"metrics-server-f44cdff77-qkch5\" (UID: \"6dff4ff7-87f4-4892-b811-162f7f256099\") " pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.302532 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.302439 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:51:41.671523 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.671492 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-89dcd698f-2jckf"] Sep 10 00:51:41.673921 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.673896 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.676883 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.676732 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 10 00:51:41.676883 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.676747 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 10 00:51:41.676883 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.676830 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 10 00:51:41.676883 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.676838 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 10 00:51:41.676883 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.676880 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 10 00:51:41.677197 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.677175 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-x6rtn\"" Sep 10 00:51:41.683317 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.683298 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 10 00:51:41.689288 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.689268 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-89dcd698f-2jckf"] Sep 10 00:51:41.810686 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.810656 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-secret-telemeter-client\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.810875 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.810718 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-federate-client-tls\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.810875 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.810783 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26gmj\" (UniqueName: \"kubernetes.io/projected/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-kube-api-access-26gmj\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.810875 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.810859 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.811026 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.810887 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.811026 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.810935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-telemeter-client-tls\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.811026 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.810987 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-metrics-client-ca\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.811160 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.811032 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-serving-certs-ca-bundle\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.911814 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.911779 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-federate-client-tls\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.911990 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.911825 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26gmj\" (UniqueName: \"kubernetes.io/projected/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-kube-api-access-26gmj\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.911990 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.911880 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.911990 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.911912 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.911990 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.911951 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-telemeter-client-tls\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.912241 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.912000 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-metrics-client-ca\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.912241 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.912035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-serving-certs-ca-bundle\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.912241 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.912066 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-secret-telemeter-client\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.913181 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.913130 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-metrics-client-ca\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.913289 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.913258 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-serving-certs-ca-bundle\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.913800 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.913772 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.915152 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.915122 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-federate-client-tls\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.915225 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.915181 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-secret-telemeter-client\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.915225 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.915205 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-telemeter-client-tls\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.915308 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.915292 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.921305 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.921284 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26gmj\" (UniqueName: \"kubernetes.io/projected/3c41fc6a-5899-4abd-9fa1-6acc62ec95d1-kube-api-access-26gmj\") pod \"telemeter-client-89dcd698f-2jckf\" (UID: \"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1\") " pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:41.986505 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:41.986416 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" Sep 10 00:51:42.283678 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.283595 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74cdbfc5d-87fjq"] Sep 10 00:51:42.285922 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.285903 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.296676 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.296652 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74cdbfc5d-87fjq"] Sep 10 00:51:42.416072 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.416029 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-console-config\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.416072 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.416076 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9be3f09a-cff8-4097-aac9-56033f182147-console-serving-cert\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.416284 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.416105 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-service-ca\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.416284 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.416164 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9be3f09a-cff8-4097-aac9-56033f182147-console-oauth-config\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.416284 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.416233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-trusted-ca-bundle\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.416409 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.416293 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-oauth-serving-cert\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.416409 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.416335 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd7fh\" (UniqueName: \"kubernetes.io/projected/9be3f09a-cff8-4097-aac9-56033f182147-kube-api-access-bd7fh\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.517192 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.517151 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9be3f09a-cff8-4097-aac9-56033f182147-console-serving-cert\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.517377 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.517201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-service-ca\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.517377 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.517360 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9be3f09a-cff8-4097-aac9-56033f182147-console-oauth-config\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.517536 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.517431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-trusted-ca-bundle\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.517536 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.517495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-oauth-serving-cert\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.517608 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.517553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd7fh\" (UniqueName: \"kubernetes.io/projected/9be3f09a-cff8-4097-aac9-56033f182147-kube-api-access-bd7fh\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.517715 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.517689 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-console-config\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.518012 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.517987 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-service-ca\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.518348 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.518323 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-trusted-ca-bundle\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.518550 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.518528 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-console-config\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.518831 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.518801 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-oauth-serving-cert\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.520711 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.520639 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9be3f09a-cff8-4097-aac9-56033f182147-console-serving-cert\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.520711 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.520670 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9be3f09a-cff8-4097-aac9-56033f182147-console-oauth-config\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.526320 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.526286 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd7fh\" (UniqueName: \"kubernetes.io/projected/9be3f09a-cff8-4097-aac9-56033f182147-kube-api-access-bd7fh\") pod \"console-74cdbfc5d-87fjq\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:42.597223 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:42.597187 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:51:45.940909 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:45.940881 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:51:46.245846 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:51:46.245774 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411eaa81_989a_4693_8805_98451096721b.slice/crio-203edae4d0044ed2ff8e7bfc2ee7692888ce3aef28fb9e7eb7867bd6d1b0d54e WatchSource:0}: Error finding container 203edae4d0044ed2ff8e7bfc2ee7692888ce3aef28fb9e7eb7867bd6d1b0d54e: Status 404 returned error can't find the container with id 203edae4d0044ed2ff8e7bfc2ee7692888ce3aef28fb9e7eb7867bd6d1b0d54e Sep 10 00:51:46.803632 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:46.803602 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d74f956f-qfkt8"] Sep 10 00:51:46.806787 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:51:46.806763 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e85a9b_0d6b_4357_b896_c346134d8b43.slice/crio-8569e5965d4599c389dd3e2f767531ff8357bbaaf71dd5f69803b7230dcdd19f WatchSource:0}: Error finding container 8569e5965d4599c389dd3e2f767531ff8357bbaaf71dd5f69803b7230dcdd19f: Status 404 returned error can't find the container with id 8569e5965d4599c389dd3e2f767531ff8357bbaaf71dd5f69803b7230dcdd19f Sep 10 00:51:46.812349 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:46.812326 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f44cdff77-qkch5"] Sep 10 00:51:46.818645 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:46.818581 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74cdbfc5d-87fjq"] Sep 10 00:51:46.820641 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:51:46.820604 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be3f09a_cff8_4097_aac9_56033f182147.slice/crio-6deafd6c2c46d95bd6facf1101eae7eabf1eaa55f5458cbf42099fac2e15fe78 WatchSource:0}: Error finding container 6deafd6c2c46d95bd6facf1101eae7eabf1eaa55f5458cbf42099fac2e15fe78: Status 404 returned error can't find the container with id 6deafd6c2c46d95bd6facf1101eae7eabf1eaa55f5458cbf42099fac2e15fe78 Sep 10 00:51:46.821928 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:51:46.821875 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dff4ff7_87f4_4892_b811_162f7f256099.slice/crio-e444ef70b68892eb3ce0290996edab06b5a2d21e42f81fb50345046c26f01378 WatchSource:0}: Error finding container e444ef70b68892eb3ce0290996edab06b5a2d21e42f81fb50345046c26f01378: Status 404 returned error can't find the container with id e444ef70b68892eb3ce0290996edab06b5a2d21e42f81fb50345046c26f01378 Sep 10 00:51:46.822955 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:46.822933 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-89dcd698f-2jckf"] Sep 10 00:51:47.059012 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:47.058918 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" event={"ID":"6dff4ff7-87f4-4892-b811-162f7f256099","Type":"ContainerStarted","Data":"e444ef70b68892eb3ce0290996edab06b5a2d21e42f81fb50345046c26f01378"} Sep 10 00:51:47.060993 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:47.060959 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-wqn5x" event={"ID":"58f9776d-a47a-428e-9e08-4a80ff705aed","Type":"ContainerStarted","Data":"6c577ad86521f7a79eb2880062df3b6e98afabcc1a1a6fd0e96394c2f2631792"} Sep 10 00:51:47.061248 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:47.061194 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-wqn5x" Sep 10 00:51:47.062711 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:47.062682 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" event={"ID":"411eaa81-989a-4693-8805-98451096721b","Type":"ContainerStarted","Data":"203edae4d0044ed2ff8e7bfc2ee7692888ce3aef28fb9e7eb7867bd6d1b0d54e"} Sep 10 00:51:47.064723 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:47.064700 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerID="61725c9fb333dcb17b15e3e42b34c7f313a319568d214a28fb9d40e1f8823542" exitCode=0 Sep 10 00:51:47.064868 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:47.064780 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerDied","Data":"61725c9fb333dcb17b15e3e42b34c7f313a319568d214a28fb9d40e1f8823542"} Sep 10 00:51:47.066139 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:47.066119 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" event={"ID":"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1","Type":"ContainerStarted","Data":"f1618ff31b38e996d5d6a3799e3fe2bd3f1a21edb7f056d198d546870cf9fc0b"} Sep 10 00:51:47.067719 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:47.067695 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d74f956f-qfkt8" event={"ID":"84e85a9b-0d6b-4357-b896-c346134d8b43","Type":"ContainerStarted","Data":"8569e5965d4599c389dd3e2f767531ff8357bbaaf71dd5f69803b7230dcdd19f"} Sep 10 00:51:47.069101 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:47.069079 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74cdbfc5d-87fjq" event={"ID":"9be3f09a-cff8-4097-aac9-56033f182147","Type":"ContainerStarted","Data":"6deafd6c2c46d95bd6facf1101eae7eabf1eaa55f5458cbf42099fac2e15fe78"} Sep 10 00:51:47.077698 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:47.077679 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-wqn5x" Sep 10 00:51:47.088511 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:47.088471 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-wqn5x" podStartSLOduration=2.066856855 podStartE2EDuration="23.088457186s" totalImagesPullingTime="21.021600331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:47.086953087 +0000 UTC m=+90.037355210" watchObservedRunningTime="2026-09-10 00:51:47.088457186 +0000 UTC m=+90.038859313" Sep 10 00:51:49.973992 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:49.973961 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-84cc88496f-wks9z" Sep 10 00:51:50.957578 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:50.957508 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7795776d6f-4k82m" podUID="c14eedb9-50cd-4c46-ad0b-4db012506ceb" containerName="registry" containerID="cri-o://0bebc503571cda4460fe1709c0eff56e1e8fc55f6f4c59f75b3cf2feb33f29d6" gracePeriod=30 Sep 10 00:51:52.102170 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:52.102134 2567 generic.go:356] "Generic (PLEG): container finished" podID="c14eedb9-50cd-4c46-ad0b-4db012506ceb" containerID="0bebc503571cda4460fe1709c0eff56e1e8fc55f6f4c59f75b3cf2feb33f29d6" exitCode=0 Sep 10 00:51:52.102651 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:52.102202 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7795776d6f-4k82m" event={"ID":"c14eedb9-50cd-4c46-ad0b-4db012506ceb","Type":"ContainerDied","Data":"0bebc503571cda4460fe1709c0eff56e1e8fc55f6f4c59f75b3cf2feb33f29d6"} Sep 10 00:51:54.857550 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:54.857519 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:51:54.931150 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:54.931120 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mvqfv" Sep 10 00:51:55.048817 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.048788 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c14eedb9-50cd-4c46-ad0b-4db012506ceb-ca-trust-extracted\") pod \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " Sep 10 00:51:55.048987 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.048853 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls\") pod \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " Sep 10 00:51:55.048987 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.048887 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-certificates\") pod \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " Sep 10 00:51:55.048987 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.048920 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c14eedb9-50cd-4c46-ad0b-4db012506ceb-installation-pull-secrets\") pod \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " Sep 10 00:51:55.048987 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.048953 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c14eedb9-50cd-4c46-ad0b-4db012506ceb-trusted-ca\") pod \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " Sep 10 00:51:55.048987 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.048983 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c14eedb9-50cd-4c46-ad0b-4db012506ceb-image-registry-private-configuration\") pod \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " Sep 10 00:51:55.049249 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.049020 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8k2v\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-kube-api-access-z8k2v\") pod \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " Sep 10 00:51:55.049249 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.049050 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-bound-sa-token\") pod \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\" (UID: \"c14eedb9-50cd-4c46-ad0b-4db012506ceb\") " Sep 10 00:51:55.049605 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.049573 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c14eedb9-50cd-4c46-ad0b-4db012506ceb" (UID: "c14eedb9-50cd-4c46-ad0b-4db012506ceb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:51:55.049985 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.049697 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c14eedb9-50cd-4c46-ad0b-4db012506ceb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c14eedb9-50cd-4c46-ad0b-4db012506ceb" (UID: "c14eedb9-50cd-4c46-ad0b-4db012506ceb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:51:55.052000 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.051943 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c14eedb9-50cd-4c46-ad0b-4db012506ceb" (UID: "c14eedb9-50cd-4c46-ad0b-4db012506ceb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:51:55.052134 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.052102 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c14eedb9-50cd-4c46-ad0b-4db012506ceb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c14eedb9-50cd-4c46-ad0b-4db012506ceb" (UID: "c14eedb9-50cd-4c46-ad0b-4db012506ceb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:51:55.052575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.052539 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c14eedb9-50cd-4c46-ad0b-4db012506ceb" (UID: "c14eedb9-50cd-4c46-ad0b-4db012506ceb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:51:55.052764 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.052738 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-kube-api-access-z8k2v" (OuterVolumeSpecName: "kube-api-access-z8k2v") pod "c14eedb9-50cd-4c46-ad0b-4db012506ceb" (UID: "c14eedb9-50cd-4c46-ad0b-4db012506ceb"). InnerVolumeSpecName "kube-api-access-z8k2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:51:55.052863 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.052808 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c14eedb9-50cd-4c46-ad0b-4db012506ceb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c14eedb9-50cd-4c46-ad0b-4db012506ceb" (UID: "c14eedb9-50cd-4c46-ad0b-4db012506ceb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:51:55.059727 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.059674 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14eedb9-50cd-4c46-ad0b-4db012506ceb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c14eedb9-50cd-4c46-ad0b-4db012506ceb" (UID: "c14eedb9-50cd-4c46-ad0b-4db012506ceb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:51:55.118136 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.118105 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7795776d6f-4k82m" Sep 10 00:51:55.118230 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.118102 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7795776d6f-4k82m" event={"ID":"c14eedb9-50cd-4c46-ad0b-4db012506ceb","Type":"ContainerDied","Data":"aaa80e052277db99fbf80c6547b0f75ff57ed73115b9aa5e005aec5c09b5e175"} Sep 10 00:51:55.118293 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.118249 2567 scope.go:117] "RemoveContainer" containerID="0bebc503571cda4460fe1709c0eff56e1e8fc55f6f4c59f75b3cf2feb33f29d6" Sep 10 00:51:55.147203 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.147173 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7795776d6f-4k82m"] Sep 10 00:51:55.149820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.149749 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c14eedb9-50cd-4c46-ad0b-4db012506ceb-installation-pull-secrets\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:51:55.149820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.149803 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c14eedb9-50cd-4c46-ad0b-4db012506ceb-trusted-ca\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:51:55.149820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.149818 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c14eedb9-50cd-4c46-ad0b-4db012506ceb-image-registry-private-configuration\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:51:55.150084 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.149833 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8k2v\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-kube-api-access-z8k2v\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:51:55.150084 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.149846 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-bound-sa-token\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:51:55.150084 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.149858 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c14eedb9-50cd-4c46-ad0b-4db012506ceb-ca-trust-extracted\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:51:55.150084 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.149870 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-tls\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:51:55.150084 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.149883 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c14eedb9-50cd-4c46-ad0b-4db012506ceb-registry-certificates\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:51:55.151885 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.151868 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7795776d6f-4k82m"] Sep 10 00:51:55.528087 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:55.528060 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c14eedb9-50cd-4c46-ad0b-4db012506ceb" path="/var/lib/kubelet/pods/c14eedb9-50cd-4c46-ad0b-4db012506ceb/volumes" Sep 10 00:51:56.124781 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.124749 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" event={"ID":"411eaa81-989a-4693-8805-98451096721b","Type":"ContainerStarted","Data":"12e507918876f2c90e9af982925b562e55d579a66d0c5eed5b2e23f884be8f12"} Sep 10 00:51:56.125268 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.124822 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" event={"ID":"411eaa81-989a-4693-8805-98451096721b","Type":"ContainerStarted","Data":"d56e42cdc3f7926fb186872370e9f59c3669d29861defbe015e7935c7082a0f6"} Sep 10 00:51:56.125268 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.124854 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" event={"ID":"411eaa81-989a-4693-8805-98451096721b","Type":"ContainerStarted","Data":"3451d91223d17c3abdc0dd7e87b476b3637fa9c80970e0545d53e9c42cb13597"} Sep 10 00:51:56.127940 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.127916 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerStarted","Data":"ad0466bf7804dac01be136bc294be025f5dbd4b8169d38576270bbb0d23d7680"} Sep 10 00:51:56.128043 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.127968 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerStarted","Data":"25da4e7d561db448fa452897ac47fb961ba15d45fe0f69b4b61dc6115bab1e6f"} Sep 10 00:51:56.128043 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.128002 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerStarted","Data":"d3a9517b73006b66136e19bea1b935f945b0e098ff9fad3edfddc960c56b2ffb"} Sep 10 00:51:56.128043 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.128036 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerStarted","Data":"43bb9ac38115eaec81a7f014b5ae4f7865ec4d08001bb41965835e44145b967e"} Sep 10 00:51:56.128166 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.128065 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerStarted","Data":"fa583d45036d9472689b87f718ccb55eee61462811d7199e5601083e7f9b4559"} Sep 10 00:51:56.130047 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.130024 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" event={"ID":"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1","Type":"ContainerStarted","Data":"15d40c2cba7e57bce327ea590fc743cc5f020776a7986ebb879526c5f0ecd5c6"} Sep 10 00:51:56.130135 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.130066 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" event={"ID":"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1","Type":"ContainerStarted","Data":"039cf323c4b9052184971e98420bf27d04c4ee8e944ed2a1cd38f97bfb31c1bc"} Sep 10 00:51:56.130135 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.130093 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" event={"ID":"3c41fc6a-5899-4abd-9fa1-6acc62ec95d1","Type":"ContainerStarted","Data":"98626190d3d78e39c35cc33b0c9fb4f48cbae77d1701afcb43b07d9912ae2dd7"} Sep 10 00:51:56.131663 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.131620 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d74f956f-qfkt8" event={"ID":"84e85a9b-0d6b-4357-b896-c346134d8b43","Type":"ContainerStarted","Data":"77fa40ddce3b89d79af6c36249bd6ff84fbe099a78942f35cdb137b84225b918"} Sep 10 00:51:56.133217 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.133199 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74cdbfc5d-87fjq" event={"ID":"9be3f09a-cff8-4097-aac9-56033f182147","Type":"ContainerStarted","Data":"08c509468aa76608bac2e77ea86ffdb6e60ef802469e2f9149dcb22e619ef314"} Sep 10 00:51:56.135471 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.135450 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" event={"ID":"6dff4ff7-87f4-4892-b811-162f7f256099","Type":"ContainerStarted","Data":"279a48a0d5709b2dece19acab90fd2857d7b8a6be535ed79b477f3cc21168482"} Sep 10 00:51:56.152864 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.152821 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-89dcd698f-2jckf" podStartSLOduration=6.896528281 podStartE2EDuration="15.152808068s" totalImagesPullingTime="8.256279787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:56.150226613 +0000 UTC m=+99.100628733" watchObservedRunningTime="2026-09-10 00:51:56.152808068 +0000 UTC m=+99.103210205" Sep 10 00:51:56.167934 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.167887 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65d74f956f-qfkt8" podStartSLOduration=9.893250428 podStartE2EDuration="18.167873592s" totalImagesPullingTime="8.274623164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:56.167727599 +0000 UTC m=+99.118129723" watchObservedRunningTime="2026-09-10 00:51:56.167873592 +0000 UTC m=+99.118275691" Sep 10 00:51:56.188268 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.188226 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74cdbfc5d-87fjq" podStartSLOduration=5.920135098 podStartE2EDuration="14.18821314s" totalImagesPullingTime="8.268078042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:51:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:56.187538325 +0000 UTC m=+99.137940438" watchObservedRunningTime="2026-09-10 00:51:56.18821314 +0000 UTC m=+99.138615261" Sep 10 00:51:56.205238 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.205198 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" podStartSLOduration=7.945964823 podStartE2EDuration="16.20518566s" totalImagesPullingTime="8.259220837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:56.204668083 +0000 UTC m=+99.155070230" watchObservedRunningTime="2026-09-10 00:51:56.20518566 +0000 UTC m=+99.155587781" Sep 10 00:51:56.246638 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:56.246601 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d74f956f-qfkt8"] Sep 10 00:51:58.147185 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:58.147145 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" event={"ID":"411eaa81-989a-4693-8805-98451096721b","Type":"ContainerStarted","Data":"cbb369978f8ff6110abd848f7e939b6cc8342d5dca2b2a4636b5821a2a68bb50"} Sep 10 00:51:58.147742 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:58.147209 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" event={"ID":"411eaa81-989a-4693-8805-98451096721b","Type":"ContainerStarted","Data":"58c520bb1bb4e870f7d03b2b647da7df9f5d6f12f0c976f3458c60d3934831ef"} Sep 10 00:51:58.147742 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:58.147245 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" event={"ID":"411eaa81-989a-4693-8805-98451096721b","Type":"ContainerStarted","Data":"a86fe54f227fb8b9b57f1d1506cbc86d8f3747650e7ab61ab8ff6406d4f67769"} Sep 10 00:51:58.147742 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:58.147316 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:51:58.150709 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:58.150684 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerStarted","Data":"bceeaf2d97eea825942a301d9099b1cddf4ee29b598ff7b3f9093c2baa36e96a"} Sep 10 00:51:58.178799 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:58.173882 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" podStartSLOduration=9.895307549 podStartE2EDuration="20.173863416s" totalImagesPullingTime="10.278555867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:51:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:58.17190315 +0000 UTC m=+101.122305284" watchObservedRunningTime="2026-09-10 00:51:58.173863416 +0000 UTC m=+101.124265539" Sep 10 00:51:58.204054 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:58.204012 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.175100083 podStartE2EDuration="21.203997736s" totalImagesPullingTime="17.008248324s" totalInitContainerRuntime="20.649329ms" isStatefulPod=false podCreationTimestamp="2026-09-10 00:51:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:51:58.201665744 +0000 UTC m=+101.152067869" watchObservedRunningTime="2026-09-10 00:51:58.203997736 +0000 UTC m=+101.154399856" Sep 10 00:51:59.152181 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:51:59.152150 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:52:01.303174 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:01.303131 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:52:01.303673 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:01.303210 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:52:02.598185 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:02.598145 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:52:02.598705 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:02.598248 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:52:02.603255 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:02.603234 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:52:03.175685 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:03.175656 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:52:04.161642 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:04.161612 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5d6cf59c49-bf5rn" Sep 10 00:52:04.592525 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:04.592504 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-587b6fb4b6-v9vlg_5bc421f3-3586-4513-9aaf-9c354af84cf6/router/0.log" Sep 10 00:52:04.601871 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:04.601850 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dmrkj_c11ce5f8-8d74-4158-9702-24fba4e2b2e4/serve-healthcheck-canary/0.log" Sep 10 00:52:06.806612 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:06.806580 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74cdbfc5d-87fjq"] Sep 10 00:52:09.200177 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:09.200146 2567 generic.go:356] "Generic (PLEG): container finished" podID="1fc14129-390a-444d-a5d4-2006d4eaaf82" containerID="286ce3c89d3aa6f08424b784731f3284a90c6a9970ba63dcc5f619fee4257fb6" exitCode=0 Sep 10 00:52:09.200586 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:09.200208 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" event={"ID":"1fc14129-390a-444d-a5d4-2006d4eaaf82","Type":"ContainerDied","Data":"286ce3c89d3aa6f08424b784731f3284a90c6a9970ba63dcc5f619fee4257fb6"} Sep 10 00:52:09.200586 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:09.200573 2567 scope.go:117] "RemoveContainer" containerID="286ce3c89d3aa6f08424b784731f3284a90c6a9970ba63dcc5f619fee4257fb6" Sep 10 00:52:10.206005 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:10.205972 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c6qn2" event={"ID":"1fc14129-390a-444d-a5d4-2006d4eaaf82","Type":"ContainerStarted","Data":"602a4f4ec102549a29eb87b87b07bf789b17c00848b62bea8e0220a8772c4f1e"} Sep 10 00:52:21.308570 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:21.308536 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:52:21.312257 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:21.312237 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f44cdff77-qkch5" Sep 10 00:52:23.170207 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.170151 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65d74f956f-qfkt8" podUID="84e85a9b-0d6b-4357-b896-c346134d8b43" containerName="console" containerID="cri-o://77fa40ddce3b89d79af6c36249bd6ff84fbe099a78942f35cdb137b84225b918" gracePeriod=15 Sep 10 00:52:23.456354 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.456325 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:52:23.615039 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.614998 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84e85a9b-0d6b-4357-b896-c346134d8b43-console-oauth-config\") pod \"84e85a9b-0d6b-4357-b896-c346134d8b43\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " Sep 10 00:52:23.615039 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.615036 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-trusted-ca-bundle\") pod \"84e85a9b-0d6b-4357-b896-c346134d8b43\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " Sep 10 00:52:23.615273 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.615059 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-console-config\") pod \"84e85a9b-0d6b-4357-b896-c346134d8b43\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " Sep 10 00:52:23.615273 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.615108 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv6cj\" (UniqueName: \"kubernetes.io/projected/84e85a9b-0d6b-4357-b896-c346134d8b43-kube-api-access-jv6cj\") pod \"84e85a9b-0d6b-4357-b896-c346134d8b43\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " Sep 10 00:52:23.615273 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.615128 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84e85a9b-0d6b-4357-b896-c346134d8b43-console-serving-cert\") pod \"84e85a9b-0d6b-4357-b896-c346134d8b43\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " Sep 10 00:52:23.615273 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.615153 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-oauth-serving-cert\") pod \"84e85a9b-0d6b-4357-b896-c346134d8b43\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " Sep 10 00:52:23.615273 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.615190 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-service-ca\") pod \"84e85a9b-0d6b-4357-b896-c346134d8b43\" (UID: \"84e85a9b-0d6b-4357-b896-c346134d8b43\") " Sep 10 00:52:23.615626 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.615589 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "84e85a9b-0d6b-4357-b896-c346134d8b43" (UID: "84e85a9b-0d6b-4357-b896-c346134d8b43"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:52:23.615716 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.615640 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "84e85a9b-0d6b-4357-b896-c346134d8b43" (UID: "84e85a9b-0d6b-4357-b896-c346134d8b43"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:52:23.615716 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.615660 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-console-config" (OuterVolumeSpecName: "console-config") pod "84e85a9b-0d6b-4357-b896-c346134d8b43" (UID: "84e85a9b-0d6b-4357-b896-c346134d8b43"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:52:23.615716 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.615698 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-service-ca" (OuterVolumeSpecName: "service-ca") pod "84e85a9b-0d6b-4357-b896-c346134d8b43" (UID: "84e85a9b-0d6b-4357-b896-c346134d8b43"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:52:23.617619 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.617590 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84e85a9b-0d6b-4357-b896-c346134d8b43-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "84e85a9b-0d6b-4357-b896-c346134d8b43" (UID: "84e85a9b-0d6b-4357-b896-c346134d8b43"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:52:23.617700 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.617617 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84e85a9b-0d6b-4357-b896-c346134d8b43-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "84e85a9b-0d6b-4357-b896-c346134d8b43" (UID: "84e85a9b-0d6b-4357-b896-c346134d8b43"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:52:23.617700 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.617663 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84e85a9b-0d6b-4357-b896-c346134d8b43-kube-api-access-jv6cj" (OuterVolumeSpecName: "kube-api-access-jv6cj") pod "84e85a9b-0d6b-4357-b896-c346134d8b43" (UID: "84e85a9b-0d6b-4357-b896-c346134d8b43"). InnerVolumeSpecName "kube-api-access-jv6cj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:52:23.715891 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.715808 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv6cj\" (UniqueName: \"kubernetes.io/projected/84e85a9b-0d6b-4357-b896-c346134d8b43-kube-api-access-jv6cj\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:23.715891 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.715838 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84e85a9b-0d6b-4357-b896-c346134d8b43-console-serving-cert\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:23.715891 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.715847 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-oauth-serving-cert\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:23.715891 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.715856 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-service-ca\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:23.715891 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.715865 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84e85a9b-0d6b-4357-b896-c346134d8b43-console-oauth-config\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:23.715891 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.715873 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-trusted-ca-bundle\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:23.715891 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:23.715881 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84e85a9b-0d6b-4357-b896-c346134d8b43-console-config\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:24.266592 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:24.266562 2567 generic.go:356] "Generic (PLEG): container finished" podID="84e85a9b-0d6b-4357-b896-c346134d8b43" containerID="77fa40ddce3b89d79af6c36249bd6ff84fbe099a78942f35cdb137b84225b918" exitCode=0 Sep 10 00:52:24.266983 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:24.266608 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d74f956f-qfkt8" Sep 10 00:52:24.266983 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:24.266620 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d74f956f-qfkt8" event={"ID":"84e85a9b-0d6b-4357-b896-c346134d8b43","Type":"ContainerDied","Data":"77fa40ddce3b89d79af6c36249bd6ff84fbe099a78942f35cdb137b84225b918"} Sep 10 00:52:24.266983 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:24.266657 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d74f956f-qfkt8" event={"ID":"84e85a9b-0d6b-4357-b896-c346134d8b43","Type":"ContainerDied","Data":"8569e5965d4599c389dd3e2f767531ff8357bbaaf71dd5f69803b7230dcdd19f"} Sep 10 00:52:24.266983 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:24.266676 2567 scope.go:117] "RemoveContainer" containerID="77fa40ddce3b89d79af6c36249bd6ff84fbe099a78942f35cdb137b84225b918" Sep 10 00:52:24.275334 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:24.275316 2567 scope.go:117] "RemoveContainer" containerID="77fa40ddce3b89d79af6c36249bd6ff84fbe099a78942f35cdb137b84225b918" Sep 10 00:52:24.275681 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:52:24.275659 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77fa40ddce3b89d79af6c36249bd6ff84fbe099a78942f35cdb137b84225b918\": container with ID starting with 77fa40ddce3b89d79af6c36249bd6ff84fbe099a78942f35cdb137b84225b918 not found: ID does not exist" containerID="77fa40ddce3b89d79af6c36249bd6ff84fbe099a78942f35cdb137b84225b918" Sep 10 00:52:24.275741 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:24.275693 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77fa40ddce3b89d79af6c36249bd6ff84fbe099a78942f35cdb137b84225b918"} err="failed to get container status \"77fa40ddce3b89d79af6c36249bd6ff84fbe099a78942f35cdb137b84225b918\": rpc error: code = NotFound desc = could not find container \"77fa40ddce3b89d79af6c36249bd6ff84fbe099a78942f35cdb137b84225b918\": container with ID starting with 77fa40ddce3b89d79af6c36249bd6ff84fbe099a78942f35cdb137b84225b918 not found: ID does not exist" Sep 10 00:52:24.287194 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:24.287169 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d74f956f-qfkt8"] Sep 10 00:52:24.291133 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:24.291110 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65d74f956f-qfkt8"] Sep 10 00:52:25.526172 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:25.526131 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84e85a9b-0d6b-4357-b896-c346134d8b43" path="/var/lib/kubelet/pods/84e85a9b-0d6b-4357-b896-c346134d8b43/volumes" Sep 10 00:52:31.826866 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:31.826807 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74cdbfc5d-87fjq" podUID="9be3f09a-cff8-4097-aac9-56033f182147" containerName="console" containerID="cri-o://08c509468aa76608bac2e77ea86ffdb6e60ef802469e2f9149dcb22e619ef314" gracePeriod=15 Sep 10 00:52:32.096360 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.096333 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:52:32.190078 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.190045 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-trusted-ca-bundle\") pod \"9be3f09a-cff8-4097-aac9-56033f182147\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " Sep 10 00:52:32.190078 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.190085 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9be3f09a-cff8-4097-aac9-56033f182147-console-serving-cert\") pod \"9be3f09a-cff8-4097-aac9-56033f182147\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " Sep 10 00:52:32.190287 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.190120 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-console-config\") pod \"9be3f09a-cff8-4097-aac9-56033f182147\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " Sep 10 00:52:32.190287 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.190167 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd7fh\" (UniqueName: \"kubernetes.io/projected/9be3f09a-cff8-4097-aac9-56033f182147-kube-api-access-bd7fh\") pod \"9be3f09a-cff8-4097-aac9-56033f182147\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " Sep 10 00:52:32.190287 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.190210 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-service-ca\") pod \"9be3f09a-cff8-4097-aac9-56033f182147\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " Sep 10 00:52:32.190287 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.190235 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9be3f09a-cff8-4097-aac9-56033f182147-console-oauth-config\") pod \"9be3f09a-cff8-4097-aac9-56033f182147\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " Sep 10 00:52:32.190287 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.190265 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-oauth-serving-cert\") pod \"9be3f09a-cff8-4097-aac9-56033f182147\" (UID: \"9be3f09a-cff8-4097-aac9-56033f182147\") " Sep 10 00:52:32.190618 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.190590 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9be3f09a-cff8-4097-aac9-56033f182147" (UID: "9be3f09a-cff8-4097-aac9-56033f182147"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:52:32.190731 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.190662 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-service-ca" (OuterVolumeSpecName: "service-ca") pod "9be3f09a-cff8-4097-aac9-56033f182147" (UID: "9be3f09a-cff8-4097-aac9-56033f182147"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:52:32.190790 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.190747 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-console-config" (OuterVolumeSpecName: "console-config") pod "9be3f09a-cff8-4097-aac9-56033f182147" (UID: "9be3f09a-cff8-4097-aac9-56033f182147"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:52:32.191047 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.190977 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9be3f09a-cff8-4097-aac9-56033f182147" (UID: "9be3f09a-cff8-4097-aac9-56033f182147"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:52:32.192436 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.192361 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9be3f09a-cff8-4097-aac9-56033f182147-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9be3f09a-cff8-4097-aac9-56033f182147" (UID: "9be3f09a-cff8-4097-aac9-56033f182147"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:52:32.192521 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.192499 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9be3f09a-cff8-4097-aac9-56033f182147-kube-api-access-bd7fh" (OuterVolumeSpecName: "kube-api-access-bd7fh") pod "9be3f09a-cff8-4097-aac9-56033f182147" (UID: "9be3f09a-cff8-4097-aac9-56033f182147"). InnerVolumeSpecName "kube-api-access-bd7fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:52:32.192564 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.192528 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9be3f09a-cff8-4097-aac9-56033f182147-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9be3f09a-cff8-4097-aac9-56033f182147" (UID: "9be3f09a-cff8-4097-aac9-56033f182147"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:52:32.290975 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.290943 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd7fh\" (UniqueName: \"kubernetes.io/projected/9be3f09a-cff8-4097-aac9-56033f182147-kube-api-access-bd7fh\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:32.290975 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.290970 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-service-ca\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:32.290975 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.290981 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9be3f09a-cff8-4097-aac9-56033f182147-console-oauth-config\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:32.291174 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.290990 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-oauth-serving-cert\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:32.291174 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.290998 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-trusted-ca-bundle\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:32.291174 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.291006 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9be3f09a-cff8-4097-aac9-56033f182147-console-serving-cert\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:32.291174 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.291015 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9be3f09a-cff8-4097-aac9-56033f182147-console-config\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:32.302550 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.302519 2567 generic.go:356] "Generic (PLEG): container finished" podID="9be3f09a-cff8-4097-aac9-56033f182147" containerID="08c509468aa76608bac2e77ea86ffdb6e60ef802469e2f9149dcb22e619ef314" exitCode=0 Sep 10 00:52:32.302660 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.302572 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74cdbfc5d-87fjq" Sep 10 00:52:32.302660 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.302584 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74cdbfc5d-87fjq" event={"ID":"9be3f09a-cff8-4097-aac9-56033f182147","Type":"ContainerDied","Data":"08c509468aa76608bac2e77ea86ffdb6e60ef802469e2f9149dcb22e619ef314"} Sep 10 00:52:32.302660 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.302637 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74cdbfc5d-87fjq" event={"ID":"9be3f09a-cff8-4097-aac9-56033f182147","Type":"ContainerDied","Data":"6deafd6c2c46d95bd6facf1101eae7eabf1eaa55f5458cbf42099fac2e15fe78"} Sep 10 00:52:32.302757 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.302677 2567 scope.go:117] "RemoveContainer" containerID="08c509468aa76608bac2e77ea86ffdb6e60ef802469e2f9149dcb22e619ef314" Sep 10 00:52:32.311948 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.311929 2567 scope.go:117] "RemoveContainer" containerID="08c509468aa76608bac2e77ea86ffdb6e60ef802469e2f9149dcb22e619ef314" Sep 10 00:52:32.312254 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:52:32.312234 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08c509468aa76608bac2e77ea86ffdb6e60ef802469e2f9149dcb22e619ef314\": container with ID starting with 08c509468aa76608bac2e77ea86ffdb6e60ef802469e2f9149dcb22e619ef314 not found: ID does not exist" containerID="08c509468aa76608bac2e77ea86ffdb6e60ef802469e2f9149dcb22e619ef314" Sep 10 00:52:32.312295 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.312262 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08c509468aa76608bac2e77ea86ffdb6e60ef802469e2f9149dcb22e619ef314"} err="failed to get container status \"08c509468aa76608bac2e77ea86ffdb6e60ef802469e2f9149dcb22e619ef314\": rpc error: code = NotFound desc = could not find container \"08c509468aa76608bac2e77ea86ffdb6e60ef802469e2f9149dcb22e619ef314\": container with ID starting with 08c509468aa76608bac2e77ea86ffdb6e60ef802469e2f9149dcb22e619ef314 not found: ID does not exist" Sep 10 00:52:32.327060 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.327033 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74cdbfc5d-87fjq"] Sep 10 00:52:32.331126 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:32.331103 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74cdbfc5d-87fjq"] Sep 10 00:52:33.526069 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:33.526036 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9be3f09a-cff8-4097-aac9-56033f182147" path="/var/lib/kubelet/pods/9be3f09a-cff8-4097-aac9-56033f182147/volumes" Sep 10 00:52:56.835819 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:56.835782 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 00:52:56.836248 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:56.836067 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="alertmanager" containerID="cri-o://fa583d45036d9472689b87f718ccb55eee61462811d7199e5601083e7f9b4559" gracePeriod=120 Sep 10 00:52:56.836248 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:56.836142 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="kube-rbac-proxy-metric" containerID="cri-o://ad0466bf7804dac01be136bc294be025f5dbd4b8169d38576270bbb0d23d7680" gracePeriod=120 Sep 10 00:52:56.836248 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:56.836166 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="kube-rbac-proxy-web" containerID="cri-o://d3a9517b73006b66136e19bea1b935f945b0e098ff9fad3edfddc960c56b2ffb" gracePeriod=120 Sep 10 00:52:56.836248 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:56.836221 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="prom-label-proxy" containerID="cri-o://bceeaf2d97eea825942a301d9099b1cddf4ee29b598ff7b3f9093c2baa36e96a" gracePeriod=120 Sep 10 00:52:56.836248 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:56.836183 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="config-reloader" containerID="cri-o://43bb9ac38115eaec81a7f014b5ae4f7865ec4d08001bb41965835e44145b967e" gracePeriod=120 Sep 10 00:52:56.836589 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:56.836247 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="kube-rbac-proxy" containerID="cri-o://25da4e7d561db448fa452897ac47fb961ba15d45fe0f69b4b61dc6115bab1e6f" gracePeriod=120 Sep 10 00:52:57.402962 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:57.402929 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerID="bceeaf2d97eea825942a301d9099b1cddf4ee29b598ff7b3f9093c2baa36e96a" exitCode=0 Sep 10 00:52:57.402962 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:57.402954 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerID="ad0466bf7804dac01be136bc294be025f5dbd4b8169d38576270bbb0d23d7680" exitCode=0 Sep 10 00:52:57.402962 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:57.402961 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerID="25da4e7d561db448fa452897ac47fb961ba15d45fe0f69b4b61dc6115bab1e6f" exitCode=0 Sep 10 00:52:57.402962 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:57.402966 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerID="43bb9ac38115eaec81a7f014b5ae4f7865ec4d08001bb41965835e44145b967e" exitCode=0 Sep 10 00:52:57.402962 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:57.402971 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerID="fa583d45036d9472689b87f718ccb55eee61462811d7199e5601083e7f9b4559" exitCode=0 Sep 10 00:52:57.403246 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:57.402998 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerDied","Data":"bceeaf2d97eea825942a301d9099b1cddf4ee29b598ff7b3f9093c2baa36e96a"} Sep 10 00:52:57.403246 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:57.403057 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerDied","Data":"ad0466bf7804dac01be136bc294be025f5dbd4b8169d38576270bbb0d23d7680"} Sep 10 00:52:57.403246 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:57.403083 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerDied","Data":"25da4e7d561db448fa452897ac47fb961ba15d45fe0f69b4b61dc6115bab1e6f"} Sep 10 00:52:57.403246 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:57.403107 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerDied","Data":"43bb9ac38115eaec81a7f014b5ae4f7865ec4d08001bb41965835e44145b967e"} Sep 10 00:52:57.403246 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:57.403132 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerDied","Data":"fa583d45036d9472689b87f718ccb55eee61462811d7199e5601083e7f9b4559"} Sep 10 00:52:58.081865 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.081843 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.204019 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.203935 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-metrics-client-ca\") pod \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " Sep 10 00:52:58.204019 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.203995 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-web-config\") pod \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " Sep 10 00:52:58.204019 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.204012 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-config-out\") pod \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " Sep 10 00:52:58.204337 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.204032 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-tls-assets\") pod \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " Sep 10 00:52:58.204337 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.204145 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-cluster-tls-config\") pod \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " Sep 10 00:52:58.204337 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.204178 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-main-tls\") pod \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " Sep 10 00:52:58.204337 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.204203 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-config-volume\") pod \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " Sep 10 00:52:58.204337 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.204227 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy\") pod \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " Sep 10 00:52:58.204337 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.204286 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy-web\") pod \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " Sep 10 00:52:58.204337 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.204317 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-main-db\") pod \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " Sep 10 00:52:58.204337 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.204324 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:52:58.204764 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.204348 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " Sep 10 00:52:58.204764 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.204411 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4kzx\" (UniqueName: \"kubernetes.io/projected/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-kube-api-access-s4kzx\") pod \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " Sep 10 00:52:58.204764 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.204460 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-trusted-ca-bundle\") pod \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\" (UID: \"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf\") " Sep 10 00:52:58.204917 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.204869 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-metrics-client-ca\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:58.204971 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.204920 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:52:58.205223 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.205198 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:52:58.207143 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.207110 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-config-out" (OuterVolumeSpecName: "config-out") pod "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:52:58.207511 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.207486 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:52:58.207949 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.207918 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:52:58.208029 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.207965 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:52:58.208430 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.208376 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:52:58.208822 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.208795 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-kube-api-access-s4kzx" (OuterVolumeSpecName: "kube-api-access-s4kzx") pod "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf"). InnerVolumeSpecName "kube-api-access-s4kzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:52:58.208997 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.208969 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-config-volume" (OuterVolumeSpecName: "config-volume") pod "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:52:58.209163 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.209145 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:52:58.211855 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.211831 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:52:58.218088 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.218061 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-web-config" (OuterVolumeSpecName: "web-config") pod "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" (UID: "1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:52:58.306182 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.306144 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-main-tls\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:58.306182 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.306175 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-config-volume\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:58.306182 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.306189 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:58.306435 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.306202 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:58.306435 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.306218 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-main-db\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:58.306435 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.306229 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:58.306435 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.306242 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4kzx\" (UniqueName: \"kubernetes.io/projected/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-kube-api-access-s4kzx\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:58.306435 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.306254 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:58.306435 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.306265 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-web-config\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:58.306435 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.306275 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-config-out\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:58.306435 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.306287 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-tls-assets\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:58.306435 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.306298 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf-cluster-tls-config\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:52:58.410366 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.410329 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerID="d3a9517b73006b66136e19bea1b935f945b0e098ff9fad3edfddc960c56b2ffb" exitCode=0 Sep 10 00:52:58.410538 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.410374 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerDied","Data":"d3a9517b73006b66136e19bea1b935f945b0e098ff9fad3edfddc960c56b2ffb"} Sep 10 00:52:58.410538 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.410447 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.410538 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.410468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf","Type":"ContainerDied","Data":"28b1ccc95a498234d52969e326776bd89f54b3043f680123d8db932e60df69f0"} Sep 10 00:52:58.410538 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.410518 2567 scope.go:117] "RemoveContainer" containerID="bceeaf2d97eea825942a301d9099b1cddf4ee29b598ff7b3f9093c2baa36e96a" Sep 10 00:52:58.420846 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.420826 2567 scope.go:117] "RemoveContainer" containerID="ad0466bf7804dac01be136bc294be025f5dbd4b8169d38576270bbb0d23d7680" Sep 10 00:52:58.428192 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.428173 2567 scope.go:117] "RemoveContainer" containerID="25da4e7d561db448fa452897ac47fb961ba15d45fe0f69b4b61dc6115bab1e6f" Sep 10 00:52:58.434503 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.434482 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 00:52:58.435540 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.435517 2567 scope.go:117] "RemoveContainer" containerID="d3a9517b73006b66136e19bea1b935f945b0e098ff9fad3edfddc960c56b2ffb" Sep 10 00:52:58.441224 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.441202 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 00:52:58.442835 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.442817 2567 scope.go:117] "RemoveContainer" containerID="43bb9ac38115eaec81a7f014b5ae4f7865ec4d08001bb41965835e44145b967e" Sep 10 00:52:58.449754 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.449738 2567 scope.go:117] "RemoveContainer" containerID="fa583d45036d9472689b87f718ccb55eee61462811d7199e5601083e7f9b4559" Sep 10 00:52:58.456537 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.456522 2567 scope.go:117] "RemoveContainer" containerID="61725c9fb333dcb17b15e3e42b34c7f313a319568d214a28fb9d40e1f8823542" Sep 10 00:52:58.463544 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.463526 2567 scope.go:117] "RemoveContainer" containerID="bceeaf2d97eea825942a301d9099b1cddf4ee29b598ff7b3f9093c2baa36e96a" Sep 10 00:52:58.463803 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:52:58.463785 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bceeaf2d97eea825942a301d9099b1cddf4ee29b598ff7b3f9093c2baa36e96a\": container with ID starting with bceeaf2d97eea825942a301d9099b1cddf4ee29b598ff7b3f9093c2baa36e96a not found: ID does not exist" containerID="bceeaf2d97eea825942a301d9099b1cddf4ee29b598ff7b3f9093c2baa36e96a" Sep 10 00:52:58.463882 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.463814 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bceeaf2d97eea825942a301d9099b1cddf4ee29b598ff7b3f9093c2baa36e96a"} err="failed to get container status \"bceeaf2d97eea825942a301d9099b1cddf4ee29b598ff7b3f9093c2baa36e96a\": rpc error: code = NotFound desc = could not find container \"bceeaf2d97eea825942a301d9099b1cddf4ee29b598ff7b3f9093c2baa36e96a\": container with ID starting with bceeaf2d97eea825942a301d9099b1cddf4ee29b598ff7b3f9093c2baa36e96a not found: ID does not exist" Sep 10 00:52:58.463882 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.463838 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 00:52:58.464018 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.463840 2567 scope.go:117] "RemoveContainer" containerID="ad0466bf7804dac01be136bc294be025f5dbd4b8169d38576270bbb0d23d7680" Sep 10 00:52:58.464140 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464124 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="alertmanager" Sep 10 00:52:58.464140 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464141 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="alertmanager" Sep 10 00:52:58.464255 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464149 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="kube-rbac-proxy" Sep 10 00:52:58.464255 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464155 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="kube-rbac-proxy" Sep 10 00:52:58.464255 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464162 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="kube-rbac-proxy-metric" Sep 10 00:52:58.464255 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464167 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="kube-rbac-proxy-metric" Sep 10 00:52:58.464255 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464175 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="prom-label-proxy" Sep 10 00:52:58.464255 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464184 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="prom-label-proxy" Sep 10 00:52:58.464255 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464199 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="init-config-reloader" Sep 10 00:52:58.464255 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:52:58.464191 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad0466bf7804dac01be136bc294be025f5dbd4b8169d38576270bbb0d23d7680\": container with ID starting with ad0466bf7804dac01be136bc294be025f5dbd4b8169d38576270bbb0d23d7680 not found: ID does not exist" containerID="ad0466bf7804dac01be136bc294be025f5dbd4b8169d38576270bbb0d23d7680" Sep 10 00:52:58.464255 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464249 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad0466bf7804dac01be136bc294be025f5dbd4b8169d38576270bbb0d23d7680"} err="failed to get container status \"ad0466bf7804dac01be136bc294be025f5dbd4b8169d38576270bbb0d23d7680\": rpc error: code = NotFound desc = could not find container \"ad0466bf7804dac01be136bc294be025f5dbd4b8169d38576270bbb0d23d7680\": container with ID starting with ad0466bf7804dac01be136bc294be025f5dbd4b8169d38576270bbb0d23d7680 not found: ID does not exist" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464265 2567 scope.go:117] "RemoveContainer" containerID="25da4e7d561db448fa452897ac47fb961ba15d45fe0f69b4b61dc6115bab1e6f" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464205 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="init-config-reloader" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464297 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="config-reloader" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464302 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="config-reloader" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464310 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9be3f09a-cff8-4097-aac9-56033f182147" containerName="console" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464315 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9be3f09a-cff8-4097-aac9-56033f182147" containerName="console" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464322 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="kube-rbac-proxy-web" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464326 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="kube-rbac-proxy-web" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464333 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84e85a9b-0d6b-4357-b896-c346134d8b43" containerName="console" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464341 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="84e85a9b-0d6b-4357-b896-c346134d8b43" containerName="console" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464355 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14eedb9-50cd-4c46-ad0b-4db012506ceb" containerName="registry" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464363 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14eedb9-50cd-4c46-ad0b-4db012506ceb" containerName="registry" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464451 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="kube-rbac-proxy" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464460 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="kube-rbac-proxy-web" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464468 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="config-reloader" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464474 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14eedb9-50cd-4c46-ad0b-4db012506ceb" containerName="registry" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464481 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9be3f09a-cff8-4097-aac9-56033f182147" containerName="console" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464491 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="kube-rbac-proxy-metric" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464499 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="alertmanager" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464505 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" containerName="prom-label-proxy" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464511 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="84e85a9b-0d6b-4357-b896-c346134d8b43" containerName="console" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:52:58.464513 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25da4e7d561db448fa452897ac47fb961ba15d45fe0f69b4b61dc6115bab1e6f\": container with ID starting with 25da4e7d561db448fa452897ac47fb961ba15d45fe0f69b4b61dc6115bab1e6f not found: ID does not exist" containerID="25da4e7d561db448fa452897ac47fb961ba15d45fe0f69b4b61dc6115bab1e6f" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464533 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25da4e7d561db448fa452897ac47fb961ba15d45fe0f69b4b61dc6115bab1e6f"} err="failed to get container status \"25da4e7d561db448fa452897ac47fb961ba15d45fe0f69b4b61dc6115bab1e6f\": rpc error: code = NotFound desc = could not find container \"25da4e7d561db448fa452897ac47fb961ba15d45fe0f69b4b61dc6115bab1e6f\": container with ID starting with 25da4e7d561db448fa452897ac47fb961ba15d45fe0f69b4b61dc6115bab1e6f not found: ID does not exist" Sep 10 00:52:58.464575 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464548 2567 scope.go:117] "RemoveContainer" containerID="d3a9517b73006b66136e19bea1b935f945b0e098ff9fad3edfddc960c56b2ffb" Sep 10 00:52:58.465437 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:52:58.464779 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3a9517b73006b66136e19bea1b935f945b0e098ff9fad3edfddc960c56b2ffb\": container with ID starting with d3a9517b73006b66136e19bea1b935f945b0e098ff9fad3edfddc960c56b2ffb not found: ID does not exist" containerID="d3a9517b73006b66136e19bea1b935f945b0e098ff9fad3edfddc960c56b2ffb" Sep 10 00:52:58.465437 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464801 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3a9517b73006b66136e19bea1b935f945b0e098ff9fad3edfddc960c56b2ffb"} err="failed to get container status \"d3a9517b73006b66136e19bea1b935f945b0e098ff9fad3edfddc960c56b2ffb\": rpc error: code = NotFound desc = could not find container \"d3a9517b73006b66136e19bea1b935f945b0e098ff9fad3edfddc960c56b2ffb\": container with ID starting with d3a9517b73006b66136e19bea1b935f945b0e098ff9fad3edfddc960c56b2ffb not found: ID does not exist" Sep 10 00:52:58.465437 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.464814 2567 scope.go:117] "RemoveContainer" containerID="43bb9ac38115eaec81a7f014b5ae4f7865ec4d08001bb41965835e44145b967e" Sep 10 00:52:58.465437 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:52:58.465017 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43bb9ac38115eaec81a7f014b5ae4f7865ec4d08001bb41965835e44145b967e\": container with ID starting with 43bb9ac38115eaec81a7f014b5ae4f7865ec4d08001bb41965835e44145b967e not found: ID does not exist" containerID="43bb9ac38115eaec81a7f014b5ae4f7865ec4d08001bb41965835e44145b967e" Sep 10 00:52:58.465437 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.465035 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43bb9ac38115eaec81a7f014b5ae4f7865ec4d08001bb41965835e44145b967e"} err="failed to get container status \"43bb9ac38115eaec81a7f014b5ae4f7865ec4d08001bb41965835e44145b967e\": rpc error: code = NotFound desc = could not find container \"43bb9ac38115eaec81a7f014b5ae4f7865ec4d08001bb41965835e44145b967e\": container with ID starting with 43bb9ac38115eaec81a7f014b5ae4f7865ec4d08001bb41965835e44145b967e not found: ID does not exist" Sep 10 00:52:58.465437 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.465050 2567 scope.go:117] "RemoveContainer" containerID="fa583d45036d9472689b87f718ccb55eee61462811d7199e5601083e7f9b4559" Sep 10 00:52:58.465437 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:52:58.465281 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa583d45036d9472689b87f718ccb55eee61462811d7199e5601083e7f9b4559\": container with ID starting with fa583d45036d9472689b87f718ccb55eee61462811d7199e5601083e7f9b4559 not found: ID does not exist" containerID="fa583d45036d9472689b87f718ccb55eee61462811d7199e5601083e7f9b4559" Sep 10 00:52:58.465437 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.465295 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa583d45036d9472689b87f718ccb55eee61462811d7199e5601083e7f9b4559"} err="failed to get container status \"fa583d45036d9472689b87f718ccb55eee61462811d7199e5601083e7f9b4559\": rpc error: code = NotFound desc = could not find container \"fa583d45036d9472689b87f718ccb55eee61462811d7199e5601083e7f9b4559\": container with ID starting with fa583d45036d9472689b87f718ccb55eee61462811d7199e5601083e7f9b4559 not found: ID does not exist" Sep 10 00:52:58.465437 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.465306 2567 scope.go:117] "RemoveContainer" containerID="61725c9fb333dcb17b15e3e42b34c7f313a319568d214a28fb9d40e1f8823542" Sep 10 00:52:58.465717 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:52:58.465560 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61725c9fb333dcb17b15e3e42b34c7f313a319568d214a28fb9d40e1f8823542\": container with ID starting with 61725c9fb333dcb17b15e3e42b34c7f313a319568d214a28fb9d40e1f8823542 not found: ID does not exist" containerID="61725c9fb333dcb17b15e3e42b34c7f313a319568d214a28fb9d40e1f8823542" Sep 10 00:52:58.465717 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.465576 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61725c9fb333dcb17b15e3e42b34c7f313a319568d214a28fb9d40e1f8823542"} err="failed to get container status \"61725c9fb333dcb17b15e3e42b34c7f313a319568d214a28fb9d40e1f8823542\": rpc error: code = NotFound desc = could not find container \"61725c9fb333dcb17b15e3e42b34c7f313a319568d214a28fb9d40e1f8823542\": container with ID starting with 61725c9fb333dcb17b15e3e42b34c7f313a319568d214a28fb9d40e1f8823542 not found: ID does not exist" Sep 10 00:52:58.467495 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.467481 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.470081 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.470064 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s2x22\"" Sep 10 00:52:58.470183 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.470070 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 00:52:58.470183 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.470088 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 00:52:58.470297 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.470194 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 00:52:58.470459 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.470444 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 00:52:58.470642 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.470628 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 00:52:58.470714 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.470643 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 00:52:58.470915 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.470898 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 00:52:58.471020 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.470976 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 00:52:58.475508 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.475487 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 00:52:58.483446 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.483425 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 00:52:58.508024 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.508002 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.508118 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.508034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.508118 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.508063 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-config-volume\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.508118 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.508104 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40eb8857-3ced-41d3-a664-3984e23c9008-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.508230 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.508123 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40eb8857-3ced-41d3-a664-3984e23c9008-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.508230 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.508147 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.508230 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.508196 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.508230 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.508213 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-web-config\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.508350 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.508230 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5spk9\" (UniqueName: \"kubernetes.io/projected/40eb8857-3ced-41d3-a664-3984e23c9008-kube-api-access-5spk9\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.508350 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.508280 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40eb8857-3ced-41d3-a664-3984e23c9008-config-out\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.508350 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.508309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40eb8857-3ced-41d3-a664-3984e23c9008-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.508350 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.508338 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40eb8857-3ced-41d3-a664-3984e23c9008-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.508496 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.508364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.608840 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.608804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-config-volume\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.608840 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.608844 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40eb8857-3ced-41d3-a664-3984e23c9008-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.609052 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.608861 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40eb8857-3ced-41d3-a664-3984e23c9008-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.609052 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.608880 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.609170 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.609051 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.609170 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.609109 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-web-config\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.609170 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.609157 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5spk9\" (UniqueName: \"kubernetes.io/projected/40eb8857-3ced-41d3-a664-3984e23c9008-kube-api-access-5spk9\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.609329 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.609259 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40eb8857-3ced-41d3-a664-3984e23c9008-config-out\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.609329 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.609319 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40eb8857-3ced-41d3-a664-3984e23c9008-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.609480 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.609358 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40eb8857-3ced-41d3-a664-3984e23c9008-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.609480 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.609435 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.609480 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.609466 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.609618 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.609494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.609763 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.609738 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40eb8857-3ced-41d3-a664-3984e23c9008-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.609948 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.609885 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40eb8857-3ced-41d3-a664-3984e23c9008-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.611312 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.611284 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40eb8857-3ced-41d3-a664-3984e23c9008-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.612191 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.612132 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40eb8857-3ced-41d3-a664-3984e23c9008-config-out\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.612290 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.612275 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-config-volume\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.612629 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.612583 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-web-config\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.612752 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.612651 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40eb8857-3ced-41d3-a664-3984e23c9008-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.612813 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.612747 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.612863 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.612826 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.613348 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.613329 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.613679 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.613662 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.614169 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.614155 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40eb8857-3ced-41d3-a664-3984e23c9008-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.621678 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.619676 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5spk9\" (UniqueName: \"kubernetes.io/projected/40eb8857-3ced-41d3-a664-3984e23c9008-kube-api-access-5spk9\") pod \"alertmanager-main-0\" (UID: \"40eb8857-3ced-41d3-a664-3984e23c9008\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:58.776518 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:58.776436 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 00:52:59.054513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:59.054490 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 00:52:59.056309 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:52:59.056281 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40eb8857_3ced_41d3_a664_3984e23c9008.slice/crio-5c1c1614944084f78ca2713fb77849961717a2272576d97742ce9aa2821560f2 WatchSource:0}: Error finding container 5c1c1614944084f78ca2713fb77849961717a2272576d97742ce9aa2821560f2: Status 404 returned error can't find the container with id 5c1c1614944084f78ca2713fb77849961717a2272576d97742ce9aa2821560f2 Sep 10 00:52:59.417131 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:59.417097 2567 generic.go:356] "Generic (PLEG): container finished" podID="40eb8857-3ced-41d3-a664-3984e23c9008" containerID="8f0ea1bbe369494e5d898c53a7c70d6e17beda239f60293492fe4ec0735362f1" exitCode=0 Sep 10 00:52:59.417585 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:59.417188 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40eb8857-3ced-41d3-a664-3984e23c9008","Type":"ContainerDied","Data":"8f0ea1bbe369494e5d898c53a7c70d6e17beda239f60293492fe4ec0735362f1"} Sep 10 00:52:59.417585 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:59.417264 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40eb8857-3ced-41d3-a664-3984e23c9008","Type":"ContainerStarted","Data":"5c1c1614944084f78ca2713fb77849961717a2272576d97742ce9aa2821560f2"} Sep 10 00:52:59.526271 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:52:59.526237 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf" path="/var/lib/kubelet/pods/1c4fdc3a-3bba-41ed-97a2-f9f7d24afbdf/volumes" Sep 10 00:53:00.424232 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:00.424199 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40eb8857-3ced-41d3-a664-3984e23c9008","Type":"ContainerStarted","Data":"1fa02386cf35b67111ec986f53cbb16bddfc68ab36306c11bb49fbbfb58de427"} Sep 10 00:53:00.424613 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:00.424263 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40eb8857-3ced-41d3-a664-3984e23c9008","Type":"ContainerStarted","Data":"9f3cfde2a423895adcb6dd5482b49cca6f85e193d71bd0ffe229c1f48abac1b6"} Sep 10 00:53:00.424613 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:00.424289 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40eb8857-3ced-41d3-a664-3984e23c9008","Type":"ContainerStarted","Data":"48298043c9a6e4873ec24691ea1e1c4d3e112164faa782aa7e4868af1af00ffc"} Sep 10 00:53:00.424613 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:00.424312 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40eb8857-3ced-41d3-a664-3984e23c9008","Type":"ContainerStarted","Data":"0d8c86988b9495ee3a5668a812ecc420d83b3ddd524433999149fc4571348939"} Sep 10 00:53:00.424613 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:00.424336 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40eb8857-3ced-41d3-a664-3984e23c9008","Type":"ContainerStarted","Data":"f48369355f4f844657ef0dbb0e9b284fa3a5914f599f2bc59fd2b9d8fbcdbdf5"} Sep 10 00:53:00.424613 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:00.424359 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40eb8857-3ced-41d3-a664-3984e23c9008","Type":"ContainerStarted","Data":"0ed971a147152b1af894b944c8be19de96243a92ee976d8c6eb0e279ef8f25f9"} Sep 10 00:53:00.452113 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:00.452054 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.437427135 podStartE2EDuration="2.452031678s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.604543ms" isStatefulPod=false podCreationTimestamp="2026-09-10 00:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:53:00.449756022 +0000 UTC m=+163.400158145" watchObservedRunningTime="2026-09-10 00:53:00.452031678 +0000 UTC m=+163.402433801" Sep 10 00:53:13.113420 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.113311 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74886c5864-c6rzp"] Sep 10 00:53:13.115465 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.115449 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.119002 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.118981 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 00:53:13.119182 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.119164 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 00:53:13.120613 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.120590 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jlrnr\"" Sep 10 00:53:13.120726 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.120652 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 00:53:13.120726 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.120650 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 00:53:13.120726 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.120704 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 00:53:13.131293 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.131264 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 00:53:13.133208 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.133183 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74886c5864-c6rzp"] Sep 10 00:53:13.229180 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.229135 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-service-ca\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.229180 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.229184 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-oauth-serving-cert\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.229180 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.229204 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-serving-cert\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.229546 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.229287 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqsr2\" (UniqueName: \"kubernetes.io/projected/2c1720f6-32c3-4e3d-80e3-e7fad7864743-kube-api-access-zqsr2\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.229546 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.229339 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-trusted-ca-bundle\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.229546 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.229417 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-oauth-config\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.229546 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.229445 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-config\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.330009 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.329962 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-service-ca\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.330009 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.330013 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-oauth-serving-cert\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.330191 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.330032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-serving-cert\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.330191 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.330059 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqsr2\" (UniqueName: \"kubernetes.io/projected/2c1720f6-32c3-4e3d-80e3-e7fad7864743-kube-api-access-zqsr2\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.330191 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.330090 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-trusted-ca-bundle\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.330191 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.330143 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-oauth-config\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.330191 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.330174 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-config\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.330921 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.330893 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-config\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.331020 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.330893 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-oauth-serving-cert\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.331020 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.330939 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-trusted-ca-bundle\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.331093 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.331023 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-service-ca\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.332690 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.332663 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-oauth-config\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.332890 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.332867 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-serving-cert\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.338560 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.338536 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqsr2\" (UniqueName: \"kubernetes.io/projected/2c1720f6-32c3-4e3d-80e3-e7fad7864743-kube-api-access-zqsr2\") pod \"console-74886c5864-c6rzp\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.425608 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.425518 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:13.706729 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:13.706706 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74886c5864-c6rzp"] Sep 10 00:53:13.709069 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:53:13.709041 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c1720f6_32c3_4e3d_80e3_e7fad7864743.slice/crio-5b050b474c2617c28cee8d34ecac393f1b002929a840500db8db2d2d37138b6d WatchSource:0}: Error finding container 5b050b474c2617c28cee8d34ecac393f1b002929a840500db8db2d2d37138b6d: Status 404 returned error can't find the container with id 5b050b474c2617c28cee8d34ecac393f1b002929a840500db8db2d2d37138b6d Sep 10 00:53:14.482302 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:14.482269 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74886c5864-c6rzp" event={"ID":"2c1720f6-32c3-4e3d-80e3-e7fad7864743","Type":"ContainerStarted","Data":"1620c12002cd0cc7ea54a5cfd06301aee3023cce011c91a1b25f785b27e0865a"} Sep 10 00:53:14.482704 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:14.482322 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74886c5864-c6rzp" event={"ID":"2c1720f6-32c3-4e3d-80e3-e7fad7864743","Type":"ContainerStarted","Data":"5b050b474c2617c28cee8d34ecac393f1b002929a840500db8db2d2d37138b6d"} Sep 10 00:53:14.502327 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:14.502280 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74886c5864-c6rzp" podStartSLOduration=1.50226501 podStartE2EDuration="1.50226501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:53:14.499670734 +0000 UTC m=+177.450072880" watchObservedRunningTime="2026-09-10 00:53:14.50226501 +0000 UTC m=+177.452667130" Sep 10 00:53:23.426348 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:23.426290 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:23.426831 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:23.426372 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:23.431961 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:23.431936 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:23.526310 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:23.526285 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:53:54.710175 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.710141 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z"] Sep 10 00:53:54.712704 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.712688 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" Sep 10 00:53:54.716211 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.716189 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 00:53:54.716337 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.716261 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vg5b9\"" Sep 10 00:53:54.717488 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.717472 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 00:53:54.723150 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.723131 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z"] Sep 10 00:53:54.762559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.762531 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e264b2ec-7300-409b-9ee6-a08759d0bc56-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z\" (UID: \"e264b2ec-7300-409b-9ee6-a08759d0bc56\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" Sep 10 00:53:54.762701 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.762609 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e264b2ec-7300-409b-9ee6-a08759d0bc56-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z\" (UID: \"e264b2ec-7300-409b-9ee6-a08759d0bc56\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" Sep 10 00:53:54.762701 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.762632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qzls\" (UniqueName: \"kubernetes.io/projected/e264b2ec-7300-409b-9ee6-a08759d0bc56-kube-api-access-9qzls\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z\" (UID: \"e264b2ec-7300-409b-9ee6-a08759d0bc56\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" Sep 10 00:53:54.863180 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.863138 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e264b2ec-7300-409b-9ee6-a08759d0bc56-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z\" (UID: \"e264b2ec-7300-409b-9ee6-a08759d0bc56\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" Sep 10 00:53:54.863369 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.863218 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e264b2ec-7300-409b-9ee6-a08759d0bc56-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z\" (UID: \"e264b2ec-7300-409b-9ee6-a08759d0bc56\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" Sep 10 00:53:54.863369 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.863242 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qzls\" (UniqueName: \"kubernetes.io/projected/e264b2ec-7300-409b-9ee6-a08759d0bc56-kube-api-access-9qzls\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z\" (UID: \"e264b2ec-7300-409b-9ee6-a08759d0bc56\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" Sep 10 00:53:54.863592 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.863569 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e264b2ec-7300-409b-9ee6-a08759d0bc56-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z\" (UID: \"e264b2ec-7300-409b-9ee6-a08759d0bc56\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" Sep 10 00:53:54.863656 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.863618 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e264b2ec-7300-409b-9ee6-a08759d0bc56-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z\" (UID: \"e264b2ec-7300-409b-9ee6-a08759d0bc56\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" Sep 10 00:53:54.871993 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:54.871971 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qzls\" (UniqueName: \"kubernetes.io/projected/e264b2ec-7300-409b-9ee6-a08759d0bc56-kube-api-access-9qzls\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z\" (UID: \"e264b2ec-7300-409b-9ee6-a08759d0bc56\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" Sep 10 00:53:55.022107 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:55.022028 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" Sep 10 00:53:55.291924 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:55.291902 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z"] Sep 10 00:53:55.294045 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:53:55.294015 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode264b2ec_7300_409b_9ee6_a08759d0bc56.slice/crio-e31d4934ed2591bd05251b5cf062f42b336705a2a2ce9522152269bea88f9378 WatchSource:0}: Error finding container e31d4934ed2591bd05251b5cf062f42b336705a2a2ce9522152269bea88f9378: Status 404 returned error can't find the container with id e31d4934ed2591bd05251b5cf062f42b336705a2a2ce9522152269bea88f9378 Sep 10 00:53:55.641137 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:53:55.641104 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" event={"ID":"e264b2ec-7300-409b-9ee6-a08759d0bc56","Type":"ContainerStarted","Data":"e31d4934ed2591bd05251b5cf062f42b336705a2a2ce9522152269bea88f9378"} Sep 10 00:54:01.666979 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:01.666945 2567 generic.go:356] "Generic (PLEG): container finished" podID="e264b2ec-7300-409b-9ee6-a08759d0bc56" containerID="36cd87855a13f29ff1d25176e235982c18c256afd0cd589aadfb269be8664dc9" exitCode=0 Sep 10 00:54:01.667403 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:01.667034 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" event={"ID":"e264b2ec-7300-409b-9ee6-a08759d0bc56","Type":"ContainerDied","Data":"36cd87855a13f29ff1d25176e235982c18c256afd0cd589aadfb269be8664dc9"} Sep 10 00:54:04.681379 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:04.681344 2567 generic.go:356] "Generic (PLEG): container finished" podID="e264b2ec-7300-409b-9ee6-a08759d0bc56" containerID="84b87357606c96f11231ab95e4339c4504d93a7472fa8bcd536385a637180b18" exitCode=0 Sep 10 00:54:04.681779 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:04.681440 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" event={"ID":"e264b2ec-7300-409b-9ee6-a08759d0bc56","Type":"ContainerDied","Data":"84b87357606c96f11231ab95e4339c4504d93a7472fa8bcd536385a637180b18"} Sep 10 00:54:11.714751 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:11.714722 2567 generic.go:356] "Generic (PLEG): container finished" podID="e264b2ec-7300-409b-9ee6-a08759d0bc56" containerID="2fcc71d1aa615acb1c45a9b89de71e1b5c9194cb6d38010b564da696e2c83d5a" exitCode=0 Sep 10 00:54:11.715115 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:11.714817 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" event={"ID":"e264b2ec-7300-409b-9ee6-a08759d0bc56","Type":"ContainerDied","Data":"2fcc71d1aa615acb1c45a9b89de71e1b5c9194cb6d38010b564da696e2c83d5a"} Sep 10 00:54:12.841253 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:12.841231 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" Sep 10 00:54:12.923512 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:12.923481 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qzls\" (UniqueName: \"kubernetes.io/projected/e264b2ec-7300-409b-9ee6-a08759d0bc56-kube-api-access-9qzls\") pod \"e264b2ec-7300-409b-9ee6-a08759d0bc56\" (UID: \"e264b2ec-7300-409b-9ee6-a08759d0bc56\") " Sep 10 00:54:12.923696 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:12.923538 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e264b2ec-7300-409b-9ee6-a08759d0bc56-bundle\") pod \"e264b2ec-7300-409b-9ee6-a08759d0bc56\" (UID: \"e264b2ec-7300-409b-9ee6-a08759d0bc56\") " Sep 10 00:54:12.923696 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:12.923595 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e264b2ec-7300-409b-9ee6-a08759d0bc56-util\") pod \"e264b2ec-7300-409b-9ee6-a08759d0bc56\" (UID: \"e264b2ec-7300-409b-9ee6-a08759d0bc56\") " Sep 10 00:54:12.924242 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:12.924211 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e264b2ec-7300-409b-9ee6-a08759d0bc56-bundle" (OuterVolumeSpecName: "bundle") pod "e264b2ec-7300-409b-9ee6-a08759d0bc56" (UID: "e264b2ec-7300-409b-9ee6-a08759d0bc56"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:54:12.925849 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:12.925827 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e264b2ec-7300-409b-9ee6-a08759d0bc56-kube-api-access-9qzls" (OuterVolumeSpecName: "kube-api-access-9qzls") pod "e264b2ec-7300-409b-9ee6-a08759d0bc56" (UID: "e264b2ec-7300-409b-9ee6-a08759d0bc56"). InnerVolumeSpecName "kube-api-access-9qzls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:54:12.928038 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:12.928018 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e264b2ec-7300-409b-9ee6-a08759d0bc56-util" (OuterVolumeSpecName: "util") pod "e264b2ec-7300-409b-9ee6-a08759d0bc56" (UID: "e264b2ec-7300-409b-9ee6-a08759d0bc56"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:54:13.024536 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:13.024444 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e264b2ec-7300-409b-9ee6-a08759d0bc56-util\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:54:13.024536 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:13.024477 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qzls\" (UniqueName: \"kubernetes.io/projected/e264b2ec-7300-409b-9ee6-a08759d0bc56-kube-api-access-9qzls\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:54:13.024536 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:13.024485 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e264b2ec-7300-409b-9ee6-a08759d0bc56-bundle\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:54:13.724109 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:13.724071 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" event={"ID":"e264b2ec-7300-409b-9ee6-a08759d0bc56","Type":"ContainerDied","Data":"e31d4934ed2591bd05251b5cf062f42b336705a2a2ce9522152269bea88f9378"} Sep 10 00:54:13.724109 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:13.724105 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qlt8z" Sep 10 00:54:13.724310 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:13.724121 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e31d4934ed2591bd05251b5cf062f42b336705a2a2ce9522152269bea88f9378" Sep 10 00:54:17.573917 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.573877 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-874d5"] Sep 10 00:54:17.574414 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.574308 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e264b2ec-7300-409b-9ee6-a08759d0bc56" containerName="util" Sep 10 00:54:17.574414 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.574325 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e264b2ec-7300-409b-9ee6-a08759d0bc56" containerName="util" Sep 10 00:54:17.574414 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.574353 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e264b2ec-7300-409b-9ee6-a08759d0bc56" containerName="pull" Sep 10 00:54:17.574414 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.574360 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e264b2ec-7300-409b-9ee6-a08759d0bc56" containerName="pull" Sep 10 00:54:17.574414 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.574375 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e264b2ec-7300-409b-9ee6-a08759d0bc56" containerName="extract" Sep 10 00:54:17.574414 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.574405 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e264b2ec-7300-409b-9ee6-a08759d0bc56" containerName="extract" Sep 10 00:54:17.574713 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.574493 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e264b2ec-7300-409b-9ee6-a08759d0bc56" containerName="extract" Sep 10 00:54:17.606191 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.606164 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-874d5"] Sep 10 00:54:17.606350 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.606267 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-874d5" Sep 10 00:54:17.609296 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.609262 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 10 00:54:17.609447 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.609428 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ftf8c\"" Sep 10 00:54:17.609447 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.609441 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:54:17.761982 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.761947 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwgms\" (UniqueName: \"kubernetes.io/projected/b14d2190-07f3-4a98-bed2-4b1e3fa9a551-kube-api-access-pwgms\") pod \"cert-manager-operator-controller-manager-55c444bf86-874d5\" (UID: \"b14d2190-07f3-4a98-bed2-4b1e3fa9a551\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-874d5" Sep 10 00:54:17.762149 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.762001 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b14d2190-07f3-4a98-bed2-4b1e3fa9a551-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-874d5\" (UID: \"b14d2190-07f3-4a98-bed2-4b1e3fa9a551\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-874d5" Sep 10 00:54:17.863161 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.863126 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b14d2190-07f3-4a98-bed2-4b1e3fa9a551-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-874d5\" (UID: \"b14d2190-07f3-4a98-bed2-4b1e3fa9a551\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-874d5" Sep 10 00:54:17.863318 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.863226 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwgms\" (UniqueName: \"kubernetes.io/projected/b14d2190-07f3-4a98-bed2-4b1e3fa9a551-kube-api-access-pwgms\") pod \"cert-manager-operator-controller-manager-55c444bf86-874d5\" (UID: \"b14d2190-07f3-4a98-bed2-4b1e3fa9a551\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-874d5" Sep 10 00:54:17.863552 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.863528 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b14d2190-07f3-4a98-bed2-4b1e3fa9a551-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-874d5\" (UID: \"b14d2190-07f3-4a98-bed2-4b1e3fa9a551\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-874d5" Sep 10 00:54:17.873150 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.873130 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwgms\" (UniqueName: \"kubernetes.io/projected/b14d2190-07f3-4a98-bed2-4b1e3fa9a551-kube-api-access-pwgms\") pod \"cert-manager-operator-controller-manager-55c444bf86-874d5\" (UID: \"b14d2190-07f3-4a98-bed2-4b1e3fa9a551\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-874d5" Sep 10 00:54:17.914779 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:17.914747 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-874d5" Sep 10 00:54:18.223133 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:18.223105 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-874d5"] Sep 10 00:54:18.224662 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:54:18.224637 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14d2190_07f3_4a98_bed2_4b1e3fa9a551.slice/crio-9e2da03d8575a6ac9c1ea30a3bcbefb06afdc7a11792ba5eea9489cf3d48f912 WatchSource:0}: Error finding container 9e2da03d8575a6ac9c1ea30a3bcbefb06afdc7a11792ba5eea9489cf3d48f912: Status 404 returned error can't find the container with id 9e2da03d8575a6ac9c1ea30a3bcbefb06afdc7a11792ba5eea9489cf3d48f912 Sep 10 00:54:18.746172 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:18.746135 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-874d5" event={"ID":"b14d2190-07f3-4a98-bed2-4b1e3fa9a551","Type":"ContainerStarted","Data":"9e2da03d8575a6ac9c1ea30a3bcbefb06afdc7a11792ba5eea9489cf3d48f912"} Sep 10 00:54:20.758932 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:20.758831 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-874d5" event={"ID":"b14d2190-07f3-4a98-bed2-4b1e3fa9a551","Type":"ContainerStarted","Data":"c39006de504d4d10214ff7434f72be937b31a55221a4f6eff1f676a154c09349"} Sep 10 00:54:20.779532 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:20.779350 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-874d5" podStartSLOduration=1.64132341 podStartE2EDuration="3.779331316s" totalImagesPullingTime="2.138007906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:54:20.777704754 +0000 UTC m=+243.728106899" watchObservedRunningTime="2026-09-10 00:54:20.779331316 +0000 UTC m=+243.729733438" Sep 10 00:54:21.927326 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:21.927294 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm"] Sep 10 00:54:21.929879 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:21.929864 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" Sep 10 00:54:21.932738 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:21.932715 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 00:54:21.932887 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:21.932756 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 00:54:21.933974 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:21.933956 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vg5b9\"" Sep 10 00:54:21.940787 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:21.940767 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm"] Sep 10 00:54:22.101403 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:22.101361 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46c05ea6-597a-4e83-8a27-f02e0697bb36-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm\" (UID: \"46c05ea6-597a-4e83-8a27-f02e0697bb36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" Sep 10 00:54:22.101570 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:22.101416 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46c05ea6-597a-4e83-8a27-f02e0697bb36-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm\" (UID: \"46c05ea6-597a-4e83-8a27-f02e0697bb36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" Sep 10 00:54:22.101570 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:22.101483 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5glrm\" (UniqueName: \"kubernetes.io/projected/46c05ea6-597a-4e83-8a27-f02e0697bb36-kube-api-access-5glrm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm\" (UID: \"46c05ea6-597a-4e83-8a27-f02e0697bb36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" Sep 10 00:54:22.202472 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:22.202372 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46c05ea6-597a-4e83-8a27-f02e0697bb36-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm\" (UID: \"46c05ea6-597a-4e83-8a27-f02e0697bb36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" Sep 10 00:54:22.202472 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:22.202434 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46c05ea6-597a-4e83-8a27-f02e0697bb36-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm\" (UID: \"46c05ea6-597a-4e83-8a27-f02e0697bb36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" Sep 10 00:54:22.202472 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:22.202466 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5glrm\" (UniqueName: \"kubernetes.io/projected/46c05ea6-597a-4e83-8a27-f02e0697bb36-kube-api-access-5glrm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm\" (UID: \"46c05ea6-597a-4e83-8a27-f02e0697bb36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" Sep 10 00:54:22.202770 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:22.202746 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46c05ea6-597a-4e83-8a27-f02e0697bb36-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm\" (UID: \"46c05ea6-597a-4e83-8a27-f02e0697bb36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" Sep 10 00:54:22.202808 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:22.202769 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46c05ea6-597a-4e83-8a27-f02e0697bb36-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm\" (UID: \"46c05ea6-597a-4e83-8a27-f02e0697bb36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" Sep 10 00:54:22.210457 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:22.210429 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5glrm\" (UniqueName: \"kubernetes.io/projected/46c05ea6-597a-4e83-8a27-f02e0697bb36-kube-api-access-5glrm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm\" (UID: \"46c05ea6-597a-4e83-8a27-f02e0697bb36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" Sep 10 00:54:22.239398 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:22.239360 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" Sep 10 00:54:22.507042 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:22.507020 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm"] Sep 10 00:54:22.508723 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:54:22.508702 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c05ea6_597a_4e83_8a27_f02e0697bb36.slice/crio-e003634d5ec595652f3c8525e75009ad52b9f9daaae1cfd837640d1ae49d923b WatchSource:0}: Error finding container e003634d5ec595652f3c8525e75009ad52b9f9daaae1cfd837640d1ae49d923b: Status 404 returned error can't find the container with id e003634d5ec595652f3c8525e75009ad52b9f9daaae1cfd837640d1ae49d923b Sep 10 00:54:22.769450 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:22.769361 2567 generic.go:356] "Generic (PLEG): container finished" podID="46c05ea6-597a-4e83-8a27-f02e0697bb36" containerID="ae37afee240aa963e2936181c50e24c24e6614de5e70495fc00db39ac1218dde" exitCode=0 Sep 10 00:54:22.769593 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:22.769459 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" event={"ID":"46c05ea6-597a-4e83-8a27-f02e0697bb36","Type":"ContainerDied","Data":"ae37afee240aa963e2936181c50e24c24e6614de5e70495fc00db39ac1218dde"} Sep 10 00:54:22.769593 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:22.769499 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" event={"ID":"46c05ea6-597a-4e83-8a27-f02e0697bb36","Type":"ContainerStarted","Data":"e003634d5ec595652f3c8525e75009ad52b9f9daaae1cfd837640d1ae49d923b"} Sep 10 00:54:25.790621 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:25.790579 2567 generic.go:356] "Generic (PLEG): container finished" podID="46c05ea6-597a-4e83-8a27-f02e0697bb36" containerID="cc7d8ad0c70ef658d98f063d6e04132eda7e4c4b2e660a4e23a5d9aa9202cad1" exitCode=0 Sep 10 00:54:25.791088 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:25.790630 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" event={"ID":"46c05ea6-597a-4e83-8a27-f02e0697bb36","Type":"ContainerDied","Data":"cc7d8ad0c70ef658d98f063d6e04132eda7e4c4b2e660a4e23a5d9aa9202cad1"} Sep 10 00:54:26.797763 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:26.797731 2567 generic.go:356] "Generic (PLEG): container finished" podID="46c05ea6-597a-4e83-8a27-f02e0697bb36" containerID="1362a3a74e512d67846638f334bdbf9c500ba6fa4a1c392b0051d0df59de99a1" exitCode=0 Sep 10 00:54:26.798157 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:26.797806 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" event={"ID":"46c05ea6-597a-4e83-8a27-f02e0697bb36","Type":"ContainerDied","Data":"1362a3a74e512d67846638f334bdbf9c500ba6fa4a1c392b0051d0df59de99a1"} Sep 10 00:54:27.926920 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:27.926891 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" Sep 10 00:54:28.053734 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:28.053643 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46c05ea6-597a-4e83-8a27-f02e0697bb36-util\") pod \"46c05ea6-597a-4e83-8a27-f02e0697bb36\" (UID: \"46c05ea6-597a-4e83-8a27-f02e0697bb36\") " Sep 10 00:54:28.053734 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:28.053682 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46c05ea6-597a-4e83-8a27-f02e0697bb36-bundle\") pod \"46c05ea6-597a-4e83-8a27-f02e0697bb36\" (UID: \"46c05ea6-597a-4e83-8a27-f02e0697bb36\") " Sep 10 00:54:28.053734 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:28.053713 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5glrm\" (UniqueName: \"kubernetes.io/projected/46c05ea6-597a-4e83-8a27-f02e0697bb36-kube-api-access-5glrm\") pod \"46c05ea6-597a-4e83-8a27-f02e0697bb36\" (UID: \"46c05ea6-597a-4e83-8a27-f02e0697bb36\") " Sep 10 00:54:28.054138 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:28.054112 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46c05ea6-597a-4e83-8a27-f02e0697bb36-bundle" (OuterVolumeSpecName: "bundle") pod "46c05ea6-597a-4e83-8a27-f02e0697bb36" (UID: "46c05ea6-597a-4e83-8a27-f02e0697bb36"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:54:28.055984 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:28.055955 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46c05ea6-597a-4e83-8a27-f02e0697bb36-kube-api-access-5glrm" (OuterVolumeSpecName: "kube-api-access-5glrm") pod "46c05ea6-597a-4e83-8a27-f02e0697bb36" (UID: "46c05ea6-597a-4e83-8a27-f02e0697bb36"). InnerVolumeSpecName "kube-api-access-5glrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:54:28.058640 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:28.058621 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46c05ea6-597a-4e83-8a27-f02e0697bb36-util" (OuterVolumeSpecName: "util") pod "46c05ea6-597a-4e83-8a27-f02e0697bb36" (UID: "46c05ea6-597a-4e83-8a27-f02e0697bb36"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:54:28.155059 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:28.155035 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46c05ea6-597a-4e83-8a27-f02e0697bb36-util\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:54:28.155059 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:28.155056 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46c05ea6-597a-4e83-8a27-f02e0697bb36-bundle\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:54:28.155059 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:28.155065 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5glrm\" (UniqueName: \"kubernetes.io/projected/46c05ea6-597a-4e83-8a27-f02e0697bb36-kube-api-access-5glrm\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:54:28.808735 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:28.808705 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" event={"ID":"46c05ea6-597a-4e83-8a27-f02e0697bb36","Type":"ContainerDied","Data":"e003634d5ec595652f3c8525e75009ad52b9f9daaae1cfd837640d1ae49d923b"} Sep 10 00:54:28.808902 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:28.808749 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e003634d5ec595652f3c8525e75009ad52b9f9daaae1cfd837640d1ae49d923b" Sep 10 00:54:28.808902 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:28.808751 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmrzpm" Sep 10 00:54:32.477109 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.477072 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8297h"] Sep 10 00:54:32.477515 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.477437 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46c05ea6-597a-4e83-8a27-f02e0697bb36" containerName="pull" Sep 10 00:54:32.477515 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.477452 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="46c05ea6-597a-4e83-8a27-f02e0697bb36" containerName="pull" Sep 10 00:54:32.477515 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.477470 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46c05ea6-597a-4e83-8a27-f02e0697bb36" containerName="extract" Sep 10 00:54:32.477515 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.477475 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="46c05ea6-597a-4e83-8a27-f02e0697bb36" containerName="extract" Sep 10 00:54:32.477515 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.477483 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46c05ea6-597a-4e83-8a27-f02e0697bb36" containerName="util" Sep 10 00:54:32.477515 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.477488 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="46c05ea6-597a-4e83-8a27-f02e0697bb36" containerName="util" Sep 10 00:54:32.477698 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.477573 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="46c05ea6-597a-4e83-8a27-f02e0697bb36" containerName="extract" Sep 10 00:54:32.479530 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.479514 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8297h" Sep 10 00:54:32.482580 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.482559 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 00:54:32.482580 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.482574 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-v7h7c\"" Sep 10 00:54:32.484010 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.483995 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 00:54:32.490126 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.490100 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8297h"] Sep 10 00:54:32.491644 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.491620 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjtzx\" (UniqueName: \"kubernetes.io/projected/2b9a1b9b-038a-4a56-b36b-144444ba43b0-kube-api-access-zjtzx\") pod \"cert-manager-55b4d954d5-8297h\" (UID: \"2b9a1b9b-038a-4a56-b36b-144444ba43b0\") " pod="cert-manager/cert-manager-55b4d954d5-8297h" Sep 10 00:54:32.491747 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.491660 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b9a1b9b-038a-4a56-b36b-144444ba43b0-bound-sa-token\") pod \"cert-manager-55b4d954d5-8297h\" (UID: \"2b9a1b9b-038a-4a56-b36b-144444ba43b0\") " pod="cert-manager/cert-manager-55b4d954d5-8297h" Sep 10 00:54:32.592746 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.592711 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjtzx\" (UniqueName: \"kubernetes.io/projected/2b9a1b9b-038a-4a56-b36b-144444ba43b0-kube-api-access-zjtzx\") pod \"cert-manager-55b4d954d5-8297h\" (UID: \"2b9a1b9b-038a-4a56-b36b-144444ba43b0\") " pod="cert-manager/cert-manager-55b4d954d5-8297h" Sep 10 00:54:32.592916 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.592763 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b9a1b9b-038a-4a56-b36b-144444ba43b0-bound-sa-token\") pod \"cert-manager-55b4d954d5-8297h\" (UID: \"2b9a1b9b-038a-4a56-b36b-144444ba43b0\") " pod="cert-manager/cert-manager-55b4d954d5-8297h" Sep 10 00:54:32.602224 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.602198 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjtzx\" (UniqueName: \"kubernetes.io/projected/2b9a1b9b-038a-4a56-b36b-144444ba43b0-kube-api-access-zjtzx\") pod \"cert-manager-55b4d954d5-8297h\" (UID: \"2b9a1b9b-038a-4a56-b36b-144444ba43b0\") " pod="cert-manager/cert-manager-55b4d954d5-8297h" Sep 10 00:54:32.602627 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.602607 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b9a1b9b-038a-4a56-b36b-144444ba43b0-bound-sa-token\") pod \"cert-manager-55b4d954d5-8297h\" (UID: \"2b9a1b9b-038a-4a56-b36b-144444ba43b0\") " pod="cert-manager/cert-manager-55b4d954d5-8297h" Sep 10 00:54:32.802404 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:32.802300 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8297h" Sep 10 00:54:33.072638 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:33.072615 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8297h"] Sep 10 00:54:33.074645 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:54:33.074618 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b9a1b9b_038a_4a56_b36b_144444ba43b0.slice/crio-b8ea7988398a2d70589bbf1980f66194d8614faca46eecf1ce6e231ac2ce479d WatchSource:0}: Error finding container b8ea7988398a2d70589bbf1980f66194d8614faca46eecf1ce6e231ac2ce479d: Status 404 returned error can't find the container with id b8ea7988398a2d70589bbf1980f66194d8614faca46eecf1ce6e231ac2ce479d Sep 10 00:54:33.832065 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:33.832034 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8297h" event={"ID":"2b9a1b9b-038a-4a56-b36b-144444ba43b0","Type":"ContainerStarted","Data":"b8ea7988398a2d70589bbf1980f66194d8614faca46eecf1ce6e231ac2ce479d"} Sep 10 00:54:36.847430 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:36.847359 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8297h" event={"ID":"2b9a1b9b-038a-4a56-b36b-144444ba43b0","Type":"ContainerStarted","Data":"90d7f9f2995bb8c978bf9fabefa15865349f2d9d519c75cf99ffaee1630c317c"} Sep 10 00:54:36.864180 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:36.864126 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-8297h" podStartSLOduration=2.094494937 podStartE2EDuration="4.864085578s" totalImagesPullingTime="2.769590641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:54:36.863210199 +0000 UTC m=+259.813612334" watchObservedRunningTime="2026-09-10 00:54:36.864085578 +0000 UTC m=+259.814487698" Sep 10 00:54:42.300943 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.300864 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8"] Sep 10 00:54:42.310811 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.310785 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" Sep 10 00:54:42.311794 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.311770 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8"] Sep 10 00:54:42.313794 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.313773 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 00:54:42.315084 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.315061 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 00:54:42.315205 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.315069 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vg5b9\"" Sep 10 00:54:42.371028 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.370995 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8\" (UID: \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" Sep 10 00:54:42.371198 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.371110 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkc9f\" (UniqueName: \"kubernetes.io/projected/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-kube-api-access-vkc9f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8\" (UID: \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" Sep 10 00:54:42.371198 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.371141 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8\" (UID: \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" Sep 10 00:54:42.472046 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.472011 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkc9f\" (UniqueName: \"kubernetes.io/projected/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-kube-api-access-vkc9f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8\" (UID: \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" Sep 10 00:54:42.472046 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.472047 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8\" (UID: \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" Sep 10 00:54:42.472286 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.472089 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8\" (UID: \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" Sep 10 00:54:42.472526 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.472501 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8\" (UID: \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" Sep 10 00:54:42.472655 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.472512 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8\" (UID: \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" Sep 10 00:54:42.481007 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.480982 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkc9f\" (UniqueName: \"kubernetes.io/projected/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-kube-api-access-vkc9f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8\" (UID: \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" Sep 10 00:54:42.620677 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.620641 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" Sep 10 00:54:42.909584 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:42.909563 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8"] Sep 10 00:54:42.912403 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:54:42.912362 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8fd3e0_fef7_4817_8ea9_a9a98a36d84a.slice/crio-43c663b620c0222ebf39b6df261251512bff7b1c74357007801c1c090cf69108 WatchSource:0}: Error finding container 43c663b620c0222ebf39b6df261251512bff7b1c74357007801c1c090cf69108: Status 404 returned error can't find the container with id 43c663b620c0222ebf39b6df261251512bff7b1c74357007801c1c090cf69108 Sep 10 00:54:43.879277 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:43.879240 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a" containerID="434f7fcb7e1768bd966de919d525ca4522ba4e7fc88296002adb8305bc849b05" exitCode=0 Sep 10 00:54:43.879690 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:43.879299 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" event={"ID":"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a","Type":"ContainerDied","Data":"434f7fcb7e1768bd966de919d525ca4522ba4e7fc88296002adb8305bc849b05"} Sep 10 00:54:43.879690 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:43.879334 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" event={"ID":"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a","Type":"ContainerStarted","Data":"43c663b620c0222ebf39b6df261251512bff7b1c74357007801c1c090cf69108"} Sep 10 00:54:44.886371 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:44.886336 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a" containerID="2632005ff4ba39656d98788855b860c9aa2873d6c4e94ab32d1587b51a15bc2f" exitCode=0 Sep 10 00:54:44.886782 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:44.886443 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" event={"ID":"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a","Type":"ContainerDied","Data":"2632005ff4ba39656d98788855b860c9aa2873d6c4e94ab32d1587b51a15bc2f"} Sep 10 00:54:45.893349 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:45.893314 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a" containerID="c5f2dc8ec71c2e99a53801ee7a4a0572ace514f6de6bdc42ebfab3a8c3d671de" exitCode=0 Sep 10 00:54:45.893723 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:45.893416 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" event={"ID":"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a","Type":"ContainerDied","Data":"c5f2dc8ec71c2e99a53801ee7a4a0572ace514f6de6bdc42ebfab3a8c3d671de"} Sep 10 00:54:47.020488 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:47.020454 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" Sep 10 00:54:47.112240 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:47.112203 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-bundle\") pod \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\" (UID: \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\") " Sep 10 00:54:47.112406 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:47.112260 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkc9f\" (UniqueName: \"kubernetes.io/projected/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-kube-api-access-vkc9f\") pod \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\" (UID: \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\") " Sep 10 00:54:47.112406 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:47.112324 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-util\") pod \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\" (UID: \"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a\") " Sep 10 00:54:47.112976 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:47.112947 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-bundle" (OuterVolumeSpecName: "bundle") pod "1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a" (UID: "1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:54:47.114546 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:47.114525 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-kube-api-access-vkc9f" (OuterVolumeSpecName: "kube-api-access-vkc9f") pod "1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a" (UID: "1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a"). InnerVolumeSpecName "kube-api-access-vkc9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:54:47.118273 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:47.118236 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-util" (OuterVolumeSpecName: "util") pod "1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a" (UID: "1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:54:47.213779 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:47.213700 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-util\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:54:47.213779 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:47.213729 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-bundle\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:54:47.213779 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:47.213738 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkc9f\" (UniqueName: \"kubernetes.io/projected/1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a-kube-api-access-vkc9f\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:54:47.904674 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:47.904641 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" Sep 10 00:54:47.904674 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:47.904651 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4v9x8" event={"ID":"1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a","Type":"ContainerDied","Data":"43c663b620c0222ebf39b6df261251512bff7b1c74357007801c1c090cf69108"} Sep 10 00:54:47.904881 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:47.904733 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43c663b620c0222ebf39b6df261251512bff7b1c74357007801c1c090cf69108" Sep 10 00:54:52.310241 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.310205 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k"] Sep 10 00:54:52.310628 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.310523 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a" containerName="extract" Sep 10 00:54:52.310628 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.310534 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a" containerName="extract" Sep 10 00:54:52.310628 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.310547 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a" containerName="pull" Sep 10 00:54:52.310628 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.310553 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a" containerName="pull" Sep 10 00:54:52.310628 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.310568 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a" containerName="util" Sep 10 00:54:52.310628 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.310573 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a" containerName="util" Sep 10 00:54:52.310628 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.310625 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c8fd3e0-fef7-4817-8ea9-a9a98a36d84a" containerName="extract" Sep 10 00:54:52.313281 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.313258 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" Sep 10 00:54:52.315978 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.315955 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 00:54:52.316090 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.316058 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 00:54:52.317430 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.317409 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vg5b9\"" Sep 10 00:54:52.323635 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.323617 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k"] Sep 10 00:54:52.353890 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.353859 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ljd9\" (UniqueName: \"kubernetes.io/projected/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-kube-api-access-6ljd9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k\" (UID: \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" Sep 10 00:54:52.354042 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.353927 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k\" (UID: \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" Sep 10 00:54:52.354042 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.353978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k\" (UID: \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" Sep 10 00:54:52.455210 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.455152 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ljd9\" (UniqueName: \"kubernetes.io/projected/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-kube-api-access-6ljd9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k\" (UID: \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" Sep 10 00:54:52.455426 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.455261 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k\" (UID: \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" Sep 10 00:54:52.455426 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.455298 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k\" (UID: \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" Sep 10 00:54:52.455672 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.455650 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k\" (UID: \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" Sep 10 00:54:52.455716 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.455686 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k\" (UID: \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" Sep 10 00:54:52.464656 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.464634 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ljd9\" (UniqueName: \"kubernetes.io/projected/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-kube-api-access-6ljd9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k\" (UID: \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" Sep 10 00:54:52.622466 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.622433 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" Sep 10 00:54:52.895994 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.895907 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k"] Sep 10 00:54:52.898803 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:54:52.898774 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d2e4e8_c2e3_41a8_b1e1_14a41c3d9559.slice/crio-199559754b7d6e896bff68e9fcbcd18316a16c3146da8212a1fdef1920ce371f WatchSource:0}: Error finding container 199559754b7d6e896bff68e9fcbcd18316a16c3146da8212a1fdef1920ce371f: Status 404 returned error can't find the container with id 199559754b7d6e896bff68e9fcbcd18316a16c3146da8212a1fdef1920ce371f Sep 10 00:54:52.928108 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:52.928081 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" event={"ID":"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559","Type":"ContainerStarted","Data":"199559754b7d6e896bff68e9fcbcd18316a16c3146da8212a1fdef1920ce371f"} Sep 10 00:54:53.933845 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:53.933811 2567 generic.go:356] "Generic (PLEG): container finished" podID="c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559" containerID="a577befdf718414fd252f9fc360ddcdb27729846cb1a6d148ff1426e0c6fbc54" exitCode=0 Sep 10 00:54:53.934226 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:53.933865 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" event={"ID":"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559","Type":"ContainerDied","Data":"a577befdf718414fd252f9fc360ddcdb27729846cb1a6d148ff1426e0c6fbc54"} Sep 10 00:54:54.378519 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.378484 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7"] Sep 10 00:54:54.383043 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.383026 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.386396 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.386368 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 00:54:54.386505 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.386431 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8jt9s\"" Sep 10 00:54:54.386505 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.386451 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 00:54:54.386792 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.386776 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 00:54:54.386874 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.386832 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 00:54:54.410431 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.410408 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7"] Sep 10 00:54:54.478856 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.478825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dcdce3fe-3802-410e-af19-0e5bb3e9165c-manifests\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.478856 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.478860 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dcdce3fe-3802-410e-af19-0e5bb3e9165c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.479082 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.478878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dcdce3fe-3802-410e-af19-0e5bb3e9165c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.479082 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.479033 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8td2m\" (UniqueName: \"kubernetes.io/projected/dcdce3fe-3802-410e-af19-0e5bb3e9165c-kube-api-access-8td2m\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.479192 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.479086 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcdce3fe-3802-410e-af19-0e5bb3e9165c-tmp\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.580325 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.580290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8td2m\" (UniqueName: \"kubernetes.io/projected/dcdce3fe-3802-410e-af19-0e5bb3e9165c-kube-api-access-8td2m\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.580520 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.580336 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcdce3fe-3802-410e-af19-0e5bb3e9165c-tmp\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.580520 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.580378 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dcdce3fe-3802-410e-af19-0e5bb3e9165c-manifests\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.580520 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.580422 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dcdce3fe-3802-410e-af19-0e5bb3e9165c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.580520 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.580446 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dcdce3fe-3802-410e-af19-0e5bb3e9165c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.580876 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.580855 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dcdce3fe-3802-410e-af19-0e5bb3e9165c-manifests\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.583143 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.583117 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcdce3fe-3802-410e-af19-0e5bb3e9165c-tmp\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.583237 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.583179 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dcdce3fe-3802-410e-af19-0e5bb3e9165c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.583410 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.583373 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dcdce3fe-3802-410e-af19-0e5bb3e9165c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.588708 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.588692 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8td2m\" (UniqueName: \"kubernetes.io/projected/dcdce3fe-3802-410e-af19-0e5bb3e9165c-kube-api-access-8td2m\") pod \"opendatahub-operator-controller-manager-5dc88f9465-n9pf7\" (UID: \"dcdce3fe-3802-410e-af19-0e5bb3e9165c\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.692984 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.692959 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:54:54.939763 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.939675 2567 generic.go:356] "Generic (PLEG): container finished" podID="c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559" containerID="272b18e56b11b48e8f266227274485fbd60c5da25a69bf9977a353ccf8d56f2c" exitCode=0 Sep 10 00:54:54.939763 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.939735 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" event={"ID":"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559","Type":"ContainerDied","Data":"272b18e56b11b48e8f266227274485fbd60c5da25a69bf9977a353ccf8d56f2c"} Sep 10 00:54:54.968452 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:54.968431 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7"] Sep 10 00:54:54.974476 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:54:54.974451 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcdce3fe_3802_410e_af19_0e5bb3e9165c.slice/crio-bd3e4e4b652f8b4b2caa50059c8d351642fb5e8b4ec9fdcf670854203832a170 WatchSource:0}: Error finding container bd3e4e4b652f8b4b2caa50059c8d351642fb5e8b4ec9fdcf670854203832a170: Status 404 returned error can't find the container with id bd3e4e4b652f8b4b2caa50059c8d351642fb5e8b4ec9fdcf670854203832a170 Sep 10 00:54:55.949637 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:55.949599 2567 generic.go:356] "Generic (PLEG): container finished" podID="c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559" containerID="d3bdbc8c24e83a0860eefcef411cbba331d3a4252720ccd719df3ef87aec7dc6" exitCode=0 Sep 10 00:54:55.950091 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:55.949726 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" event={"ID":"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559","Type":"ContainerDied","Data":"d3bdbc8c24e83a0860eefcef411cbba331d3a4252720ccd719df3ef87aec7dc6"} Sep 10 00:54:55.952372 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:55.952315 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" event={"ID":"dcdce3fe-3802-410e-af19-0e5bb3e9165c","Type":"ContainerStarted","Data":"bd3e4e4b652f8b4b2caa50059c8d351642fb5e8b4ec9fdcf670854203832a170"} Sep 10 00:54:57.102494 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:57.102462 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" Sep 10 00:54:57.204048 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:57.204013 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-util\") pod \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\" (UID: \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\") " Sep 10 00:54:57.204234 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:57.204069 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ljd9\" (UniqueName: \"kubernetes.io/projected/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-kube-api-access-6ljd9\") pod \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\" (UID: \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\") " Sep 10 00:54:57.204234 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:57.204187 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-bundle\") pod \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\" (UID: \"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559\") " Sep 10 00:54:57.204965 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:57.204935 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-bundle" (OuterVolumeSpecName: "bundle") pod "c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559" (UID: "c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:54:57.206747 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:57.206709 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-kube-api-access-6ljd9" (OuterVolumeSpecName: "kube-api-access-6ljd9") pod "c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559" (UID: "c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559"). InnerVolumeSpecName "kube-api-access-6ljd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:54:57.210107 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:57.210066 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-util" (OuterVolumeSpecName: "util") pod "c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559" (UID: "c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:54:57.305347 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:57.305314 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-bundle\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:54:57.305347 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:57.305339 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-util\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:54:57.305347 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:57.305348 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ljd9\" (UniqueName: \"kubernetes.io/projected/c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559-kube-api-access-6ljd9\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:54:57.968764 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:57.968727 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" Sep 10 00:54:57.968764 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:57.968737 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r6l7k" event={"ID":"c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559","Type":"ContainerDied","Data":"199559754b7d6e896bff68e9fcbcd18316a16c3146da8212a1fdef1920ce371f"} Sep 10 00:54:57.968966 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:57.968789 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="199559754b7d6e896bff68e9fcbcd18316a16c3146da8212a1fdef1920ce371f" Sep 10 00:54:58.975368 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:58.975334 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" event={"ID":"dcdce3fe-3802-410e-af19-0e5bb3e9165c","Type":"ContainerStarted","Data":"68338478829b7193cb357c9bac1d2407c7f2cd8e56bc1a2ac04d6f945ab9ac1b"} Sep 10 00:54:59.981026 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:59.980988 2567 generic.go:356] "Generic (PLEG): container finished" podID="dcdce3fe-3802-410e-af19-0e5bb3e9165c" containerID="68338478829b7193cb357c9bac1d2407c7f2cd8e56bc1a2ac04d6f945ab9ac1b" exitCode=0 Sep 10 00:54:59.981026 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:54:59.981015 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" event={"ID":"dcdce3fe-3802-410e-af19-0e5bb3e9165c","Type":"ContainerDied","Data":"68338478829b7193cb357c9bac1d2407c7f2cd8e56bc1a2ac04d6f945ab9ac1b"} Sep 10 00:55:00.988075 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:00.988043 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" event={"ID":"dcdce3fe-3802-410e-af19-0e5bb3e9165c","Type":"ContainerStarted","Data":"cb3e2c2de726438419901055e8fc1bb6111e44288582856d330d8e395784080e"} Sep 10 00:55:00.988459 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:00.988135 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:55:01.015679 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:01.015630 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" podStartSLOduration=2.605127326 podStartE2EDuration="7.015614646s" totalImagesPullingTime="3.341339776s" totalInitContainerRuntime="1.069147544s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:54:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:55:01.014717552 +0000 UTC m=+283.965119674" watchObservedRunningTime="2026-09-10 00:55:01.015614646 +0000 UTC m=+283.966016767" Sep 10 00:55:11.994939 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:11.994900 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5dc88f9465-n9pf7" Sep 10 00:55:14.083172 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.083139 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z"] Sep 10 00:55:14.083593 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.083474 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559" containerName="util" Sep 10 00:55:14.083593 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.083486 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559" containerName="util" Sep 10 00:55:14.083593 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.083493 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559" containerName="pull" Sep 10 00:55:14.083593 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.083499 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559" containerName="pull" Sep 10 00:55:14.083593 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.083522 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559" containerName="extract" Sep 10 00:55:14.083593 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.083528 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559" containerName="extract" Sep 10 00:55:14.083593 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.083579 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8d2e4e8-c2e3-41a8-b1e1-14a41c3d9559" containerName="extract" Sep 10 00:55:14.086489 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.086470 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z" Sep 10 00:55:14.089840 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.089821 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 10 00:55:14.089935 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.089894 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 00:55:14.101245 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.101220 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z"] Sep 10 00:55:14.249745 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.249712 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b466a55-2834-4729-8f60-e772b926c0e9-tmp\") pod \"kube-auth-proxy-569dfc5d57-xz76z\" (UID: \"2b466a55-2834-4729-8f60-e772b926c0e9\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z" Sep 10 00:55:14.249924 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.249779 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b466a55-2834-4729-8f60-e772b926c0e9-tls-certs\") pod \"kube-auth-proxy-569dfc5d57-xz76z\" (UID: \"2b466a55-2834-4729-8f60-e772b926c0e9\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z" Sep 10 00:55:14.249924 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.249810 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nswl8\" (UniqueName: \"kubernetes.io/projected/2b466a55-2834-4729-8f60-e772b926c0e9-kube-api-access-nswl8\") pod \"kube-auth-proxy-569dfc5d57-xz76z\" (UID: \"2b466a55-2834-4729-8f60-e772b926c0e9\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z" Sep 10 00:55:14.350740 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.350657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b466a55-2834-4729-8f60-e772b926c0e9-tmp\") pod \"kube-auth-proxy-569dfc5d57-xz76z\" (UID: \"2b466a55-2834-4729-8f60-e772b926c0e9\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z" Sep 10 00:55:14.350876 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.350756 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b466a55-2834-4729-8f60-e772b926c0e9-tls-certs\") pod \"kube-auth-proxy-569dfc5d57-xz76z\" (UID: \"2b466a55-2834-4729-8f60-e772b926c0e9\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z" Sep 10 00:55:14.350876 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.350789 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nswl8\" (UniqueName: \"kubernetes.io/projected/2b466a55-2834-4729-8f60-e772b926c0e9-kube-api-access-nswl8\") pod \"kube-auth-proxy-569dfc5d57-xz76z\" (UID: \"2b466a55-2834-4729-8f60-e772b926c0e9\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z" Sep 10 00:55:14.353000 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.352977 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b466a55-2834-4729-8f60-e772b926c0e9-tmp\") pod \"kube-auth-proxy-569dfc5d57-xz76z\" (UID: \"2b466a55-2834-4729-8f60-e772b926c0e9\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z" Sep 10 00:55:14.353345 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.353324 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b466a55-2834-4729-8f60-e772b926c0e9-tls-certs\") pod \"kube-auth-proxy-569dfc5d57-xz76z\" (UID: \"2b466a55-2834-4729-8f60-e772b926c0e9\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z" Sep 10 00:55:14.374694 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.374669 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nswl8\" (UniqueName: \"kubernetes.io/projected/2b466a55-2834-4729-8f60-e772b926c0e9-kube-api-access-nswl8\") pod \"kube-auth-proxy-569dfc5d57-xz76z\" (UID: \"2b466a55-2834-4729-8f60-e772b926c0e9\") " pod="openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z" Sep 10 00:55:14.396124 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.396095 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z" Sep 10 00:55:14.673348 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:14.673324 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z"] Sep 10 00:55:14.675095 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:55:14.675066 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b466a55_2834_4729_8f60_e772b926c0e9.slice/crio-09eaebeab7d2457f2b5e3330f2b48fed22c72b1651ce8241a6f12295956675da WatchSource:0}: Error finding container 09eaebeab7d2457f2b5e3330f2b48fed22c72b1651ce8241a6f12295956675da: Status 404 returned error can't find the container with id 09eaebeab7d2457f2b5e3330f2b48fed22c72b1651ce8241a6f12295956675da Sep 10 00:55:15.054280 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.054203 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z" event={"ID":"2b466a55-2834-4729-8f60-e772b926c0e9","Type":"ContainerStarted","Data":"09eaebeab7d2457f2b5e3330f2b48fed22c72b1651ce8241a6f12295956675da"} Sep 10 00:55:15.383712 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.383676 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8"] Sep 10 00:55:15.388363 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.388346 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.391458 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.391437 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 00:55:15.391582 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.391464 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 00:55:15.391582 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.391511 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xntfg\"" Sep 10 00:55:15.391582 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.391470 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 00:55:15.391582 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.391464 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 00:55:15.399323 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.399298 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8"] Sep 10 00:55:15.560699 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.560668 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.560866 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.560720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.560866 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.560753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.560866 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.560789 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f6f07c-14a7-46a5-948f-d20d571a6387-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.560866 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.560836 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.561014 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.560895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92lfs\" (UniqueName: \"kubernetes.io/projected/b9f6f07c-14a7-46a5-948f-d20d571a6387-kube-api-access-92lfs\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.561014 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.560920 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.662351 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.662266 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.662351 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.662328 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.662602 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.662424 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.662602 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.662474 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.662602 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.662523 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f6f07c-14a7-46a5-948f-d20d571a6387-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.662843 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.662807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.662993 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.662975 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92lfs\" (UniqueName: \"kubernetes.io/projected/b9f6f07c-14a7-46a5-948f-d20d571a6387-kube-api-access-92lfs\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.663072 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.663042 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.665181 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.665155 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.665181 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.665177 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.665459 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.665440 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f6f07c-14a7-46a5-948f-d20d571a6387-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.665565 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.665547 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.671171 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.671135 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.671833 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.671811 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92lfs\" (UniqueName: \"kubernetes.io/projected/b9f6f07c-14a7-46a5-948f-d20d571a6387-kube-api-access-92lfs\") pod \"istiod-openshift-gateway-7b7995d5cd-tdlk8\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.698056 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.698026 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:15.994876 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:15.994783 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8"] Sep 10 00:55:15.996197 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:55:15.996165 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f6f07c_14a7_46a5_948f_d20d571a6387.slice/crio-826fa07c1c4ae0c6ce3823d8e0b03060a02733d3c4a192f2ba1b92cb34c37eb9 WatchSource:0}: Error finding container 826fa07c1c4ae0c6ce3823d8e0b03060a02733d3c4a192f2ba1b92cb34c37eb9: Status 404 returned error can't find the container with id 826fa07c1c4ae0c6ce3823d8e0b03060a02733d3c4a192f2ba1b92cb34c37eb9 Sep 10 00:55:16.063428 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:16.063362 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" event={"ID":"b9f6f07c-14a7-46a5-948f-d20d571a6387","Type":"ContainerStarted","Data":"826fa07c1c4ae0c6ce3823d8e0b03060a02733d3c4a192f2ba1b92cb34c37eb9"} Sep 10 00:55:17.805042 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:17.805013 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/ovn-acl-logging/0.log" Sep 10 00:55:17.807405 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:17.805312 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/ovn-acl-logging/0.log" Sep 10 00:55:17.812878 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:17.812859 2567 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 00:55:17.835987 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:17.835970 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 00:55:18.077706 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:18.077668 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z" event={"ID":"2b466a55-2834-4729-8f60-e772b926c0e9","Type":"ContainerStarted","Data":"31f765db92e19102f54d73fc7641f52e1093f68a3205ea94dc14d17149f02b0e"} Sep 10 00:55:18.096705 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:18.096642 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-569dfc5d57-xz76z" podStartSLOduration=0.940847934 podStartE2EDuration="4.096621671s" totalImagesPullingTime="3.155773737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:55:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:55:18.095107477 +0000 UTC m=+301.045509598" watchObservedRunningTime="2026-09-10 00:55:18.096621671 +0000 UTC m=+301.047023793" Sep 10 00:55:19.665087 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:19.665043 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"} Sep 10 00:55:19.665407 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:19.665120 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"} Sep 10 00:55:20.090672 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:20.090639 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" event={"ID":"b9f6f07c-14a7-46a5-948f-d20d571a6387","Type":"ContainerStarted","Data":"01660bbe08ff60ad109c7877607ec8b7cb5273cd272f0fc440f7133e41930e87"} Sep 10 00:55:20.090874 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:20.090795 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:20.092588 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:20.092563 2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-tdlk8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 10 00:55:20.092693 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:20.092616 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" podUID="b9f6f07c-14a7-46a5-948f-d20d571a6387" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 00:55:20.112660 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:20.112612 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" podStartSLOduration=1.446552042 podStartE2EDuration="5.112599711s" totalImagesPullingTime="3.666047669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:55:20.110270592 +0000 UTC m=+303.060672713" watchObservedRunningTime="2026-09-10 00:55:20.112599711 +0000 UTC m=+303.063001832" Sep 10 00:55:21.096433 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:21.096404 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:33.039712 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.039673 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68"] Sep 10 00:55:33.046601 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.046576 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:33.050480 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.050458 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 00:55:33.050604 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.050458 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 00:55:33.051778 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.051757 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 00:55:33.052097 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.052081 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 00:55:33.052166 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.052094 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qmdts\"" Sep 10 00:55:33.052166 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.052081 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 00:55:33.067608 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.067584 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68"] Sep 10 00:55:33.118643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.118611 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d4dfe06-d845-4f0f-aac5-9c28d9991ee2-metrics-cert\") pod \"lws-controller-manager-56bf56cd54-8lh68\" (UID: \"5d4dfe06-d845-4f0f-aac5-9c28d9991ee2\") " pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:33.118643 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.118643 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z8k5\" (UniqueName: \"kubernetes.io/projected/5d4dfe06-d845-4f0f-aac5-9c28d9991ee2-kube-api-access-9z8k5\") pod \"lws-controller-manager-56bf56cd54-8lh68\" (UID: \"5d4dfe06-d845-4f0f-aac5-9c28d9991ee2\") " pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:33.118889 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.118664 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5d4dfe06-d845-4f0f-aac5-9c28d9991ee2-manager-config\") pod \"lws-controller-manager-56bf56cd54-8lh68\" (UID: \"5d4dfe06-d845-4f0f-aac5-9c28d9991ee2\") " pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:33.118889 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.118837 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d4dfe06-d845-4f0f-aac5-9c28d9991ee2-cert\") pod \"lws-controller-manager-56bf56cd54-8lh68\" (UID: \"5d4dfe06-d845-4f0f-aac5-9c28d9991ee2\") " pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:33.219963 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.219930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d4dfe06-d845-4f0f-aac5-9c28d9991ee2-cert\") pod \"lws-controller-manager-56bf56cd54-8lh68\" (UID: \"5d4dfe06-d845-4f0f-aac5-9c28d9991ee2\") " pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:33.220167 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.219974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d4dfe06-d845-4f0f-aac5-9c28d9991ee2-metrics-cert\") pod \"lws-controller-manager-56bf56cd54-8lh68\" (UID: \"5d4dfe06-d845-4f0f-aac5-9c28d9991ee2\") " pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:33.220167 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.219993 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z8k5\" (UniqueName: \"kubernetes.io/projected/5d4dfe06-d845-4f0f-aac5-9c28d9991ee2-kube-api-access-9z8k5\") pod \"lws-controller-manager-56bf56cd54-8lh68\" (UID: \"5d4dfe06-d845-4f0f-aac5-9c28d9991ee2\") " pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:33.220167 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.220049 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5d4dfe06-d845-4f0f-aac5-9c28d9991ee2-manager-config\") pod \"lws-controller-manager-56bf56cd54-8lh68\" (UID: \"5d4dfe06-d845-4f0f-aac5-9c28d9991ee2\") " pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:33.220678 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.220652 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5d4dfe06-d845-4f0f-aac5-9c28d9991ee2-manager-config\") pod \"lws-controller-manager-56bf56cd54-8lh68\" (UID: \"5d4dfe06-d845-4f0f-aac5-9c28d9991ee2\") " pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:33.222545 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.222520 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d4dfe06-d845-4f0f-aac5-9c28d9991ee2-cert\") pod \"lws-controller-manager-56bf56cd54-8lh68\" (UID: \"5d4dfe06-d845-4f0f-aac5-9c28d9991ee2\") " pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:33.222678 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.222656 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d4dfe06-d845-4f0f-aac5-9c28d9991ee2-metrics-cert\") pod \"lws-controller-manager-56bf56cd54-8lh68\" (UID: \"5d4dfe06-d845-4f0f-aac5-9c28d9991ee2\") " pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:33.233194 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.233170 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z8k5\" (UniqueName: \"kubernetes.io/projected/5d4dfe06-d845-4f0f-aac5-9c28d9991ee2-kube-api-access-9z8k5\") pod \"lws-controller-manager-56bf56cd54-8lh68\" (UID: \"5d4dfe06-d845-4f0f-aac5-9c28d9991ee2\") " pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:33.356303 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.356270 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:33.629698 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.629669 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68"] Sep 10 00:55:33.631836 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:55:33.631808 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4dfe06_d845_4f0f_aac5_9c28d9991ee2.slice/crio-663e0847a1129d7f32ddfd5c909d94eb82dc5f6a2d1cd8f0602512216f0f79bb WatchSource:0}: Error finding container 663e0847a1129d7f32ddfd5c909d94eb82dc5f6a2d1cd8f0602512216f0f79bb: Status 404 returned error can't find the container with id 663e0847a1129d7f32ddfd5c909d94eb82dc5f6a2d1cd8f0602512216f0f79bb Sep 10 00:55:33.633928 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:33.633908 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 00:55:34.159734 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:34.159700 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" event={"ID":"5d4dfe06-d845-4f0f-aac5-9c28d9991ee2","Type":"ContainerStarted","Data":"663e0847a1129d7f32ddfd5c909d94eb82dc5f6a2d1cd8f0602512216f0f79bb"} Sep 10 00:55:35.545038 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.544835 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8"] Sep 10 00:55:35.545527 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.545095 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" podUID="b9f6f07c-14a7-46a5-948f-d20d571a6387" containerName="discovery" containerID="cri-o://01660bbe08ff60ad109c7877607ec8b7cb5273cd272f0fc440f7133e41930e87" gracePeriod=30 Sep 10 00:55:35.793892 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.793866 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:35.843622 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.843595 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-csr-dns-cert\") pod \"b9f6f07c-14a7-46a5-948f-d20d571a6387\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " Sep 10 00:55:35.843622 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.843625 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-token\") pod \"b9f6f07c-14a7-46a5-948f-d20d571a6387\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " Sep 10 00:55:35.843823 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.843652 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-cacerts\") pod \"b9f6f07c-14a7-46a5-948f-d20d571a6387\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " Sep 10 00:55:35.843823 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.843693 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f6f07c-14a7-46a5-948f-d20d571a6387-local-certs\") pod \"b9f6f07c-14a7-46a5-948f-d20d571a6387\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " Sep 10 00:55:35.843823 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.843722 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-csr-ca-configmap\") pod \"b9f6f07c-14a7-46a5-948f-d20d571a6387\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " Sep 10 00:55:35.843823 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.843784 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92lfs\" (UniqueName: \"kubernetes.io/projected/b9f6f07c-14a7-46a5-948f-d20d571a6387-kube-api-access-92lfs\") pod \"b9f6f07c-14a7-46a5-948f-d20d571a6387\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " Sep 10 00:55:35.843823 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.843808 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-kubeconfig\") pod \"b9f6f07c-14a7-46a5-948f-d20d571a6387\" (UID: \"b9f6f07c-14a7-46a5-948f-d20d571a6387\") " Sep 10 00:55:35.844201 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.844168 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "b9f6f07c-14a7-46a5-948f-d20d571a6387" (UID: "b9f6f07c-14a7-46a5-948f-d20d571a6387"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:55:35.846246 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.846212 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-cacerts" (OuterVolumeSpecName: "cacerts") pod "b9f6f07c-14a7-46a5-948f-d20d571a6387" (UID: "b9f6f07c-14a7-46a5-948f-d20d571a6387"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:55:35.846342 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.846268 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9f6f07c-14a7-46a5-948f-d20d571a6387" (UID: "b9f6f07c-14a7-46a5-948f-d20d571a6387"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:55:35.846446 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.846432 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f6f07c-14a7-46a5-948f-d20d571a6387-local-certs" (OuterVolumeSpecName: "local-certs") pod "b9f6f07c-14a7-46a5-948f-d20d571a6387" (UID: "b9f6f07c-14a7-46a5-948f-d20d571a6387"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:55:35.846573 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.846557 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "b9f6f07c-14a7-46a5-948f-d20d571a6387" (UID: "b9f6f07c-14a7-46a5-948f-d20d571a6387"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:55:35.846659 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.846637 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "b9f6f07c-14a7-46a5-948f-d20d571a6387" (UID: "b9f6f07c-14a7-46a5-948f-d20d571a6387"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:55:35.846692 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.846637 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f6f07c-14a7-46a5-948f-d20d571a6387-kube-api-access-92lfs" (OuterVolumeSpecName: "kube-api-access-92lfs") pod "b9f6f07c-14a7-46a5-948f-d20d571a6387" (UID: "b9f6f07c-14a7-46a5-948f-d20d571a6387"). InnerVolumeSpecName "kube-api-access-92lfs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:55:35.944752 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.944718 2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-csr-dns-cert\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:55:35.944752 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.944747 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-token\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:55:35.944752 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.944755 2567 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-cacerts\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:55:35.944972 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.944763 2567 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f6f07c-14a7-46a5-948f-d20d571a6387-local-certs\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:55:35.944972 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.944773 2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-csr-ca-configmap\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:55:35.944972 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.944784 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92lfs\" (UniqueName: \"kubernetes.io/projected/b9f6f07c-14a7-46a5-948f-d20d571a6387-kube-api-access-92lfs\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:55:35.944972 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:35.944793 2567 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9f6f07c-14a7-46a5-948f-d20d571a6387-istio-kubeconfig\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:55:36.170786 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:36.170693 2567 generic.go:356] "Generic (PLEG): container finished" podID="b9f6f07c-14a7-46a5-948f-d20d571a6387" containerID="01660bbe08ff60ad109c7877607ec8b7cb5273cd272f0fc440f7133e41930e87" exitCode=0 Sep 10 00:55:36.170786 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:36.170752 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" Sep 10 00:55:36.171019 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:36.170786 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" event={"ID":"b9f6f07c-14a7-46a5-948f-d20d571a6387","Type":"ContainerDied","Data":"01660bbe08ff60ad109c7877607ec8b7cb5273cd272f0fc440f7133e41930e87"} Sep 10 00:55:36.171019 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:36.170874 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8" event={"ID":"b9f6f07c-14a7-46a5-948f-d20d571a6387","Type":"ContainerDied","Data":"826fa07c1c4ae0c6ce3823d8e0b03060a02733d3c4a192f2ba1b92cb34c37eb9"} Sep 10 00:55:36.171019 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:36.170903 2567 scope.go:117] "RemoveContainer" containerID="01660bbe08ff60ad109c7877607ec8b7cb5273cd272f0fc440f7133e41930e87" Sep 10 00:55:36.172590 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:36.172560 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" event={"ID":"5d4dfe06-d845-4f0f-aac5-9c28d9991ee2","Type":"ContainerStarted","Data":"526a8a475947d2cbaff32dbb3f548648f661fef006ad460511f078f1d99da875"} Sep 10 00:55:36.172727 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:36.172656 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:55:36.180533 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:36.180515 2567 scope.go:117] "RemoveContainer" containerID="01660bbe08ff60ad109c7877607ec8b7cb5273cd272f0fc440f7133e41930e87" Sep 10 00:55:36.180802 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:55:36.180783 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01660bbe08ff60ad109c7877607ec8b7cb5273cd272f0fc440f7133e41930e87\": container with ID starting with 01660bbe08ff60ad109c7877607ec8b7cb5273cd272f0fc440f7133e41930e87 not found: ID does not exist" containerID="01660bbe08ff60ad109c7877607ec8b7cb5273cd272f0fc440f7133e41930e87" Sep 10 00:55:36.180843 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:36.180809 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01660bbe08ff60ad109c7877607ec8b7cb5273cd272f0fc440f7133e41930e87"} err="failed to get container status \"01660bbe08ff60ad109c7877607ec8b7cb5273cd272f0fc440f7133e41930e87\": rpc error: code = NotFound desc = could not find container \"01660bbe08ff60ad109c7877607ec8b7cb5273cd272f0fc440f7133e41930e87\": container with ID starting with 01660bbe08ff60ad109c7877607ec8b7cb5273cd272f0fc440f7133e41930e87 not found: ID does not exist" Sep 10 00:55:36.207763 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:36.207722 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" podStartSLOduration=2.176548072 podStartE2EDuration="4.207707582s" totalImagesPullingTime="2.03115951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:55:36.206210462 +0000 UTC m=+319.156612583" watchObservedRunningTime="2026-09-10 00:55:36.207707582 +0000 UTC m=+319.158109703" Sep 10 00:55:36.238463 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:36.238427 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8"] Sep 10 00:55:36.255962 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:36.255935 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tdlk8"] Sep 10 00:55:37.528487 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:37.528457 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9f6f07c-14a7-46a5-948f-d20d571a6387" path="/var/lib/kubelet/pods/b9f6f07c-14a7-46a5-948f-d20d571a6387/volumes" Sep 10 00:55:47.180942 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:55:47.180905 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56bf56cd54-8lh68" Sep 10 00:56:29.263802 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.263763 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92"] Sep 10 00:56:29.264248 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.264095 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f6f07c-14a7-46a5-948f-d20d571a6387" containerName="discovery" Sep 10 00:56:29.264248 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.264105 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f6f07c-14a7-46a5-948f-d20d571a6387" containerName="discovery" Sep 10 00:56:29.264248 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.264177 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9f6f07c-14a7-46a5-948f-d20d571a6387" containerName="discovery" Sep 10 00:56:29.268505 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.268488 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" Sep 10 00:56:29.271446 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.271414 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vg5b9\"" Sep 10 00:56:29.271613 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.271414 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 00:56:29.271705 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.271416 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 00:56:29.275040 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.275014 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92"] Sep 10 00:56:29.286635 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.286607 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f434e280-17cf-41c1-916e-ec51d141d3f1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92\" (UID: \"f434e280-17cf-41c1-916e-ec51d141d3f1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" Sep 10 00:56:29.286759 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.286641 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjcss\" (UniqueName: \"kubernetes.io/projected/f434e280-17cf-41c1-916e-ec51d141d3f1-kube-api-access-zjcss\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92\" (UID: \"f434e280-17cf-41c1-916e-ec51d141d3f1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" Sep 10 00:56:29.286759 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.286684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f434e280-17cf-41c1-916e-ec51d141d3f1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92\" (UID: \"f434e280-17cf-41c1-916e-ec51d141d3f1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" Sep 10 00:56:29.364126 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.364085 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj"] Sep 10 00:56:29.367602 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.367578 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" Sep 10 00:56:29.375314 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.375168 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj"] Sep 10 00:56:29.387487 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.387460 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a379a0f-f902-42b1-b793-ef91c4b5c52c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj\" (UID: \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" Sep 10 00:56:29.387619 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.387494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f434e280-17cf-41c1-916e-ec51d141d3f1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92\" (UID: \"f434e280-17cf-41c1-916e-ec51d141d3f1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" Sep 10 00:56:29.387619 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.387527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjcss\" (UniqueName: \"kubernetes.io/projected/f434e280-17cf-41c1-916e-ec51d141d3f1-kube-api-access-zjcss\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92\" (UID: \"f434e280-17cf-41c1-916e-ec51d141d3f1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" Sep 10 00:56:29.387619 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.387575 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f434e280-17cf-41c1-916e-ec51d141d3f1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92\" (UID: \"f434e280-17cf-41c1-916e-ec51d141d3f1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" Sep 10 00:56:29.387619 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.387612 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a379a0f-f902-42b1-b793-ef91c4b5c52c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj\" (UID: \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" Sep 10 00:56:29.387820 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.387634 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7dwv\" (UniqueName: \"kubernetes.io/projected/8a379a0f-f902-42b1-b793-ef91c4b5c52c-kube-api-access-c7dwv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj\" (UID: \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" Sep 10 00:56:29.387923 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.387901 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f434e280-17cf-41c1-916e-ec51d141d3f1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92\" (UID: \"f434e280-17cf-41c1-916e-ec51d141d3f1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" Sep 10 00:56:29.387963 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.387912 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f434e280-17cf-41c1-916e-ec51d141d3f1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92\" (UID: \"f434e280-17cf-41c1-916e-ec51d141d3f1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" Sep 10 00:56:29.396345 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.396320 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjcss\" (UniqueName: \"kubernetes.io/projected/f434e280-17cf-41c1-916e-ec51d141d3f1-kube-api-access-zjcss\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92\" (UID: \"f434e280-17cf-41c1-916e-ec51d141d3f1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" Sep 10 00:56:29.461941 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.461906 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6"] Sep 10 00:56:29.465519 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.465500 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" Sep 10 00:56:29.474059 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.474030 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6"] Sep 10 00:56:29.488264 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.488237 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6\" (UID: \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" Sep 10 00:56:29.488264 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.488264 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6\" (UID: \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" Sep 10 00:56:29.488451 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.488364 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a379a0f-f902-42b1-b793-ef91c4b5c52c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj\" (UID: \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" Sep 10 00:56:29.488451 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.488421 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7dwv\" (UniqueName: \"kubernetes.io/projected/8a379a0f-f902-42b1-b793-ef91c4b5c52c-kube-api-access-c7dwv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj\" (UID: \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" Sep 10 00:56:29.488451 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.488445 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk4sp\" (UniqueName: \"kubernetes.io/projected/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-kube-api-access-bk4sp\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6\" (UID: \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" Sep 10 00:56:29.488558 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.488469 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a379a0f-f902-42b1-b793-ef91c4b5c52c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj\" (UID: \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" Sep 10 00:56:29.488680 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.488661 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a379a0f-f902-42b1-b793-ef91c4b5c52c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj\" (UID: \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" Sep 10 00:56:29.488745 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.488731 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a379a0f-f902-42b1-b793-ef91c4b5c52c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj\" (UID: \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" Sep 10 00:56:29.496683 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.496660 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7dwv\" (UniqueName: \"kubernetes.io/projected/8a379a0f-f902-42b1-b793-ef91c4b5c52c-kube-api-access-c7dwv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj\" (UID: \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" Sep 10 00:56:29.565318 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.565233 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs"] Sep 10 00:56:29.568982 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.568965 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" Sep 10 00:56:29.575529 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.575505 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs"] Sep 10 00:56:29.578475 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.578454 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" Sep 10 00:56:29.589586 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.589560 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk4sp\" (UniqueName: \"kubernetes.io/projected/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-kube-api-access-bk4sp\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6\" (UID: \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" Sep 10 00:56:29.589751 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.589732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2abe1a84-ec37-49e4-aca4-5fd813311214-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs\" (UID: \"2abe1a84-ec37-49e4-aca4-5fd813311214\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" Sep 10 00:56:29.589881 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.589859 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd4wg\" (UniqueName: \"kubernetes.io/projected/2abe1a84-ec37-49e4-aca4-5fd813311214-kube-api-access-sd4wg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs\" (UID: \"2abe1a84-ec37-49e4-aca4-5fd813311214\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" Sep 10 00:56:29.589995 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.589898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2abe1a84-ec37-49e4-aca4-5fd813311214-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs\" (UID: \"2abe1a84-ec37-49e4-aca4-5fd813311214\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" Sep 10 00:56:29.589995 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.589958 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6\" (UID: \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" Sep 10 00:56:29.589995 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.589983 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6\" (UID: \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" Sep 10 00:56:29.590424 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.590405 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6\" (UID: \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" Sep 10 00:56:29.590521 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.590375 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6\" (UID: \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" Sep 10 00:56:29.598039 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.598015 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk4sp\" (UniqueName: \"kubernetes.io/projected/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-kube-api-access-bk4sp\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6\" (UID: \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" Sep 10 00:56:29.678868 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.678837 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" Sep 10 00:56:29.691424 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.691402 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2abe1a84-ec37-49e4-aca4-5fd813311214-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs\" (UID: \"2abe1a84-ec37-49e4-aca4-5fd813311214\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" Sep 10 00:56:29.691515 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.691442 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd4wg\" (UniqueName: \"kubernetes.io/projected/2abe1a84-ec37-49e4-aca4-5fd813311214-kube-api-access-sd4wg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs\" (UID: \"2abe1a84-ec37-49e4-aca4-5fd813311214\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" Sep 10 00:56:29.691515 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.691462 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2abe1a84-ec37-49e4-aca4-5fd813311214-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs\" (UID: \"2abe1a84-ec37-49e4-aca4-5fd813311214\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" Sep 10 00:56:29.691785 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.691764 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2abe1a84-ec37-49e4-aca4-5fd813311214-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs\" (UID: \"2abe1a84-ec37-49e4-aca4-5fd813311214\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" Sep 10 00:56:29.691846 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.691796 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2abe1a84-ec37-49e4-aca4-5fd813311214-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs\" (UID: \"2abe1a84-ec37-49e4-aca4-5fd813311214\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" Sep 10 00:56:29.700490 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.700464 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd4wg\" (UniqueName: \"kubernetes.io/projected/2abe1a84-ec37-49e4-aca4-5fd813311214-kube-api-access-sd4wg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs\" (UID: \"2abe1a84-ec37-49e4-aca4-5fd813311214\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" Sep 10 00:56:29.776786 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.776745 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" Sep 10 00:56:29.854023 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.853993 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92"] Sep 10 00:56:29.855459 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:56:29.855434 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf434e280_17cf_41c1_916e_ec51d141d3f1.slice/crio-095e0a9c09beec38d9cd956ebd1e721ad80404cba2cc06f309bc9a2c84ddda2a WatchSource:0}: Error finding container 095e0a9c09beec38d9cd956ebd1e721ad80404cba2cc06f309bc9a2c84ddda2a: Status 404 returned error can't find the container with id 095e0a9c09beec38d9cd956ebd1e721ad80404cba2cc06f309bc9a2c84ddda2a Sep 10 00:56:29.879582 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.879562 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" Sep 10 00:56:29.952466 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:29.952436 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj"] Sep 10 00:56:29.954336 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:56:29.954298 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a379a0f_f902_42b1_b793_ef91c4b5c52c.slice/crio-980a6eea448bdec7222e46a4e36108245e8a8091d7c08d21cc2224dff5cd2f8a WatchSource:0}: Error finding container 980a6eea448bdec7222e46a4e36108245e8a8091d7c08d21cc2224dff5cd2f8a: Status 404 returned error can't find the container with id 980a6eea448bdec7222e46a4e36108245e8a8091d7c08d21cc2224dff5cd2f8a Sep 10 00:56:30.049348 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:30.049323 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6"] Sep 10 00:56:30.050092 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:56:30.050058 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod626f0932_7e4f_46ef_8d0e_abacbc9c3eb4.slice/crio-29f039bd373577715ff6ea2fa2818fab927e5be5f82f02716636e17635c2f6f9 WatchSource:0}: Error finding container 29f039bd373577715ff6ea2fa2818fab927e5be5f82f02716636e17635c2f6f9: Status 404 returned error can't find the container with id 29f039bd373577715ff6ea2fa2818fab927e5be5f82f02716636e17635c2f6f9 Sep 10 00:56:30.154079 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:30.154047 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs"] Sep 10 00:56:30.216326 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:56:30.216290 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abe1a84_ec37_49e4_aca4_5fd813311214.slice/crio-e761ac52495d09d6d23098895307c13702bcadca1210213a160d18bc7dbe9976 WatchSource:0}: Error finding container e761ac52495d09d6d23098895307c13702bcadca1210213a160d18bc7dbe9976: Status 404 returned error can't find the container with id e761ac52495d09d6d23098895307c13702bcadca1210213a160d18bc7dbe9976 Sep 10 00:56:30.446927 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:30.446829 2567 generic.go:356] "Generic (PLEG): container finished" podID="f434e280-17cf-41c1-916e-ec51d141d3f1" containerID="1e6288440466fb295033f0c9d1a3a0940df971fb72758783050e645d8f9463a0" exitCode=0 Sep 10 00:56:30.446927 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:30.446877 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" event={"ID":"f434e280-17cf-41c1-916e-ec51d141d3f1","Type":"ContainerDied","Data":"1e6288440466fb295033f0c9d1a3a0940df971fb72758783050e645d8f9463a0"} Sep 10 00:56:30.447412 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:30.446962 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" event={"ID":"f434e280-17cf-41c1-916e-ec51d141d3f1","Type":"ContainerStarted","Data":"095e0a9c09beec38d9cd956ebd1e721ad80404cba2cc06f309bc9a2c84ddda2a"} Sep 10 00:56:30.448864 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:30.448841 2567 generic.go:356] "Generic (PLEG): container finished" podID="2abe1a84-ec37-49e4-aca4-5fd813311214" containerID="779b51bead8aa9ab43e1d3ec8841c6b914c7063b2264b7f2108623f71efe37af" exitCode=0 Sep 10 00:56:30.448967 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:30.448932 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" event={"ID":"2abe1a84-ec37-49e4-aca4-5fd813311214","Type":"ContainerDied","Data":"779b51bead8aa9ab43e1d3ec8841c6b914c7063b2264b7f2108623f71efe37af"} Sep 10 00:56:30.449023 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:30.448987 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" event={"ID":"2abe1a84-ec37-49e4-aca4-5fd813311214","Type":"ContainerStarted","Data":"e761ac52495d09d6d23098895307c13702bcadca1210213a160d18bc7dbe9976"} Sep 10 00:56:30.450677 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:30.450657 2567 generic.go:356] "Generic (PLEG): container finished" podID="8a379a0f-f902-42b1-b793-ef91c4b5c52c" containerID="93f5636efdbcb5499b4b348f0f4a32a5aa60999c1345171cc05504c389a4487b" exitCode=0 Sep 10 00:56:30.450780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:30.450723 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" event={"ID":"8a379a0f-f902-42b1-b793-ef91c4b5c52c","Type":"ContainerDied","Data":"93f5636efdbcb5499b4b348f0f4a32a5aa60999c1345171cc05504c389a4487b"} Sep 10 00:56:30.450780 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:30.450765 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" event={"ID":"8a379a0f-f902-42b1-b793-ef91c4b5c52c","Type":"ContainerStarted","Data":"980a6eea448bdec7222e46a4e36108245e8a8091d7c08d21cc2224dff5cd2f8a"} Sep 10 00:56:30.452463 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:30.452443 2567 generic.go:356] "Generic (PLEG): container finished" podID="626f0932-7e4f-46ef-8d0e-abacbc9c3eb4" containerID="e286809251e9a47f9d5343c15989cadfcbef96d444d3c52f863196e2c3cf08ea" exitCode=0 Sep 10 00:56:30.452557 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:30.452471 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" event={"ID":"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4","Type":"ContainerDied","Data":"e286809251e9a47f9d5343c15989cadfcbef96d444d3c52f863196e2c3cf08ea"} Sep 10 00:56:30.452557 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:30.452515 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" event={"ID":"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4","Type":"ContainerStarted","Data":"29f039bd373577715ff6ea2fa2818fab927e5be5f82f02716636e17635c2f6f9"} Sep 10 00:56:31.460013 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:31.459975 2567 generic.go:356] "Generic (PLEG): container finished" podID="2abe1a84-ec37-49e4-aca4-5fd813311214" containerID="45827703f95a84355f3166f1ca04f0f9b6d6669f9ecebecae69b27ce70d7e757" exitCode=0 Sep 10 00:56:31.460443 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:31.460016 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" event={"ID":"2abe1a84-ec37-49e4-aca4-5fd813311214","Type":"ContainerDied","Data":"45827703f95a84355f3166f1ca04f0f9b6d6669f9ecebecae69b27ce70d7e757"} Sep 10 00:56:31.461875 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:31.461856 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" event={"ID":"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4","Type":"ContainerStarted","Data":"1692566ef7d3f1caae11e16d0525798e1068cf7dc16d9c07d7eed1f1e9fbd3c8"} Sep 10 00:56:32.468614 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:32.468579 2567 generic.go:356] "Generic (PLEG): container finished" podID="f434e280-17cf-41c1-916e-ec51d141d3f1" containerID="9ee731447c285eadb1e970a0ea38e3ee9d264a391242c9b6ddb142ec5870ae00" exitCode=0 Sep 10 00:56:32.469021 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:32.468665 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" event={"ID":"f434e280-17cf-41c1-916e-ec51d141d3f1","Type":"ContainerDied","Data":"9ee731447c285eadb1e970a0ea38e3ee9d264a391242c9b6ddb142ec5870ae00"} Sep 10 00:56:32.471566 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:32.471546 2567 generic.go:356] "Generic (PLEG): container finished" podID="2abe1a84-ec37-49e4-aca4-5fd813311214" containerID="8ca6f35d3081c8c8f9820a0795966f1bb3f2684928c71f625a1dda4c827c03ee" exitCode=0 Sep 10 00:56:32.471659 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:32.471569 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" event={"ID":"2abe1a84-ec37-49e4-aca4-5fd813311214","Type":"ContainerDied","Data":"8ca6f35d3081c8c8f9820a0795966f1bb3f2684928c71f625a1dda4c827c03ee"} Sep 10 00:56:32.473464 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:32.473443 2567 generic.go:356] "Generic (PLEG): container finished" podID="8a379a0f-f902-42b1-b793-ef91c4b5c52c" containerID="e9bcef0517533f508e715074853e47c94d3b5edf24a28242359b965a0a6e7ebe" exitCode=0 Sep 10 00:56:32.473577 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:32.473506 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" event={"ID":"8a379a0f-f902-42b1-b793-ef91c4b5c52c","Type":"ContainerDied","Data":"e9bcef0517533f508e715074853e47c94d3b5edf24a28242359b965a0a6e7ebe"} Sep 10 00:56:32.475570 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:32.475550 2567 generic.go:356] "Generic (PLEG): container finished" podID="626f0932-7e4f-46ef-8d0e-abacbc9c3eb4" containerID="1692566ef7d3f1caae11e16d0525798e1068cf7dc16d9c07d7eed1f1e9fbd3c8" exitCode=0 Sep 10 00:56:32.475660 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:32.475580 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" event={"ID":"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4","Type":"ContainerDied","Data":"1692566ef7d3f1caae11e16d0525798e1068cf7dc16d9c07d7eed1f1e9fbd3c8"} Sep 10 00:56:33.483292 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.483247 2567 generic.go:356] "Generic (PLEG): container finished" podID="8a379a0f-f902-42b1-b793-ef91c4b5c52c" containerID="7d99525f7fafd3a195572983704a35fb6f7101f0ddbf28621edd903a4b69d743" exitCode=0 Sep 10 00:56:33.483687 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.483310 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" event={"ID":"8a379a0f-f902-42b1-b793-ef91c4b5c52c","Type":"ContainerDied","Data":"7d99525f7fafd3a195572983704a35fb6f7101f0ddbf28621edd903a4b69d743"} Sep 10 00:56:33.485565 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.485543 2567 generic.go:356] "Generic (PLEG): container finished" podID="626f0932-7e4f-46ef-8d0e-abacbc9c3eb4" containerID="f035ac6a49764358c91ea500fcd105e32a89a7180ecb51788cb6742b7ddf00e7" exitCode=0 Sep 10 00:56:33.485673 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.485629 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" event={"ID":"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4","Type":"ContainerDied","Data":"f035ac6a49764358c91ea500fcd105e32a89a7180ecb51788cb6742b7ddf00e7"} Sep 10 00:56:33.487745 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.487725 2567 generic.go:356] "Generic (PLEG): container finished" podID="f434e280-17cf-41c1-916e-ec51d141d3f1" containerID="bc998a71f7b538455d166e5d2f4c581d54be78d1ac9eabfc35e9ed9ebc0bcd19" exitCode=0 Sep 10 00:56:33.487827 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.487789 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" event={"ID":"f434e280-17cf-41c1-916e-ec51d141d3f1","Type":"ContainerDied","Data":"bc998a71f7b538455d166e5d2f4c581d54be78d1ac9eabfc35e9ed9ebc0bcd19"} Sep 10 00:56:33.622519 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.622492 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" Sep 10 00:56:33.728984 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.728882 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd4wg\" (UniqueName: \"kubernetes.io/projected/2abe1a84-ec37-49e4-aca4-5fd813311214-kube-api-access-sd4wg\") pod \"2abe1a84-ec37-49e4-aca4-5fd813311214\" (UID: \"2abe1a84-ec37-49e4-aca4-5fd813311214\") " Sep 10 00:56:33.728984 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.728932 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2abe1a84-ec37-49e4-aca4-5fd813311214-bundle\") pod \"2abe1a84-ec37-49e4-aca4-5fd813311214\" (UID: \"2abe1a84-ec37-49e4-aca4-5fd813311214\") " Sep 10 00:56:33.729215 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.728993 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2abe1a84-ec37-49e4-aca4-5fd813311214-util\") pod \"2abe1a84-ec37-49e4-aca4-5fd813311214\" (UID: \"2abe1a84-ec37-49e4-aca4-5fd813311214\") " Sep 10 00:56:33.729454 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.729429 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abe1a84-ec37-49e4-aca4-5fd813311214-bundle" (OuterVolumeSpecName: "bundle") pod "2abe1a84-ec37-49e4-aca4-5fd813311214" (UID: "2abe1a84-ec37-49e4-aca4-5fd813311214"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:56:33.731200 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.731179 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2abe1a84-ec37-49e4-aca4-5fd813311214-kube-api-access-sd4wg" (OuterVolumeSpecName: "kube-api-access-sd4wg") pod "2abe1a84-ec37-49e4-aca4-5fd813311214" (UID: "2abe1a84-ec37-49e4-aca4-5fd813311214"). InnerVolumeSpecName "kube-api-access-sd4wg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:56:33.734396 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.734364 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abe1a84-ec37-49e4-aca4-5fd813311214-util" (OuterVolumeSpecName: "util") pod "2abe1a84-ec37-49e4-aca4-5fd813311214" (UID: "2abe1a84-ec37-49e4-aca4-5fd813311214"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:56:33.830288 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.830250 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2abe1a84-ec37-49e4-aca4-5fd813311214-util\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:56:33.830288 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.830280 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd4wg\" (UniqueName: \"kubernetes.io/projected/2abe1a84-ec37-49e4-aca4-5fd813311214-kube-api-access-sd4wg\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:56:33.830288 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:33.830291 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2abe1a84-ec37-49e4-aca4-5fd813311214-bundle\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:56:34.494559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.494522 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" event={"ID":"2abe1a84-ec37-49e4-aca4-5fd813311214","Type":"ContainerDied","Data":"e761ac52495d09d6d23098895307c13702bcadca1210213a160d18bc7dbe9976"} Sep 10 00:56:34.494963 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.494613 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e761ac52495d09d6d23098895307c13702bcadca1210213a160d18bc7dbe9976" Sep 10 00:56:34.494963 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.494542 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hblbs" Sep 10 00:56:34.632125 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.632102 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" Sep 10 00:56:34.681070 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.681047 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" Sep 10 00:56:34.684571 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.684544 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" Sep 10 00:56:34.740304 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.740273 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f434e280-17cf-41c1-916e-ec51d141d3f1-util\") pod \"f434e280-17cf-41c1-916e-ec51d141d3f1\" (UID: \"f434e280-17cf-41c1-916e-ec51d141d3f1\") " Sep 10 00:56:34.740503 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.740328 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-bundle\") pod \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\" (UID: \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\") " Sep 10 00:56:34.740503 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.740379 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjcss\" (UniqueName: \"kubernetes.io/projected/f434e280-17cf-41c1-916e-ec51d141d3f1-kube-api-access-zjcss\") pod \"f434e280-17cf-41c1-916e-ec51d141d3f1\" (UID: \"f434e280-17cf-41c1-916e-ec51d141d3f1\") " Sep 10 00:56:34.740503 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.740441 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a379a0f-f902-42b1-b793-ef91c4b5c52c-util\") pod \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\" (UID: \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\") " Sep 10 00:56:34.740503 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.740467 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7dwv\" (UniqueName: \"kubernetes.io/projected/8a379a0f-f902-42b1-b793-ef91c4b5c52c-kube-api-access-c7dwv\") pod \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\" (UID: \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\") " Sep 10 00:56:34.740718 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.740606 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f434e280-17cf-41c1-916e-ec51d141d3f1-bundle\") pod \"f434e280-17cf-41c1-916e-ec51d141d3f1\" (UID: \"f434e280-17cf-41c1-916e-ec51d141d3f1\") " Sep 10 00:56:34.740718 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.740648 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a379a0f-f902-42b1-b793-ef91c4b5c52c-bundle\") pod \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\" (UID: \"8a379a0f-f902-42b1-b793-ef91c4b5c52c\") " Sep 10 00:56:34.740718 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.740693 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-util\") pod \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\" (UID: \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\") " Sep 10 00:56:34.740894 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.740718 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk4sp\" (UniqueName: \"kubernetes.io/projected/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-kube-api-access-bk4sp\") pod \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\" (UID: \"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4\") " Sep 10 00:56:34.741941 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.741164 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a379a0f-f902-42b1-b793-ef91c4b5c52c-bundle" (OuterVolumeSpecName: "bundle") pod "8a379a0f-f902-42b1-b793-ef91c4b5c52c" (UID: "8a379a0f-f902-42b1-b793-ef91c4b5c52c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:56:34.741941 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.741750 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f434e280-17cf-41c1-916e-ec51d141d3f1-bundle" (OuterVolumeSpecName: "bundle") pod "f434e280-17cf-41c1-916e-ec51d141d3f1" (UID: "f434e280-17cf-41c1-916e-ec51d141d3f1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:56:34.741941 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.741887 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-bundle" (OuterVolumeSpecName: "bundle") pod "626f0932-7e4f-46ef-8d0e-abacbc9c3eb4" (UID: "626f0932-7e4f-46ef-8d0e-abacbc9c3eb4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:56:34.742872 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.742837 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a379a0f-f902-42b1-b793-ef91c4b5c52c-kube-api-access-c7dwv" (OuterVolumeSpecName: "kube-api-access-c7dwv") pod "8a379a0f-f902-42b1-b793-ef91c4b5c52c" (UID: "8a379a0f-f902-42b1-b793-ef91c4b5c52c"). InnerVolumeSpecName "kube-api-access-c7dwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:56:34.743042 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.743021 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f434e280-17cf-41c1-916e-ec51d141d3f1-kube-api-access-zjcss" (OuterVolumeSpecName: "kube-api-access-zjcss") pod "f434e280-17cf-41c1-916e-ec51d141d3f1" (UID: "f434e280-17cf-41c1-916e-ec51d141d3f1"). InnerVolumeSpecName "kube-api-access-zjcss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:56:34.743332 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.743309 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-kube-api-access-bk4sp" (OuterVolumeSpecName: "kube-api-access-bk4sp") pod "626f0932-7e4f-46ef-8d0e-abacbc9c3eb4" (UID: "626f0932-7e4f-46ef-8d0e-abacbc9c3eb4"). InnerVolumeSpecName "kube-api-access-bk4sp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:56:34.747557 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.747488 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f434e280-17cf-41c1-916e-ec51d141d3f1-util" (OuterVolumeSpecName: "util") pod "f434e280-17cf-41c1-916e-ec51d141d3f1" (UID: "f434e280-17cf-41c1-916e-ec51d141d3f1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:56:34.749725 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.749678 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a379a0f-f902-42b1-b793-ef91c4b5c52c-util" (OuterVolumeSpecName: "util") pod "8a379a0f-f902-42b1-b793-ef91c4b5c52c" (UID: "8a379a0f-f902-42b1-b793-ef91c4b5c52c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:56:34.750252 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.750232 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-util" (OuterVolumeSpecName: "util") pod "626f0932-7e4f-46ef-8d0e-abacbc9c3eb4" (UID: "626f0932-7e4f-46ef-8d0e-abacbc9c3eb4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 00:56:34.842099 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.842062 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-bundle\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:56:34.842099 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.842095 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjcss\" (UniqueName: \"kubernetes.io/projected/f434e280-17cf-41c1-916e-ec51d141d3f1-kube-api-access-zjcss\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:56:34.842099 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.842105 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a379a0f-f902-42b1-b793-ef91c4b5c52c-util\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:56:34.842330 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.842115 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7dwv\" (UniqueName: \"kubernetes.io/projected/8a379a0f-f902-42b1-b793-ef91c4b5c52c-kube-api-access-c7dwv\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:56:34.842330 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.842123 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f434e280-17cf-41c1-916e-ec51d141d3f1-bundle\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:56:34.842330 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.842131 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a379a0f-f902-42b1-b793-ef91c4b5c52c-bundle\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:56:34.842330 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.842139 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-util\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:56:34.842330 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.842147 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk4sp\" (UniqueName: \"kubernetes.io/projected/626f0932-7e4f-46ef-8d0e-abacbc9c3eb4-kube-api-access-bk4sp\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:56:34.842330 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:34.842154 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f434e280-17cf-41c1-916e-ec51d141d3f1-util\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:56:35.501330 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:35.501276 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" Sep 10 00:56:35.501330 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:35.501313 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axwt92" event={"ID":"f434e280-17cf-41c1-916e-ec51d141d3f1","Type":"ContainerDied","Data":"095e0a9c09beec38d9cd956ebd1e721ad80404cba2cc06f309bc9a2c84ddda2a"} Sep 10 00:56:35.501866 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:35.501359 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="095e0a9c09beec38d9cd956ebd1e721ad80404cba2cc06f309bc9a2c84ddda2a" Sep 10 00:56:35.503294 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:35.503277 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" Sep 10 00:56:35.503451 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:35.503298 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6k76pj" event={"ID":"8a379a0f-f902-42b1-b793-ef91c4b5c52c","Type":"ContainerDied","Data":"980a6eea448bdec7222e46a4e36108245e8a8091d7c08d21cc2224dff5cd2f8a"} Sep 10 00:56:35.503451 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:35.503342 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="980a6eea448bdec7222e46a4e36108245e8a8091d7c08d21cc2224dff5cd2f8a" Sep 10 00:56:35.505307 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:35.505279 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" event={"ID":"626f0932-7e4f-46ef-8d0e-abacbc9c3eb4","Type":"ContainerDied","Data":"29f039bd373577715ff6ea2fa2818fab927e5be5f82f02716636e17635c2f6f9"} Sep 10 00:56:35.505474 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:35.505320 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cw9nt6" Sep 10 00:56:35.505474 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:35.505320 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29f039bd373577715ff6ea2fa2818fab927e5be5f82f02716636e17635c2f6f9" Sep 10 00:56:45.026716 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:56:45.026678 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74886c5864-c6rzp"] Sep 10 00:57:01.178077 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178046 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv"] Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178370 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a379a0f-f902-42b1-b793-ef91c4b5c52c" containerName="pull" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178399 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a379a0f-f902-42b1-b793-ef91c4b5c52c" containerName="pull" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178412 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f434e280-17cf-41c1-916e-ec51d141d3f1" containerName="util" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178418 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f434e280-17cf-41c1-916e-ec51d141d3f1" containerName="util" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178426 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="626f0932-7e4f-46ef-8d0e-abacbc9c3eb4" containerName="util" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178431 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="626f0932-7e4f-46ef-8d0e-abacbc9c3eb4" containerName="util" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178438 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2abe1a84-ec37-49e4-aca4-5fd813311214" containerName="extract" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178443 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2abe1a84-ec37-49e4-aca4-5fd813311214" containerName="extract" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178448 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="626f0932-7e4f-46ef-8d0e-abacbc9c3eb4" containerName="extract" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178452 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="626f0932-7e4f-46ef-8d0e-abacbc9c3eb4" containerName="extract" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178457 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a379a0f-f902-42b1-b793-ef91c4b5c52c" containerName="extract" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178462 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a379a0f-f902-42b1-b793-ef91c4b5c52c" containerName="extract" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178468 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2abe1a84-ec37-49e4-aca4-5fd813311214" containerName="util" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178472 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2abe1a84-ec37-49e4-aca4-5fd813311214" containerName="util" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178479 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a379a0f-f902-42b1-b793-ef91c4b5c52c" containerName="util" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178484 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a379a0f-f902-42b1-b793-ef91c4b5c52c" containerName="util" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178490 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2abe1a84-ec37-49e4-aca4-5fd813311214" containerName="pull" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178495 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2abe1a84-ec37-49e4-aca4-5fd813311214" containerName="pull" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178502 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f434e280-17cf-41c1-916e-ec51d141d3f1" containerName="extract" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178506 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f434e280-17cf-41c1-916e-ec51d141d3f1" containerName="extract" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178515 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="626f0932-7e4f-46ef-8d0e-abacbc9c3eb4" containerName="pull" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178520 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="626f0932-7e4f-46ef-8d0e-abacbc9c3eb4" containerName="pull" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178526 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f434e280-17cf-41c1-916e-ec51d141d3f1" containerName="pull" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178530 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f434e280-17cf-41c1-916e-ec51d141d3f1" containerName="pull" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178583 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2abe1a84-ec37-49e4-aca4-5fd813311214" containerName="extract" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178593 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f434e280-17cf-41c1-916e-ec51d141d3f1" containerName="extract" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178599 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a379a0f-f902-42b1-b793-ef91c4b5c52c" containerName="extract" Sep 10 00:57:01.178797 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.178604 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="626f0932-7e4f-46ef-8d0e-abacbc9c3eb4" containerName="extract" Sep 10 00:57:01.183028 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.183011 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" Sep 10 00:57:01.186123 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.186102 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 00:57:01.186123 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.186118 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 10 00:57:01.186317 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.186143 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mw498\"" Sep 10 00:57:01.186317 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.186233 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 00:57:01.187438 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.187395 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 10 00:57:01.190821 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.190801 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv"] Sep 10 00:57:01.278605 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.278569 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/632545ba-dc59-4fc4-9fc1-825de11da97d-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-8mllv\" (UID: \"632545ba-dc59-4fc4-9fc1-825de11da97d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" Sep 10 00:57:01.278775 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.278642 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/632545ba-dc59-4fc4-9fc1-825de11da97d-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-8mllv\" (UID: \"632545ba-dc59-4fc4-9fc1-825de11da97d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" Sep 10 00:57:01.278775 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.278667 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbmjb\" (UniqueName: \"kubernetes.io/projected/632545ba-dc59-4fc4-9fc1-825de11da97d-kube-api-access-gbmjb\") pod \"kuadrant-console-plugin-fbdd4f445-8mllv\" (UID: \"632545ba-dc59-4fc4-9fc1-825de11da97d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" Sep 10 00:57:01.379496 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.379461 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/632545ba-dc59-4fc4-9fc1-825de11da97d-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-8mllv\" (UID: \"632545ba-dc59-4fc4-9fc1-825de11da97d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" Sep 10 00:57:01.379496 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.379501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbmjb\" (UniqueName: \"kubernetes.io/projected/632545ba-dc59-4fc4-9fc1-825de11da97d-kube-api-access-gbmjb\") pod \"kuadrant-console-plugin-fbdd4f445-8mllv\" (UID: \"632545ba-dc59-4fc4-9fc1-825de11da97d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" Sep 10 00:57:01.379691 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.379559 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/632545ba-dc59-4fc4-9fc1-825de11da97d-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-8mllv\" (UID: \"632545ba-dc59-4fc4-9fc1-825de11da97d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" Sep 10 00:57:01.379691 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:57:01.379614 2567 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Sep 10 00:57:01.379691 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:57:01.379681 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/632545ba-dc59-4fc4-9fc1-825de11da97d-plugin-serving-cert podName:632545ba-dc59-4fc4-9fc1-825de11da97d nodeName:}" failed. No retries permitted until 2026-09-10 00:57:01.879663309 +0000 UTC m=+404.830065412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/632545ba-dc59-4fc4-9fc1-825de11da97d-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-8mllv" (UID: "632545ba-dc59-4fc4-9fc1-825de11da97d") : secret "plugin-serving-cert" not found Sep 10 00:57:01.380189 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.380172 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/632545ba-dc59-4fc4-9fc1-825de11da97d-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-8mllv\" (UID: \"632545ba-dc59-4fc4-9fc1-825de11da97d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" Sep 10 00:57:01.388794 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.388772 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbmjb\" (UniqueName: \"kubernetes.io/projected/632545ba-dc59-4fc4-9fc1-825de11da97d-kube-api-access-gbmjb\") pod \"kuadrant-console-plugin-fbdd4f445-8mllv\" (UID: \"632545ba-dc59-4fc4-9fc1-825de11da97d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" Sep 10 00:57:01.884513 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.884481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/632545ba-dc59-4fc4-9fc1-825de11da97d-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-8mllv\" (UID: \"632545ba-dc59-4fc4-9fc1-825de11da97d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" Sep 10 00:57:01.887107 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:01.887078 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/632545ba-dc59-4fc4-9fc1-825de11da97d-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-8mllv\" (UID: \"632545ba-dc59-4fc4-9fc1-825de11da97d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" Sep 10 00:57:02.092371 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:02.092340 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" Sep 10 00:57:02.364050 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:02.363988 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv"] Sep 10 00:57:02.368316 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:57:02.368282 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod632545ba_dc59_4fc4_9fc1_825de11da97d.slice/crio-a307f8fcb25c43b4106224c1f0b73c58630e7d067674bcb974565c92cb875083 WatchSource:0}: Error finding container a307f8fcb25c43b4106224c1f0b73c58630e7d067674bcb974565c92cb875083: Status 404 returned error can't find the container with id a307f8fcb25c43b4106224c1f0b73c58630e7d067674bcb974565c92cb875083 Sep 10 00:57:02.642841 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:02.642809 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" event={"ID":"632545ba-dc59-4fc4-9fc1-825de11da97d","Type":"ContainerStarted","Data":"a307f8fcb25c43b4106224c1f0b73c58630e7d067674bcb974565c92cb875083"} Sep 10 00:57:10.048559 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.048508 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74886c5864-c6rzp" podUID="2c1720f6-32c3-4e3d-80e3-e7fad7864743" containerName="console" containerID="cri-o://1620c12002cd0cc7ea54a5cfd06301aee3023cce011c91a1b25f785b27e0865a" gracePeriod=15 Sep 10 00:57:10.340335 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.340308 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:57:10.460875 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.460838 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-service-ca\") pod \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " Sep 10 00:57:10.461061 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.460881 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-oauth-serving-cert\") pod \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " Sep 10 00:57:10.461061 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.460912 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-oauth-config\") pod \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " Sep 10 00:57:10.461061 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.460942 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-config\") pod \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " Sep 10 00:57:10.461061 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.461017 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-serving-cert\") pod \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " Sep 10 00:57:10.461334 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.461085 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-trusted-ca-bundle\") pod \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " Sep 10 00:57:10.461334 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.461128 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqsr2\" (UniqueName: \"kubernetes.io/projected/2c1720f6-32c3-4e3d-80e3-e7fad7864743-kube-api-access-zqsr2\") pod \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\" (UID: \"2c1720f6-32c3-4e3d-80e3-e7fad7864743\") " Sep 10 00:57:10.461334 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.461266 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-service-ca" (OuterVolumeSpecName: "service-ca") pod "2c1720f6-32c3-4e3d-80e3-e7fad7864743" (UID: "2c1720f6-32c3-4e3d-80e3-e7fad7864743"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:57:10.461521 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.461398 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2c1720f6-32c3-4e3d-80e3-e7fad7864743" (UID: "2c1720f6-32c3-4e3d-80e3-e7fad7864743"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:57:10.461521 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.461454 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-service-ca\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:57:10.461910 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.461863 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2c1720f6-32c3-4e3d-80e3-e7fad7864743" (UID: "2c1720f6-32c3-4e3d-80e3-e7fad7864743"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:57:10.462139 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.462096 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-config" (OuterVolumeSpecName: "console-config") pod "2c1720f6-32c3-4e3d-80e3-e7fad7864743" (UID: "2c1720f6-32c3-4e3d-80e3-e7fad7864743"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:57:10.463777 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.463746 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2c1720f6-32c3-4e3d-80e3-e7fad7864743" (UID: "2c1720f6-32c3-4e3d-80e3-e7fad7864743"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:57:10.463887 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.463844 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2c1720f6-32c3-4e3d-80e3-e7fad7864743" (UID: "2c1720f6-32c3-4e3d-80e3-e7fad7864743"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:57:10.464423 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.464400 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c1720f6-32c3-4e3d-80e3-e7fad7864743-kube-api-access-zqsr2" (OuterVolumeSpecName: "kube-api-access-zqsr2") pod "2c1720f6-32c3-4e3d-80e3-e7fad7864743" (UID: "2c1720f6-32c3-4e3d-80e3-e7fad7864743"). InnerVolumeSpecName "kube-api-access-zqsr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:57:10.562662 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.562625 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-trusted-ca-bundle\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:57:10.562662 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.562660 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqsr2\" (UniqueName: \"kubernetes.io/projected/2c1720f6-32c3-4e3d-80e3-e7fad7864743-kube-api-access-zqsr2\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:57:10.562662 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.562670 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-oauth-serving-cert\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:57:10.562898 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.562681 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-oauth-config\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:57:10.562898 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.562692 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-config\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:57:10.562898 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.562700 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c1720f6-32c3-4e3d-80e3-e7fad7864743-console-serving-cert\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:57:10.698039 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.697999 2567 generic.go:356] "Generic (PLEG): container finished" podID="2c1720f6-32c3-4e3d-80e3-e7fad7864743" containerID="1620c12002cd0cc7ea54a5cfd06301aee3023cce011c91a1b25f785b27e0865a" exitCode=0 Sep 10 00:57:10.698225 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.698060 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74886c5864-c6rzp" Sep 10 00:57:10.698225 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.698094 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74886c5864-c6rzp" event={"ID":"2c1720f6-32c3-4e3d-80e3-e7fad7864743","Type":"ContainerDied","Data":"1620c12002cd0cc7ea54a5cfd06301aee3023cce011c91a1b25f785b27e0865a"} Sep 10 00:57:10.698225 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.698184 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74886c5864-c6rzp" event={"ID":"2c1720f6-32c3-4e3d-80e3-e7fad7864743","Type":"ContainerDied","Data":"5b050b474c2617c28cee8d34ecac393f1b002929a840500db8db2d2d37138b6d"} Sep 10 00:57:10.698225 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.698215 2567 scope.go:117] "RemoveContainer" containerID="1620c12002cd0cc7ea54a5cfd06301aee3023cce011c91a1b25f785b27e0865a" Sep 10 00:57:10.711518 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.711462 2567 scope.go:117] "RemoveContainer" containerID="1620c12002cd0cc7ea54a5cfd06301aee3023cce011c91a1b25f785b27e0865a" Sep 10 00:57:10.712519 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:57:10.712375 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1620c12002cd0cc7ea54a5cfd06301aee3023cce011c91a1b25f785b27e0865a\": container with ID starting with 1620c12002cd0cc7ea54a5cfd06301aee3023cce011c91a1b25f785b27e0865a not found: ID does not exist" containerID="1620c12002cd0cc7ea54a5cfd06301aee3023cce011c91a1b25f785b27e0865a" Sep 10 00:57:10.712519 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.712492 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1620c12002cd0cc7ea54a5cfd06301aee3023cce011c91a1b25f785b27e0865a"} err="failed to get container status \"1620c12002cd0cc7ea54a5cfd06301aee3023cce011c91a1b25f785b27e0865a\": rpc error: code = NotFound desc = could not find container \"1620c12002cd0cc7ea54a5cfd06301aee3023cce011c91a1b25f785b27e0865a\": container with ID starting with 1620c12002cd0cc7ea54a5cfd06301aee3023cce011c91a1b25f785b27e0865a not found: ID does not exist" Sep 10 00:57:10.729771 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.729746 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74886c5864-c6rzp"] Sep 10 00:57:10.733847 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:10.733819 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74886c5864-c6rzp"] Sep 10 00:57:11.528415 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:11.528365 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c1720f6-32c3-4e3d-80e3-e7fad7864743" path="/var/lib/kubelet/pods/2c1720f6-32c3-4e3d-80e3-e7fad7864743/volumes" Sep 10 00:57:13.717794 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:13.717761 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" event={"ID":"632545ba-dc59-4fc4-9fc1-825de11da97d","Type":"ContainerStarted","Data":"7830d0966314c6ad6e64bac0280569e3bae83c097ccbbe22e1312d69181417cd"} Sep 10 00:57:13.734953 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:13.734905 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8mllv" podStartSLOduration=1.495045367 podStartE2EDuration="12.734888082s" totalImagesPullingTime="11.239842715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:57:13.733156303 +0000 UTC m=+416.683558424" watchObservedRunningTime="2026-09-10 00:57:13.734888082 +0000 UTC m=+416.685290203" Sep 10 00:57:53.605446 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.605339 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-hdnzh"] Sep 10 00:57:53.605974 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.605769 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c1720f6-32c3-4e3d-80e3-e7fad7864743" containerName="console" Sep 10 00:57:53.605974 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.605784 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c1720f6-32c3-4e3d-80e3-e7fad7864743" containerName="console" Sep 10 00:57:53.605974 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.605846 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c1720f6-32c3-4e3d-80e3-e7fad7864743" containerName="console" Sep 10 00:57:53.609736 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.609719 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-hdnzh" Sep 10 00:57:53.612700 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.612682 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 10 00:57:53.617039 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.616956 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-hdnzh"] Sep 10 00:57:53.646675 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.646639 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-hdnzh"] Sep 10 00:57:53.736267 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.736199 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc123716-755d-4870-8313-7816e887f63d-config-file\") pod \"limitador-limitador-84994f7ffc-hdnzh\" (UID: \"fc123716-755d-4870-8313-7816e887f63d\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-hdnzh" Sep 10 00:57:53.736492 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.736342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb9qk\" (UniqueName: \"kubernetes.io/projected/fc123716-755d-4870-8313-7816e887f63d-kube-api-access-jb9qk\") pod \"limitador-limitador-84994f7ffc-hdnzh\" (UID: \"fc123716-755d-4870-8313-7816e887f63d\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-hdnzh" Sep 10 00:57:53.837574 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.837534 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc123716-755d-4870-8313-7816e887f63d-config-file\") pod \"limitador-limitador-84994f7ffc-hdnzh\" (UID: \"fc123716-755d-4870-8313-7816e887f63d\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-hdnzh" Sep 10 00:57:53.837746 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.837609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb9qk\" (UniqueName: \"kubernetes.io/projected/fc123716-755d-4870-8313-7816e887f63d-kube-api-access-jb9qk\") pod \"limitador-limitador-84994f7ffc-hdnzh\" (UID: \"fc123716-755d-4870-8313-7816e887f63d\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-hdnzh" Sep 10 00:57:53.838197 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.838177 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc123716-755d-4870-8313-7816e887f63d-config-file\") pod \"limitador-limitador-84994f7ffc-hdnzh\" (UID: \"fc123716-755d-4870-8313-7816e887f63d\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-hdnzh" Sep 10 00:57:53.846248 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.846212 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb9qk\" (UniqueName: \"kubernetes.io/projected/fc123716-755d-4870-8313-7816e887f63d-kube-api-access-jb9qk\") pod \"limitador-limitador-84994f7ffc-hdnzh\" (UID: \"fc123716-755d-4870-8313-7816e887f63d\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-hdnzh" Sep 10 00:57:53.921054 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:53.920973 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-hdnzh" Sep 10 00:57:54.066402 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.066358 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-b8dlf"] Sep 10 00:57:54.070570 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.070552 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-b8dlf" Sep 10 00:57:54.073545 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.073517 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6wlbq\"" Sep 10 00:57:54.078730 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.078708 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-b8dlf"] Sep 10 00:57:54.192227 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.192201 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-hdnzh"] Sep 10 00:57:54.193887 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:57:54.193863 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc123716_755d_4870_8313_7816e887f63d.slice/crio-6c4c6fef9adfdc0f214c2ea8ff6d53575a27f5d4c3567e662e8598511788ec42 WatchSource:0}: Error finding container 6c4c6fef9adfdc0f214c2ea8ff6d53575a27f5d4c3567e662e8598511788ec42: Status 404 returned error can't find the container with id 6c4c6fef9adfdc0f214c2ea8ff6d53575a27f5d4c3567e662e8598511788ec42 Sep 10 00:57:54.204317 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.204293 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-nqrhd"] Sep 10 00:57:54.207606 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.207588 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-nqrhd" Sep 10 00:57:54.214030 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.214009 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nqrhd"] Sep 10 00:57:54.241002 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.240967 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr4p9\" (UniqueName: \"kubernetes.io/projected/ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9-kube-api-access-wr4p9\") pod \"authorino-7bcfd8f9cd-b8dlf\" (UID: \"ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-b8dlf" Sep 10 00:57:54.342307 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.342265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr4p9\" (UniqueName: \"kubernetes.io/projected/ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9-kube-api-access-wr4p9\") pod \"authorino-7bcfd8f9cd-b8dlf\" (UID: \"ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-b8dlf" Sep 10 00:57:54.342307 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.342309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpvjw\" (UniqueName: \"kubernetes.io/projected/afc6fbbc-dbe5-42e9-a960-3b6de42bccd7-kube-api-access-zpvjw\") pod \"authorino-59c974bd48-nqrhd\" (UID: \"afc6fbbc-dbe5-42e9-a960-3b6de42bccd7\") " pod="kuadrant-system/authorino-59c974bd48-nqrhd" Sep 10 00:57:54.350960 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.350933 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr4p9\" (UniqueName: \"kubernetes.io/projected/ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9-kube-api-access-wr4p9\") pod \"authorino-7bcfd8f9cd-b8dlf\" (UID: \"ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-b8dlf" Sep 10 00:57:54.380904 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.380870 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-b8dlf" Sep 10 00:57:54.443002 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.442923 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpvjw\" (UniqueName: \"kubernetes.io/projected/afc6fbbc-dbe5-42e9-a960-3b6de42bccd7-kube-api-access-zpvjw\") pod \"authorino-59c974bd48-nqrhd\" (UID: \"afc6fbbc-dbe5-42e9-a960-3b6de42bccd7\") " pod="kuadrant-system/authorino-59c974bd48-nqrhd" Sep 10 00:57:54.452087 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.452061 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpvjw\" (UniqueName: \"kubernetes.io/projected/afc6fbbc-dbe5-42e9-a960-3b6de42bccd7-kube-api-access-zpvjw\") pod \"authorino-59c974bd48-nqrhd\" (UID: \"afc6fbbc-dbe5-42e9-a960-3b6de42bccd7\") " pod="kuadrant-system/authorino-59c974bd48-nqrhd" Sep 10 00:57:54.517933 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.517904 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-nqrhd" Sep 10 00:57:54.665631 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.665607 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-b8dlf"] Sep 10 00:57:54.666064 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:57:54.666045 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecc3bbf7_d84d_47eb_bbe0_33dc75b0cbb9.slice/crio-6454b8e0b04aaf69350ad429a3b12b88ee51cd01dfa9e90ae0d82ad15213bac1 WatchSource:0}: Error finding container 6454b8e0b04aaf69350ad429a3b12b88ee51cd01dfa9e90ae0d82ad15213bac1: Status 404 returned error can't find the container with id 6454b8e0b04aaf69350ad429a3b12b88ee51cd01dfa9e90ae0d82ad15213bac1 Sep 10 00:57:54.790924 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.790895 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nqrhd"] Sep 10 00:57:54.792568 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:57:54.792544 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafc6fbbc_dbe5_42e9_a960_3b6de42bccd7.slice/crio-05b09ddfda29ef6b9547c111d6372def9f690b1d944f60ec66214291734eafbf WatchSource:0}: Error finding container 05b09ddfda29ef6b9547c111d6372def9f690b1d944f60ec66214291734eafbf: Status 404 returned error can't find the container with id 05b09ddfda29ef6b9547c111d6372def9f690b1d944f60ec66214291734eafbf Sep 10 00:57:54.929509 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.929379 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-hdnzh" event={"ID":"fc123716-755d-4870-8313-7816e887f63d","Type":"ContainerStarted","Data":"6c4c6fef9adfdc0f214c2ea8ff6d53575a27f5d4c3567e662e8598511788ec42"} Sep 10 00:57:54.931532 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.931494 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-nqrhd" event={"ID":"afc6fbbc-dbe5-42e9-a960-3b6de42bccd7","Type":"ContainerStarted","Data":"05b09ddfda29ef6b9547c111d6372def9f690b1d944f60ec66214291734eafbf"} Sep 10 00:57:54.933107 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:54.933078 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-b8dlf" event={"ID":"ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9","Type":"ContainerStarted","Data":"6454b8e0b04aaf69350ad429a3b12b88ee51cd01dfa9e90ae0d82ad15213bac1"} Sep 10 00:57:56.947103 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:56.947011 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-hdnzh" event={"ID":"fc123716-755d-4870-8313-7816e887f63d","Type":"ContainerStarted","Data":"60fdabadba2a51cb3290dec13aecdbf2d16c421317c179d48834e89c4cb70e03"} Sep 10 00:57:56.947486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:56.947105 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-hdnzh" Sep 10 00:57:56.965586 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:56.965530 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-hdnzh" podStartSLOduration=1.534196431 podStartE2EDuration="3.9655128s" totalImagesPullingTime="2.431316369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:57:56.963351249 +0000 UTC m=+459.913753373" watchObservedRunningTime="2026-09-10 00:57:56.9655128 +0000 UTC m=+459.915914922" Sep 10 00:57:57.954082 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:57.954042 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-nqrhd" event={"ID":"afc6fbbc-dbe5-42e9-a960-3b6de42bccd7","Type":"ContainerStarted","Data":"f5c0db619bf40185554938f4b57af558e4ea091b19bda43b8c9be2cd7e622357"} Sep 10 00:57:57.955687 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:57.955664 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-b8dlf" event={"ID":"ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9","Type":"ContainerStarted","Data":"7587766014d279a648ceebb55562d5cd2797095fa902adec140a076a23640ee8"} Sep 10 00:57:57.968870 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:57.968826 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-nqrhd" podStartSLOduration=1.016927641 podStartE2EDuration="3.968810899s" totalImagesPullingTime="2.951883258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:57:57.968351333 +0000 UTC m=+460.918753457" watchObservedRunningTime="2026-09-10 00:57:57.968810899 +0000 UTC m=+460.919213021" Sep 10 00:57:57.984744 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:57.984697 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-b8dlf" podStartSLOduration=0.902267695 podStartE2EDuration="3.984677405s" totalImagesPullingTime="3.08240971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:57:57.982802478 +0000 UTC m=+460.933204602" watchObservedRunningTime="2026-09-10 00:57:57.984677405 +0000 UTC m=+460.935079528" Sep 10 00:57:58.008722 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:58.008637 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-b8dlf"] Sep 10 00:57:59.965567 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:57:59.965528 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-b8dlf" podUID="ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9" containerName="authorino" containerID="cri-o://7587766014d279a648ceebb55562d5cd2797095fa902adec140a076a23640ee8" gracePeriod=30 Sep 10 00:58:00.223315 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:00.223255 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-b8dlf" Sep 10 00:58:00.395483 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:00.395450 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr4p9\" (UniqueName: \"kubernetes.io/projected/ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9-kube-api-access-wr4p9\") pod \"ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9\" (UID: \"ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9\") " Sep 10 00:58:00.397894 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:00.397865 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9-kube-api-access-wr4p9" (OuterVolumeSpecName: "kube-api-access-wr4p9") pod "ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9" (UID: "ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9"). InnerVolumeSpecName "kube-api-access-wr4p9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:58:00.496587 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:00.496501 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr4p9\" (UniqueName: \"kubernetes.io/projected/ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9-kube-api-access-wr4p9\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:58:00.971714 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:00.971681 2567 generic.go:356] "Generic (PLEG): container finished" podID="ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9" containerID="7587766014d279a648ceebb55562d5cd2797095fa902adec140a076a23640ee8" exitCode=0 Sep 10 00:58:00.972146 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:00.971726 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-b8dlf" event={"ID":"ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9","Type":"ContainerDied","Data":"7587766014d279a648ceebb55562d5cd2797095fa902adec140a076a23640ee8"} Sep 10 00:58:00.972146 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:00.971740 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-b8dlf" Sep 10 00:58:00.972146 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:00.971754 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-b8dlf" event={"ID":"ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9","Type":"ContainerDied","Data":"6454b8e0b04aaf69350ad429a3b12b88ee51cd01dfa9e90ae0d82ad15213bac1"} Sep 10 00:58:00.972146 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:00.971770 2567 scope.go:117] "RemoveContainer" containerID="7587766014d279a648ceebb55562d5cd2797095fa902adec140a076a23640ee8" Sep 10 00:58:00.980847 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:00.980822 2567 scope.go:117] "RemoveContainer" containerID="7587766014d279a648ceebb55562d5cd2797095fa902adec140a076a23640ee8" Sep 10 00:58:00.981128 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:58:00.981107 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7587766014d279a648ceebb55562d5cd2797095fa902adec140a076a23640ee8\": container with ID starting with 7587766014d279a648ceebb55562d5cd2797095fa902adec140a076a23640ee8 not found: ID does not exist" containerID="7587766014d279a648ceebb55562d5cd2797095fa902adec140a076a23640ee8" Sep 10 00:58:00.981185 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:00.981138 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7587766014d279a648ceebb55562d5cd2797095fa902adec140a076a23640ee8"} err="failed to get container status \"7587766014d279a648ceebb55562d5cd2797095fa902adec140a076a23640ee8\": rpc error: code = NotFound desc = could not find container \"7587766014d279a648ceebb55562d5cd2797095fa902adec140a076a23640ee8\": container with ID starting with 7587766014d279a648ceebb55562d5cd2797095fa902adec140a076a23640ee8 not found: ID does not exist" Sep 10 00:58:00.993402 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:00.993361 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-b8dlf"] Sep 10 00:58:00.995360 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:00.995342 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-b8dlf"] Sep 10 00:58:01.526963 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:01.526928 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9" path="/var/lib/kubelet/pods/ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9/volumes" Sep 10 00:58:07.957294 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:07.957257 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-hdnzh" Sep 10 00:58:26.771665 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:26.771632 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-v4v8q"] Sep 10 00:58:26.772054 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:26.771997 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9" containerName="authorino" Sep 10 00:58:26.772054 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:26.772009 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9" containerName="authorino" Sep 10 00:58:26.772134 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:26.772074 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecc3bbf7-d84d-47eb-bbe0-33dc75b0cbb9" containerName="authorino" Sep 10 00:58:26.776375 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:26.776358 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-v4v8q" Sep 10 00:58:26.781613 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:26.781588 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-v4v8q"] Sep 10 00:58:26.828730 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:26.828690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcksc\" (UniqueName: \"kubernetes.io/projected/78b17a87-d520-4873-b505-e28bb69e8d8b-kube-api-access-mcksc\") pod \"authorino-557f876f69-v4v8q\" (UID: \"78b17a87-d520-4873-b505-e28bb69e8d8b\") " pod="kuadrant-system/authorino-557f876f69-v4v8q" Sep 10 00:58:26.930233 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:26.930201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcksc\" (UniqueName: \"kubernetes.io/projected/78b17a87-d520-4873-b505-e28bb69e8d8b-kube-api-access-mcksc\") pod \"authorino-557f876f69-v4v8q\" (UID: \"78b17a87-d520-4873-b505-e28bb69e8d8b\") " pod="kuadrant-system/authorino-557f876f69-v4v8q" Sep 10 00:58:26.938789 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:26.938758 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcksc\" (UniqueName: \"kubernetes.io/projected/78b17a87-d520-4873-b505-e28bb69e8d8b-kube-api-access-mcksc\") pod \"authorino-557f876f69-v4v8q\" (UID: \"78b17a87-d520-4873-b505-e28bb69e8d8b\") " pod="kuadrant-system/authorino-557f876f69-v4v8q" Sep 10 00:58:26.988962 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:26.988924 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-v4v8q"] Sep 10 00:58:26.989197 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:26.989185 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-v4v8q" Sep 10 00:58:27.014486 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.014455 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-4kn5k"] Sep 10 00:58:27.018081 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.018058 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-4kn5k" Sep 10 00:58:27.020693 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.020671 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 10 00:58:27.025027 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.024964 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-4kn5k"] Sep 10 00:58:27.048915 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.048884 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-4kn5k"] Sep 10 00:58:27.049339 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:58:27.049280 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-b7mhp tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-b7mhp tls-cert]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-4kn5k" podUID="6367770b-d17e-4dfe-81f5-6ad0e90fb9a1" Sep 10 00:58:27.074154 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.074117 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7ff579cd75-vnfk2"] Sep 10 00:58:27.077449 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.077432 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff579cd75-vnfk2" Sep 10 00:58:27.084536 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.084514 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ff579cd75-vnfk2"] Sep 10 00:58:27.111058 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.111031 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-4kn5k" Sep 10 00:58:27.117716 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.117695 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-4kn5k" Sep 10 00:58:27.131729 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.131700 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6367770b-d17e-4dfe-81f5-6ad0e90fb9a1-tls-cert\") pod \"authorino-6d4dfc649f-4kn5k\" (UID: \"6367770b-d17e-4dfe-81f5-6ad0e90fb9a1\") " pod="kuadrant-system/authorino-6d4dfc649f-4kn5k" Sep 10 00:58:27.131865 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.131739 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwsw2\" (UniqueName: \"kubernetes.io/projected/3bd8fe49-221a-405d-a4d2-61cb9e9a052d-kube-api-access-qwsw2\") pod \"authorino-7ff579cd75-vnfk2\" (UID: \"3bd8fe49-221a-405d-a4d2-61cb9e9a052d\") " pod="kuadrant-system/authorino-7ff579cd75-vnfk2" Sep 10 00:58:27.131865 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.131781 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7mhp\" (UniqueName: \"kubernetes.io/projected/6367770b-d17e-4dfe-81f5-6ad0e90fb9a1-kube-api-access-b7mhp\") pod \"authorino-6d4dfc649f-4kn5k\" (UID: \"6367770b-d17e-4dfe-81f5-6ad0e90fb9a1\") " pod="kuadrant-system/authorino-6d4dfc649f-4kn5k" Sep 10 00:58:27.131937 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.131859 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3bd8fe49-221a-405d-a4d2-61cb9e9a052d-tls-cert\") pod \"authorino-7ff579cd75-vnfk2\" (UID: \"3bd8fe49-221a-405d-a4d2-61cb9e9a052d\") " pod="kuadrant-system/authorino-7ff579cd75-vnfk2" Sep 10 00:58:27.232658 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.232623 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6367770b-d17e-4dfe-81f5-6ad0e90fb9a1-tls-cert\") pod \"authorino-6d4dfc649f-4kn5k\" (UID: \"6367770b-d17e-4dfe-81f5-6ad0e90fb9a1\") " pod="kuadrant-system/authorino-6d4dfc649f-4kn5k" Sep 10 00:58:27.232658 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.232670 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwsw2\" (UniqueName: \"kubernetes.io/projected/3bd8fe49-221a-405d-a4d2-61cb9e9a052d-kube-api-access-qwsw2\") pod \"authorino-7ff579cd75-vnfk2\" (UID: \"3bd8fe49-221a-405d-a4d2-61cb9e9a052d\") " pod="kuadrant-system/authorino-7ff579cd75-vnfk2" Sep 10 00:58:27.232880 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.232719 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7mhp\" (UniqueName: \"kubernetes.io/projected/6367770b-d17e-4dfe-81f5-6ad0e90fb9a1-kube-api-access-b7mhp\") pod \"authorino-6d4dfc649f-4kn5k\" (UID: \"6367770b-d17e-4dfe-81f5-6ad0e90fb9a1\") " pod="kuadrant-system/authorino-6d4dfc649f-4kn5k" Sep 10 00:58:27.232880 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.232757 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3bd8fe49-221a-405d-a4d2-61cb9e9a052d-tls-cert\") pod \"authorino-7ff579cd75-vnfk2\" (UID: \"3bd8fe49-221a-405d-a4d2-61cb9e9a052d\") " pod="kuadrant-system/authorino-7ff579cd75-vnfk2" Sep 10 00:58:27.235288 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.235256 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6367770b-d17e-4dfe-81f5-6ad0e90fb9a1-tls-cert\") pod \"authorino-6d4dfc649f-4kn5k\" (UID: \"6367770b-d17e-4dfe-81f5-6ad0e90fb9a1\") " pod="kuadrant-system/authorino-6d4dfc649f-4kn5k" Sep 10 00:58:27.235460 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.235397 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3bd8fe49-221a-405d-a4d2-61cb9e9a052d-tls-cert\") pod \"authorino-7ff579cd75-vnfk2\" (UID: \"3bd8fe49-221a-405d-a4d2-61cb9e9a052d\") " pod="kuadrant-system/authorino-7ff579cd75-vnfk2" Sep 10 00:58:27.241272 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.241247 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7mhp\" (UniqueName: \"kubernetes.io/projected/6367770b-d17e-4dfe-81f5-6ad0e90fb9a1-kube-api-access-b7mhp\") pod \"authorino-6d4dfc649f-4kn5k\" (UID: \"6367770b-d17e-4dfe-81f5-6ad0e90fb9a1\") " pod="kuadrant-system/authorino-6d4dfc649f-4kn5k" Sep 10 00:58:27.241428 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.241293 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwsw2\" (UniqueName: \"kubernetes.io/projected/3bd8fe49-221a-405d-a4d2-61cb9e9a052d-kube-api-access-qwsw2\") pod \"authorino-7ff579cd75-vnfk2\" (UID: \"3bd8fe49-221a-405d-a4d2-61cb9e9a052d\") " pod="kuadrant-system/authorino-7ff579cd75-vnfk2" Sep 10 00:58:27.262020 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.261994 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-v4v8q"] Sep 10 00:58:27.263467 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:58:27.263441 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78b17a87_d520_4873_b505_e28bb69e8d8b.slice/crio-23f7535e64651dca9dfbe7110079c01494d34e8455c1f5aa3aec7c8b148306a4 WatchSource:0}: Error finding container 23f7535e64651dca9dfbe7110079c01494d34e8455c1f5aa3aec7c8b148306a4: Status 404 returned error can't find the container with id 23f7535e64651dca9dfbe7110079c01494d34e8455c1f5aa3aec7c8b148306a4 Sep 10 00:58:27.333663 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.333635 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6367770b-d17e-4dfe-81f5-6ad0e90fb9a1-tls-cert\") pod \"6367770b-d17e-4dfe-81f5-6ad0e90fb9a1\" (UID: \"6367770b-d17e-4dfe-81f5-6ad0e90fb9a1\") " Sep 10 00:58:27.333828 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.333713 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7mhp\" (UniqueName: \"kubernetes.io/projected/6367770b-d17e-4dfe-81f5-6ad0e90fb9a1-kube-api-access-b7mhp\") pod \"6367770b-d17e-4dfe-81f5-6ad0e90fb9a1\" (UID: \"6367770b-d17e-4dfe-81f5-6ad0e90fb9a1\") " Sep 10 00:58:27.335883 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.335850 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6367770b-d17e-4dfe-81f5-6ad0e90fb9a1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6367770b-d17e-4dfe-81f5-6ad0e90fb9a1" (UID: "6367770b-d17e-4dfe-81f5-6ad0e90fb9a1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 00:58:27.335989 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.335906 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6367770b-d17e-4dfe-81f5-6ad0e90fb9a1-kube-api-access-b7mhp" (OuterVolumeSpecName: "kube-api-access-b7mhp") pod "6367770b-d17e-4dfe-81f5-6ad0e90fb9a1" (UID: "6367770b-d17e-4dfe-81f5-6ad0e90fb9a1"). InnerVolumeSpecName "kube-api-access-b7mhp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:58:27.386625 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.386592 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff579cd75-vnfk2" Sep 10 00:58:27.434843 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.434800 2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6367770b-d17e-4dfe-81f5-6ad0e90fb9a1-tls-cert\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:58:27.434843 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.434831 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7mhp\" (UniqueName: \"kubernetes.io/projected/6367770b-d17e-4dfe-81f5-6ad0e90fb9a1-kube-api-access-b7mhp\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:58:27.660695 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:27.660583 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ff579cd75-vnfk2"] Sep 10 00:58:27.662298 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:58:27.662271 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bd8fe49_221a_405d_a4d2_61cb9e9a052d.slice/crio-23ea3662f32929f19b4750e4ba088d5efd3d008dc79c993cb343c6dd44dd24b6 WatchSource:0}: Error finding container 23ea3662f32929f19b4750e4ba088d5efd3d008dc79c993cb343c6dd44dd24b6: Status 404 returned error can't find the container with id 23ea3662f32929f19b4750e4ba088d5efd3d008dc79c993cb343c6dd44dd24b6 Sep 10 00:58:28.116919 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:28.116877 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff579cd75-vnfk2" event={"ID":"3bd8fe49-221a-405d-a4d2-61cb9e9a052d","Type":"ContainerStarted","Data":"23ea3662f32929f19b4750e4ba088d5efd3d008dc79c993cb343c6dd44dd24b6"} Sep 10 00:58:28.118356 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:28.118332 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-4kn5k" Sep 10 00:58:28.118356 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:28.118339 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-v4v8q" podUID="78b17a87-d520-4873-b505-e28bb69e8d8b" containerName="authorino" containerID="cri-o://e01302488b9df41e48966453bba67a3064f703acb8fdfd8101d4333f961380ed" gracePeriod=30 Sep 10 00:58:28.118356 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:28.118329 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-v4v8q" event={"ID":"78b17a87-d520-4873-b505-e28bb69e8d8b","Type":"ContainerStarted","Data":"e01302488b9df41e48966453bba67a3064f703acb8fdfd8101d4333f961380ed"} Sep 10 00:58:28.118608 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:28.118381 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-v4v8q" event={"ID":"78b17a87-d520-4873-b505-e28bb69e8d8b","Type":"ContainerStarted","Data":"23f7535e64651dca9dfbe7110079c01494d34e8455c1f5aa3aec7c8b148306a4"} Sep 10 00:58:28.134961 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:28.134916 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-v4v8q" podStartSLOduration=1.459304336 podStartE2EDuration="2.13489915s" totalImagesPullingTime="675.594814ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:58:28.133683602 +0000 UTC m=+491.084085723" watchObservedRunningTime="2026-09-10 00:58:28.13489915 +0000 UTC m=+491.085301271" Sep 10 00:58:28.175378 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:28.175347 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-4kn5k"] Sep 10 00:58:28.195556 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:28.195480 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-4kn5k"] Sep 10 00:58:28.364223 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:28.364201 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-v4v8q" Sep 10 00:58:28.443760 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:28.443726 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcksc\" (UniqueName: \"kubernetes.io/projected/78b17a87-d520-4873-b505-e28bb69e8d8b-kube-api-access-mcksc\") pod \"78b17a87-d520-4873-b505-e28bb69e8d8b\" (UID: \"78b17a87-d520-4873-b505-e28bb69e8d8b\") " Sep 10 00:58:28.445956 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:28.445897 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78b17a87-d520-4873-b505-e28bb69e8d8b-kube-api-access-mcksc" (OuterVolumeSpecName: "kube-api-access-mcksc") pod "78b17a87-d520-4873-b505-e28bb69e8d8b" (UID: "78b17a87-d520-4873-b505-e28bb69e8d8b"). InnerVolumeSpecName "kube-api-access-mcksc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:58:28.544953 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:28.544928 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcksc\" (UniqueName: \"kubernetes.io/projected/78b17a87-d520-4873-b505-e28bb69e8d8b-kube-api-access-mcksc\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:58:29.125478 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.125437 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff579cd75-vnfk2" event={"ID":"3bd8fe49-221a-405d-a4d2-61cb9e9a052d","Type":"ContainerStarted","Data":"d8d5b576c09c943bde0f8a76fd15b42df2746bccd23736ce0246165bec1104e9"} Sep 10 00:58:29.126671 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.126647 2567 generic.go:356] "Generic (PLEG): container finished" podID="78b17a87-d520-4873-b505-e28bb69e8d8b" containerID="e01302488b9df41e48966453bba67a3064f703acb8fdfd8101d4333f961380ed" exitCode=0 Sep 10 00:58:29.126779 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.126689 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-v4v8q" Sep 10 00:58:29.126779 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.126732 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-v4v8q" event={"ID":"78b17a87-d520-4873-b505-e28bb69e8d8b","Type":"ContainerDied","Data":"e01302488b9df41e48966453bba67a3064f703acb8fdfd8101d4333f961380ed"} Sep 10 00:58:29.126779 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.126771 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-v4v8q" event={"ID":"78b17a87-d520-4873-b505-e28bb69e8d8b","Type":"ContainerDied","Data":"23f7535e64651dca9dfbe7110079c01494d34e8455c1f5aa3aec7c8b148306a4"} Sep 10 00:58:29.126930 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.126789 2567 scope.go:117] "RemoveContainer" containerID="e01302488b9df41e48966453bba67a3064f703acb8fdfd8101d4333f961380ed" Sep 10 00:58:29.135576 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.135560 2567 scope.go:117] "RemoveContainer" containerID="e01302488b9df41e48966453bba67a3064f703acb8fdfd8101d4333f961380ed" Sep 10 00:58:29.135847 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:58:29.135830 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e01302488b9df41e48966453bba67a3064f703acb8fdfd8101d4333f961380ed\": container with ID starting with e01302488b9df41e48966453bba67a3064f703acb8fdfd8101d4333f961380ed not found: ID does not exist" containerID="e01302488b9df41e48966453bba67a3064f703acb8fdfd8101d4333f961380ed" Sep 10 00:58:29.135895 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.135856 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e01302488b9df41e48966453bba67a3064f703acb8fdfd8101d4333f961380ed"} err="failed to get container status \"e01302488b9df41e48966453bba67a3064f703acb8fdfd8101d4333f961380ed\": rpc error: code = NotFound desc = could not find container \"e01302488b9df41e48966453bba67a3064f703acb8fdfd8101d4333f961380ed\": container with ID starting with e01302488b9df41e48966453bba67a3064f703acb8fdfd8101d4333f961380ed not found: ID does not exist" Sep 10 00:58:29.139989 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.139949 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7ff579cd75-vnfk2" podStartSLOduration=1.329696938 podStartE2EDuration="2.13993754s" totalImagesPullingTime="810.240602ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:58:29.139482188 +0000 UTC m=+492.089884311" watchObservedRunningTime="2026-09-10 00:58:29.13993754 +0000 UTC m=+492.090339662" Sep 10 00:58:29.156597 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.156574 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-v4v8q"] Sep 10 00:58:29.160156 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.160130 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-v4v8q"] Sep 10 00:58:29.164916 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.164889 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nqrhd"] Sep 10 00:58:29.165088 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.165048 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-nqrhd" podUID="afc6fbbc-dbe5-42e9-a960-3b6de42bccd7" containerName="authorino" containerID="cri-o://f5c0db619bf40185554938f4b57af558e4ea091b19bda43b8c9be2cd7e622357" gracePeriod=30 Sep 10 00:58:29.421467 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.421444 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-nqrhd" Sep 10 00:58:29.527039 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.527005 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6367770b-d17e-4dfe-81f5-6ad0e90fb9a1" path="/var/lib/kubelet/pods/6367770b-d17e-4dfe-81f5-6ad0e90fb9a1/volumes" Sep 10 00:58:29.527248 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.527237 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78b17a87-d520-4873-b505-e28bb69e8d8b" path="/var/lib/kubelet/pods/78b17a87-d520-4873-b505-e28bb69e8d8b/volumes" Sep 10 00:58:29.555050 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.554991 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpvjw\" (UniqueName: \"kubernetes.io/projected/afc6fbbc-dbe5-42e9-a960-3b6de42bccd7-kube-api-access-zpvjw\") pod \"afc6fbbc-dbe5-42e9-a960-3b6de42bccd7\" (UID: \"afc6fbbc-dbe5-42e9-a960-3b6de42bccd7\") " Sep 10 00:58:29.557130 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.557110 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afc6fbbc-dbe5-42e9-a960-3b6de42bccd7-kube-api-access-zpvjw" (OuterVolumeSpecName: "kube-api-access-zpvjw") pod "afc6fbbc-dbe5-42e9-a960-3b6de42bccd7" (UID: "afc6fbbc-dbe5-42e9-a960-3b6de42bccd7"). InnerVolumeSpecName "kube-api-access-zpvjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:58:29.655782 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:29.655745 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpvjw\" (UniqueName: \"kubernetes.io/projected/afc6fbbc-dbe5-42e9-a960-3b6de42bccd7-kube-api-access-zpvjw\") on node \"ip-10-0-129-142.ec2.internal\" DevicePath \"\"" Sep 10 00:58:30.132932 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:30.132895 2567 generic.go:356] "Generic (PLEG): container finished" podID="afc6fbbc-dbe5-42e9-a960-3b6de42bccd7" containerID="f5c0db619bf40185554938f4b57af558e4ea091b19bda43b8c9be2cd7e622357" exitCode=0 Sep 10 00:58:30.133410 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:30.132937 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-nqrhd" Sep 10 00:58:30.133410 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:30.132985 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-nqrhd" event={"ID":"afc6fbbc-dbe5-42e9-a960-3b6de42bccd7","Type":"ContainerDied","Data":"f5c0db619bf40185554938f4b57af558e4ea091b19bda43b8c9be2cd7e622357"} Sep 10 00:58:30.133410 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:30.133025 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-nqrhd" event={"ID":"afc6fbbc-dbe5-42e9-a960-3b6de42bccd7","Type":"ContainerDied","Data":"05b09ddfda29ef6b9547c111d6372def9f690b1d944f60ec66214291734eafbf"} Sep 10 00:58:30.133410 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:30.133044 2567 scope.go:117] "RemoveContainer" containerID="f5c0db619bf40185554938f4b57af558e4ea091b19bda43b8c9be2cd7e622357" Sep 10 00:58:30.142664 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:30.142648 2567 scope.go:117] "RemoveContainer" containerID="f5c0db619bf40185554938f4b57af558e4ea091b19bda43b8c9be2cd7e622357" Sep 10 00:58:30.142989 ip-10-0-129-142 kubenswrapper[2567]: E0910 00:58:30.142969 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5c0db619bf40185554938f4b57af558e4ea091b19bda43b8c9be2cd7e622357\": container with ID starting with f5c0db619bf40185554938f4b57af558e4ea091b19bda43b8c9be2cd7e622357 not found: ID does not exist" containerID="f5c0db619bf40185554938f4b57af558e4ea091b19bda43b8c9be2cd7e622357" Sep 10 00:58:30.143044 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:30.142997 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5c0db619bf40185554938f4b57af558e4ea091b19bda43b8c9be2cd7e622357"} err="failed to get container status \"f5c0db619bf40185554938f4b57af558e4ea091b19bda43b8c9be2cd7e622357\": rpc error: code = NotFound desc = could not find container \"f5c0db619bf40185554938f4b57af558e4ea091b19bda43b8c9be2cd7e622357\": container with ID starting with f5c0db619bf40185554938f4b57af558e4ea091b19bda43b8c9be2cd7e622357 not found: ID does not exist" Sep 10 00:58:30.154980 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:30.154955 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nqrhd"] Sep 10 00:58:30.158125 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:30.158103 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nqrhd"] Sep 10 00:58:31.527165 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:58:31.527133 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afc6fbbc-dbe5-42e9-a960-3b6de42bccd7" path="/var/lib/kubelet/pods/afc6fbbc-dbe5-42e9-a960-3b6de42bccd7/volumes" Sep 10 00:59:11.285979 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:11.285886 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-hdnzh"] Sep 10 00:59:30.687203 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:30.687158 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-hdnzh"] Sep 10 00:59:38.401281 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:38.401236 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-hdnzh"] Sep 10 00:59:44.492465 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:44.492427 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-hdnzh"] Sep 10 00:59:50.883927 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:50.883885 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-hdnzh"] Sep 10 00:59:57.694202 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.694169 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24"] Sep 10 00:59:57.694636 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.694561 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afc6fbbc-dbe5-42e9-a960-3b6de42bccd7" containerName="authorino" Sep 10 00:59:57.694636 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.694578 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="afc6fbbc-dbe5-42e9-a960-3b6de42bccd7" containerName="authorino" Sep 10 00:59:57.694636 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.694606 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78b17a87-d520-4873-b505-e28bb69e8d8b" containerName="authorino" Sep 10 00:59:57.694636 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.694612 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="78b17a87-d520-4873-b505-e28bb69e8d8b" containerName="authorino" Sep 10 00:59:57.694857 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.694685 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="afc6fbbc-dbe5-42e9-a960-3b6de42bccd7" containerName="authorino" Sep 10 00:59:57.694857 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.694698 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="78b17a87-d520-4873-b505-e28bb69e8d8b" containerName="authorino" Sep 10 00:59:57.697741 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.697720 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.701945 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.701920 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sbt7f\"" Sep 10 00:59:57.701945 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.701939 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 10 00:59:57.702121 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.701943 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 00:59:57.702121 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.701922 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 00:59:57.707781 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.707758 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24"] Sep 10 00:59:57.814812 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.814766 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234e2f50-4176-47b7-9f04-b20b5b9b3261-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.814812 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.814805 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6szh\" (UniqueName: \"kubernetes.io/projected/234e2f50-4176-47b7-9f04-b20b5b9b3261-kube-api-access-l6szh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.815081 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.814845 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/234e2f50-4176-47b7-9f04-b20b5b9b3261-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.815081 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.814942 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/234e2f50-4176-47b7-9f04-b20b5b9b3261-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.815081 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.814993 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/234e2f50-4176-47b7-9f04-b20b5b9b3261-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.815081 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.815025 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/234e2f50-4176-47b7-9f04-b20b5b9b3261-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.916526 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.916466 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234e2f50-4176-47b7-9f04-b20b5b9b3261-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.916526 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.916525 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6szh\" (UniqueName: \"kubernetes.io/projected/234e2f50-4176-47b7-9f04-b20b5b9b3261-kube-api-access-l6szh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.916792 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.916565 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/234e2f50-4176-47b7-9f04-b20b5b9b3261-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.916792 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.916605 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/234e2f50-4176-47b7-9f04-b20b5b9b3261-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.916792 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.916639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/234e2f50-4176-47b7-9f04-b20b5b9b3261-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.916792 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.916667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/234e2f50-4176-47b7-9f04-b20b5b9b3261-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.916984 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.916916 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234e2f50-4176-47b7-9f04-b20b5b9b3261-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.917021 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.916991 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/234e2f50-4176-47b7-9f04-b20b5b9b3261-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.917058 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.917044 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/234e2f50-4176-47b7-9f04-b20b5b9b3261-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.919087 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.919062 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/234e2f50-4176-47b7-9f04-b20b5b9b3261-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.919303 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.919283 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/234e2f50-4176-47b7-9f04-b20b5b9b3261-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:57.925167 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:57.925147 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6szh\" (UniqueName: \"kubernetes.io/projected/234e2f50-4176-47b7-9f04-b20b5b9b3261-kube-api-access-l6szh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24\" (UID: \"234e2f50-4176-47b7-9f04-b20b5b9b3261\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:58.009452 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:58.009348 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 00:59:58.280293 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:58.280266 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24"] Sep 10 00:59:58.282799 ip-10-0-129-142 kubenswrapper[2567]: W0910 00:59:58.282771 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234e2f50_4176_47b7_9f04_b20b5b9b3261.slice/crio-f20e64e08765446f43c28d714f77d0961edf916d79dd4a3d96dd51ab04b8b6d7 WatchSource:0}: Error finding container f20e64e08765446f43c28d714f77d0961edf916d79dd4a3d96dd51ab04b8b6d7: Status 404 returned error can't find the container with id f20e64e08765446f43c28d714f77d0961edf916d79dd4a3d96dd51ab04b8b6d7 Sep 10 00:59:58.601479 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:58.601367 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" event={"ID":"234e2f50-4176-47b7-9f04-b20b5b9b3261","Type":"ContainerStarted","Data":"f20e64e08765446f43c28d714f77d0961edf916d79dd4a3d96dd51ab04b8b6d7"} Sep 10 00:59:59.192775 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:59.189536 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-hdnzh"] Sep 10 00:59:59.608550 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:59.608513 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" event={"ID":"234e2f50-4176-47b7-9f04-b20b5b9b3261","Type":"ContainerStarted","Data":"6917d36fd506767ccdfda7968b62ea59b501cdb536e8d67fd82c62f9b869b420"} Sep 10 00:59:59.625889 ip-10-0-129-142 kubenswrapper[2567]: I0910 00:59:59.625836 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" podStartSLOduration=1.673535388 podStartE2EDuration="2.625816587s" totalImagesPullingTime="952.281199ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 00:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:59:59.62472484 +0000 UTC m=+582.575126963" watchObservedRunningTime="2026-09-10 00:59:59.625816587 +0000 UTC m=+582.576218708" Sep 10 01:00:00.141204 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:00.141171 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816700-s5pbx"] Sep 10 01:00:00.144714 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:00.144695 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816700-s5pbx" Sep 10 01:00:00.147370 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:00.147348 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vh7h2\"" Sep 10 01:00:00.154280 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:00.154261 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816700-s5pbx" Sep 10 01:00:00.160092 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:00.160065 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816700-s5pbx"] Sep 10 01:00:00.431476 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:00.431446 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816700-s5pbx"] Sep 10 01:00:00.432967 ip-10-0-129-142 kubenswrapper[2567]: W0910 01:00:00.432941 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8220bdd_ff7e_4bf9_8b4e_9619ed3cffea.slice/crio-f2ecd7c226cdc43343f3c56b5a7c9cb5a307f679cc98adb73cdb7151b387fc3e WatchSource:0}: Error finding container f2ecd7c226cdc43343f3c56b5a7c9cb5a307f679cc98adb73cdb7151b387fc3e: Status 404 returned error can't find the container with id f2ecd7c226cdc43343f3c56b5a7c9cb5a307f679cc98adb73cdb7151b387fc3e Sep 10 01:00:00.615445 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:00.615409 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816700-s5pbx" event={"ID":"f8220bdd-ff7e-4bf9-8b4e-9619ed3cffea","Type":"ContainerStarted","Data":"f2ecd7c226cdc43343f3c56b5a7c9cb5a307f679cc98adb73cdb7151b387fc3e"} Sep 10 01:00:03.638309 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:03.638257 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816700-s5pbx" event={"ID":"f8220bdd-ff7e-4bf9-8b4e-9619ed3cffea","Type":"ContainerStarted","Data":"4be7d46f56d5e3e83833d8788dcaaf3a0ebf777d2d47b2fe3c57f9712923c674"} Sep 10 01:00:03.655222 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:03.655169 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816700-s5pbx" podStartSLOduration=0.794718684 podStartE2EDuration="3.65515416s" totalImagesPullingTime="2.860435476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 01:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 01:00:03.654033643 +0000 UTC m=+586.604435763" watchObservedRunningTime="2026-09-10 01:00:03.65515416 +0000 UTC m=+586.605556281" Sep 10 01:00:04.645550 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:04.645513 2567 generic.go:356] "Generic (PLEG): container finished" podID="f8220bdd-ff7e-4bf9-8b4e-9619ed3cffea" containerID="4be7d46f56d5e3e83833d8788dcaaf3a0ebf777d2d47b2fe3c57f9712923c674" exitCode=0 Sep 10 01:00:04.645550 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:04.645554 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816700-s5pbx" event={"ID":"f8220bdd-ff7e-4bf9-8b4e-9619ed3cffea","Type":"ContainerDied","Data":"4be7d46f56d5e3e83833d8788dcaaf3a0ebf777d2d47b2fe3c57f9712923c674"} Sep 10 01:00:05.782627 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:05.782595 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816700-s5pbx" Sep 10 01:00:06.657864 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:06.657833 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816700-s5pbx" Sep 10 01:00:06.658061 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:06.657866 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816700-s5pbx" event={"ID":"f8220bdd-ff7e-4bf9-8b4e-9619ed3cffea","Type":"ContainerDied","Data":"f2ecd7c226cdc43343f3c56b5a7c9cb5a307f679cc98adb73cdb7151b387fc3e"} Sep 10 01:00:06.658061 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:06.657907 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2ecd7c226cdc43343f3c56b5a7c9cb5a307f679cc98adb73cdb7151b387fc3e" Sep 10 01:00:08.010094 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:08.010050 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 01:00:08.010523 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:08.010125 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 01:00:08.023287 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:08.023260 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 01:00:08.679030 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:08.679005 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24" Sep 10 01:00:13.290297 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:13.290245 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-hdnzh"] Sep 10 01:00:17.846474 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:17.846443 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/ovn-acl-logging/0.log" Sep 10 01:00:17.848865 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:17.846443 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/ovn-acl-logging/0.log" Sep 10 01:00:17.991258 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:17.991228 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh"] Sep 10 01:00:17.991622 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:17.991605 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8220bdd-ff7e-4bf9-8b4e-9619ed3cffea" containerName="cleanup" Sep 10 01:00:17.991673 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:17.991626 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8220bdd-ff7e-4bf9-8b4e-9619ed3cffea" containerName="cleanup" Sep 10 01:00:17.991763 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:17.991752 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8220bdd-ff7e-4bf9-8b4e-9619ed3cffea" containerName="cleanup" Sep 10 01:00:17.994844 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:17.994820 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:17.997662 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:17.997642 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 10 01:00:18.003299 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.003274 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh"] Sep 10 01:00:18.089732 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.089691 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/140eb1c8-5815-4172-8771-4d280c821cd0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.089732 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.089729 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krkj5\" (UniqueName: \"kubernetes.io/projected/140eb1c8-5815-4172-8771-4d280c821cd0-kube-api-access-krkj5\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.089944 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.089823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/140eb1c8-5815-4172-8771-4d280c821cd0-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.089944 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.089848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/140eb1c8-5815-4172-8771-4d280c821cd0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.089944 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.089877 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/140eb1c8-5815-4172-8771-4d280c821cd0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.090043 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.089947 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/140eb1c8-5815-4172-8771-4d280c821cd0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.191212 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.191130 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/140eb1c8-5815-4172-8771-4d280c821cd0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.191212 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.191166 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krkj5\" (UniqueName: \"kubernetes.io/projected/140eb1c8-5815-4172-8771-4d280c821cd0-kube-api-access-krkj5\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.191438 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.191211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/140eb1c8-5815-4172-8771-4d280c821cd0-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.191438 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.191235 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/140eb1c8-5815-4172-8771-4d280c821cd0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.191438 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.191274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/140eb1c8-5815-4172-8771-4d280c821cd0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.191438 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.191315 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/140eb1c8-5815-4172-8771-4d280c821cd0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.191694 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.191669 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/140eb1c8-5815-4172-8771-4d280c821cd0-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.191757 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.191702 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/140eb1c8-5815-4172-8771-4d280c821cd0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.191806 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.191750 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/140eb1c8-5815-4172-8771-4d280c821cd0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.193664 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.193644 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/140eb1c8-5815-4172-8771-4d280c821cd0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.193993 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.193976 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/140eb1c8-5815-4172-8771-4d280c821cd0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.202690 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.202668 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krkj5\" (UniqueName: \"kubernetes.io/projected/140eb1c8-5815-4172-8771-4d280c821cd0-kube-api-access-krkj5\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5pznh\" (UID: \"140eb1c8-5815-4172-8771-4d280c821cd0\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.305688 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.305652 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:18.580059 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.580033 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh"] Sep 10 01:00:18.582021 ip-10-0-129-142 kubenswrapper[2567]: W0910 01:00:18.581993 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod140eb1c8_5815_4172_8771_4d280c821cd0.slice/crio-c9b81700cfa82258a8009a2cad385b0b0c4e7d6a1f301ef7ba72e338af5a018c WatchSource:0}: Error finding container c9b81700cfa82258a8009a2cad385b0b0c4e7d6a1f301ef7ba72e338af5a018c: Status 404 returned error can't find the container with id c9b81700cfa82258a8009a2cad385b0b0c4e7d6a1f301ef7ba72e338af5a018c Sep 10 01:00:18.718710 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:18.718677 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" event={"ID":"140eb1c8-5815-4172-8771-4d280c821cd0","Type":"ContainerStarted","Data":"c9b81700cfa82258a8009a2cad385b0b0c4e7d6a1f301ef7ba72e338af5a018c"} Sep 10 01:00:19.725234 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:19.725196 2567 generic.go:356] "Generic (PLEG): container finished" podID="140eb1c8-5815-4172-8771-4d280c821cd0" containerID="4f98d431d706d7eb870fbba7cb2bf4d83b85e9585b55995197676e60e46c8fe9" exitCode=0 Sep 10 01:00:19.725712 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:19.725290 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" event={"ID":"140eb1c8-5815-4172-8771-4d280c821cd0","Type":"ContainerDied","Data":"4f98d431d706d7eb870fbba7cb2bf4d83b85e9585b55995197676e60e46c8fe9"} Sep 10 01:00:19.725712 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:19.725573 2567 scope.go:117] "RemoveContainer" containerID="4f98d431d706d7eb870fbba7cb2bf4d83b85e9585b55995197676e60e46c8fe9" Sep 10 01:00:20.482985 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:20.482948 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-hdnzh"] Sep 10 01:00:20.733782 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:20.733701 2567 generic.go:356] "Generic (PLEG): container finished" podID="140eb1c8-5815-4172-8771-4d280c821cd0" containerID="183dcc1494215817505dfb7537f6fa2762c891d492e7753dad5258ad7ee05edf" exitCode=0 Sep 10 01:00:20.734170 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:20.733788 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" event={"ID":"140eb1c8-5815-4172-8771-4d280c821cd0","Type":"ContainerDied","Data":"183dcc1494215817505dfb7537f6fa2762c891d492e7753dad5258ad7ee05edf"} Sep 10 01:00:20.734170 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:20.733838 2567 scope.go:117] "RemoveContainer" containerID="4f98d431d706d7eb870fbba7cb2bf4d83b85e9585b55995197676e60e46c8fe9" Sep 10 01:00:20.734170 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:20.734124 2567 scope.go:117] "RemoveContainer" containerID="183dcc1494215817505dfb7537f6fa2762c891d492e7753dad5258ad7ee05edf" Sep 10 01:00:20.734371 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:00:20.734343 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:00:21.740766 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:21.740731 2567 scope.go:117] "RemoveContainer" containerID="183dcc1494215817505dfb7537f6fa2762c891d492e7753dad5258ad7ee05edf" Sep 10 01:00:21.741135 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:00:21.740900 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:00:28.306323 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:28.306277 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:28.306738 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:28.306337 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:28.306738 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:28.306347 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:28.306738 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:28.306356 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:28.306843 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:28.306784 2567 scope.go:117] "RemoveContainer" containerID="183dcc1494215817505dfb7537f6fa2762c891d492e7753dad5258ad7ee05edf" Sep 10 01:00:28.306989 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:00:28.306969 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:00:39.521936 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:39.521856 2567 scope.go:117] "RemoveContainer" containerID="183dcc1494215817505dfb7537f6fa2762c891d492e7753dad5258ad7ee05edf" Sep 10 01:00:39.522309 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:39.522223 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 01:00:39.842746 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:39.842714 2567 generic.go:356] "Generic (PLEG): container finished" podID="140eb1c8-5815-4172-8771-4d280c821cd0" containerID="70f7073f2c3ab08452efb1448033fc674aeb7eb5047cb785e4a4b65c80429819" exitCode=0 Sep 10 01:00:39.842931 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:39.842784 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" event={"ID":"140eb1c8-5815-4172-8771-4d280c821cd0","Type":"ContainerDied","Data":"70f7073f2c3ab08452efb1448033fc674aeb7eb5047cb785e4a4b65c80429819"} Sep 10 01:00:39.842931 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:39.842835 2567 scope.go:117] "RemoveContainer" containerID="183dcc1494215817505dfb7537f6fa2762c891d492e7753dad5258ad7ee05edf" Sep 10 01:00:39.843220 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:39.843204 2567 scope.go:117] "RemoveContainer" containerID="70f7073f2c3ab08452efb1448033fc674aeb7eb5047cb785e4a4b65c80429819" Sep 10 01:00:39.843463 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:00:39.843444 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:00:48.306777 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:48.306741 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:48.307184 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:48.306791 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:48.307184 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:48.306803 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:48.307184 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:48.306813 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:00:48.307184 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:00:48.307130 2567 scope.go:117] "RemoveContainer" containerID="70f7073f2c3ab08452efb1448033fc674aeb7eb5047cb785e4a4b65c80429819" Sep 10 01:00:48.307362 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:00:48.307289 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:01:03.521034 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:03.521002 2567 scope.go:117] "RemoveContainer" containerID="70f7073f2c3ab08452efb1448033fc674aeb7eb5047cb785e4a4b65c80429819" Sep 10 01:01:03.972015 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:03.971982 2567 generic.go:356] "Generic (PLEG): container finished" podID="140eb1c8-5815-4172-8771-4d280c821cd0" containerID="087c29281a53ee301b555d91ab43255fcb261bd68f7ecca08decc17284a81c25" exitCode=0 Sep 10 01:01:03.972177 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:03.972058 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" event={"ID":"140eb1c8-5815-4172-8771-4d280c821cd0","Type":"ContainerDied","Data":"087c29281a53ee301b555d91ab43255fcb261bd68f7ecca08decc17284a81c25"} Sep 10 01:01:03.972177 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:03.972109 2567 scope.go:117] "RemoveContainer" containerID="70f7073f2c3ab08452efb1448033fc674aeb7eb5047cb785e4a4b65c80429819" Sep 10 01:01:03.972539 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:03.972518 2567 scope.go:117] "RemoveContainer" containerID="087c29281a53ee301b555d91ab43255fcb261bd68f7ecca08decc17284a81c25" Sep 10 01:01:03.972733 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:01:03.972712 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:01:08.306583 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:08.306548 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:01:08.306992 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:08.306596 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:01:08.306992 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:08.306610 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:01:08.306992 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:08.306619 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:01:08.306992 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:08.306962 2567 scope.go:117] "RemoveContainer" containerID="087c29281a53ee301b555d91ab43255fcb261bd68f7ecca08decc17284a81c25" Sep 10 01:01:08.307146 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:01:08.307114 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:01:23.521144 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:23.521113 2567 scope.go:117] "RemoveContainer" containerID="087c29281a53ee301b555d91ab43255fcb261bd68f7ecca08decc17284a81c25" Sep 10 01:01:23.521559 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:01:23.521298 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:01:34.521372 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:34.521339 2567 scope.go:117] "RemoveContainer" containerID="087c29281a53ee301b555d91ab43255fcb261bd68f7ecca08decc17284a81c25" Sep 10 01:01:34.521856 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:01:34.521544 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:01:48.521595 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:48.521563 2567 scope.go:117] "RemoveContainer" containerID="087c29281a53ee301b555d91ab43255fcb261bd68f7ecca08decc17284a81c25" Sep 10 01:01:49.215069 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:49.215040 2567 generic.go:356] "Generic (PLEG): container finished" podID="140eb1c8-5815-4172-8771-4d280c821cd0" containerID="8d99adfead2cdd92e337e8a50cefda7783a9525997d95cd2b191dd99cf093d2f" exitCode=0 Sep 10 01:01:49.215236 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:49.215113 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" event={"ID":"140eb1c8-5815-4172-8771-4d280c821cd0","Type":"ContainerDied","Data":"8d99adfead2cdd92e337e8a50cefda7783a9525997d95cd2b191dd99cf093d2f"} Sep 10 01:01:49.215236 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:49.215168 2567 scope.go:117] "RemoveContainer" containerID="087c29281a53ee301b555d91ab43255fcb261bd68f7ecca08decc17284a81c25" Sep 10 01:01:49.215506 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:49.215488 2567 scope.go:117] "RemoveContainer" containerID="8d99adfead2cdd92e337e8a50cefda7783a9525997d95cd2b191dd99cf093d2f" Sep 10 01:01:49.215718 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:01:49.215702 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:01:58.305830 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:58.305786 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:01:58.306377 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:58.305850 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:01:58.306377 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:58.305866 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:01:58.306377 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:58.305876 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:01:58.306377 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:01:58.306312 2567 scope.go:117] "RemoveContainer" containerID="8d99adfead2cdd92e337e8a50cefda7783a9525997d95cd2b191dd99cf093d2f" Sep 10 01:01:58.306642 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:01:58.306567 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:02:13.522571 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:02:13.522464 2567 scope.go:117] "RemoveContainer" containerID="8d99adfead2cdd92e337e8a50cefda7783a9525997d95cd2b191dd99cf093d2f" Sep 10 01:02:13.523109 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:02:13.522968 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:02:25.521500 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:02:25.521460 2567 scope.go:117] "RemoveContainer" containerID="8d99adfead2cdd92e337e8a50cefda7783a9525997d95cd2b191dd99cf093d2f" Sep 10 01:02:25.521962 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:02:25.521672 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:02:37.525110 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:02:37.525081 2567 scope.go:117] "RemoveContainer" containerID="8d99adfead2cdd92e337e8a50cefda7783a9525997d95cd2b191dd99cf093d2f" Sep 10 01:02:37.525610 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:02:37.525237 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:02:48.522176 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:02:48.522142 2567 scope.go:117] "RemoveContainer" containerID="8d99adfead2cdd92e337e8a50cefda7783a9525997d95cd2b191dd99cf093d2f" Sep 10 01:02:48.522657 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:02:48.522301 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:03:00.521703 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:03:00.521670 2567 scope.go:117] "RemoveContainer" containerID="8d99adfead2cdd92e337e8a50cefda7783a9525997d95cd2b191dd99cf093d2f" Sep 10 01:03:00.522063 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:03:00.521856 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:03:14.521889 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:03:14.521858 2567 scope.go:117] "RemoveContainer" containerID="8d99adfead2cdd92e337e8a50cefda7783a9525997d95cd2b191dd99cf093d2f" Sep 10 01:03:15.678545 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:03:15.678506 2567 generic.go:356] "Generic (PLEG): container finished" podID="140eb1c8-5815-4172-8771-4d280c821cd0" containerID="f6c7e13270c79700d09707292db3fd34b23b48bb1a73522eb43abd01ff86b08b" exitCode=0 Sep 10 01:03:15.678931 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:03:15.678586 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" event={"ID":"140eb1c8-5815-4172-8771-4d280c821cd0","Type":"ContainerDied","Data":"f6c7e13270c79700d09707292db3fd34b23b48bb1a73522eb43abd01ff86b08b"} Sep 10 01:03:15.678931 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:03:15.678638 2567 scope.go:117] "RemoveContainer" containerID="8d99adfead2cdd92e337e8a50cefda7783a9525997d95cd2b191dd99cf093d2f" Sep 10 01:03:15.679021 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:03:15.678972 2567 scope.go:117] "RemoveContainer" containerID="f6c7e13270c79700d09707292db3fd34b23b48bb1a73522eb43abd01ff86b08b" Sep 10 01:03:15.679201 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:03:15.679178 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:03:18.306129 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:03:18.306082 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:03:18.306664 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:03:18.306146 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:03:18.306664 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:03:18.306165 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:03:18.306664 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:03:18.306175 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" Sep 10 01:03:18.306664 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:03:18.306635 2567 scope.go:117] "RemoveContainer" containerID="f6c7e13270c79700d09707292db3fd34b23b48bb1a73522eb43abd01ff86b08b" Sep 10 01:03:18.306874 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:03:18.306834 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:03:31.521306 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:03:31.521253 2567 scope.go:117] "RemoveContainer" containerID="f6c7e13270c79700d09707292db3fd34b23b48bb1a73522eb43abd01ff86b08b" Sep 10 01:03:31.521841 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:03:31.521505 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:03:46.521598 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:03:46.521518 2567 scope.go:117] "RemoveContainer" containerID="f6c7e13270c79700d09707292db3fd34b23b48bb1a73522eb43abd01ff86b08b" Sep 10 01:03:46.522051 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:03:46.521688 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:04:00.521651 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:00.521603 2567 scope.go:117] "RemoveContainer" containerID="f6c7e13270c79700d09707292db3fd34b23b48bb1a73522eb43abd01ff86b08b" Sep 10 01:04:00.522215 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:04:00.521876 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:04:13.521328 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:13.521288 2567 scope.go:117] "RemoveContainer" containerID="f6c7e13270c79700d09707292db3fd34b23b48bb1a73522eb43abd01ff86b08b" Sep 10 01:04:13.521909 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:04:13.521538 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:04:24.521188 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:24.521156 2567 scope.go:117] "RemoveContainer" containerID="f6c7e13270c79700d09707292db3fd34b23b48bb1a73522eb43abd01ff86b08b" Sep 10 01:04:24.521599 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:04:24.521353 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:04:26.292346 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:26.292314 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7ff579cd75-vnfk2_3bd8fe49-221a-405d-a4d2-61cb9e9a052d/authorino/0.log" Sep 10 01:04:32.546789 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:32.546760 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dc88f9465-n9pf7_dcdce3fe-3802-410e-af19-0e5bb3e9165c/copy-manifests/0.log" Sep 10 01:04:32.553308 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:32.553284 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dc88f9465-n9pf7_dcdce3fe-3802-410e-af19-0e5bb3e9165c/manager/0.log" Sep 10 01:04:33.016043 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:33.016013 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816700-s5pbx_f8220bdd-ff7e-4bf9-8b4e-9619ed3cffea/cleanup/0.log" Sep 10 01:04:33.921572 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:33.921536 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7ff579cd75-vnfk2_3bd8fe49-221a-405d-a4d2-61cb9e9a052d/authorino/0.log" Sep 10 01:04:34.250169 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:34.250088 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-8mllv_632545ba-dc59-4fc4-9fc1-825de11da97d/kuadrant-console-plugin/0.log" Sep 10 01:04:34.483633 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:34.483602 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-hdnzh_fc123716-755d-4870-8313-7816e887f63d/limitador/0.log" Sep 10 01:04:35.296049 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:35.296023 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-569dfc5d57-xz76z_2b466a55-2834-4729-8f60-e772b926c0e9/kube-auth-proxy/0.log" Sep 10 01:04:35.741035 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:35.741002 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-587b6fb4b6-v9vlg_5bc421f3-3586-4513-9aaf-9c354af84cf6/router/0.log" Sep 10 01:04:36.521829 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:36.521801 2567 scope.go:117] "RemoveContainer" containerID="f6c7e13270c79700d09707292db3fd34b23b48bb1a73522eb43abd01ff86b08b" Sep 10 01:04:36.522208 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:04:36.521976 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:04:36.527694 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:36.527668 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw6l24_234e2f50-4176-47b7-9f04-b20b5b9b3261/main/0.log" Sep 10 01:04:36.748753 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:36.748727 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_140eb1c8-5815-4172-8771-4d280c821cd0/main/5.log" Sep 10 01:04:41.882072 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:41.882037 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sb69v/must-gather-sx6md"] Sep 10 01:04:41.885570 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:41.885553 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sb69v/must-gather-sx6md" Sep 10 01:04:41.888515 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:41.888494 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sb69v\"/\"kube-root-ca.crt\"" Sep 10 01:04:41.889884 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:41.889864 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sb69v\"/\"default-dockercfg-9hx98\"" Sep 10 01:04:41.889997 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:41.889887 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sb69v\"/\"openshift-service-ca.crt\"" Sep 10 01:04:41.893540 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:41.893520 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sb69v/must-gather-sx6md"] Sep 10 01:04:41.952671 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:41.952631 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/11f58669-a681-4d66-aebd-d8c6029d7617-must-gather-output\") pod \"must-gather-sx6md\" (UID: \"11f58669-a681-4d66-aebd-d8c6029d7617\") " pod="openshift-must-gather-sb69v/must-gather-sx6md" Sep 10 01:04:41.952853 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:41.952684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7g5s\" (UniqueName: \"kubernetes.io/projected/11f58669-a681-4d66-aebd-d8c6029d7617-kube-api-access-l7g5s\") pod \"must-gather-sx6md\" (UID: \"11f58669-a681-4d66-aebd-d8c6029d7617\") " pod="openshift-must-gather-sb69v/must-gather-sx6md" Sep 10 01:04:42.053307 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:42.053274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/11f58669-a681-4d66-aebd-d8c6029d7617-must-gather-output\") pod \"must-gather-sx6md\" (UID: \"11f58669-a681-4d66-aebd-d8c6029d7617\") " pod="openshift-must-gather-sb69v/must-gather-sx6md" Sep 10 01:04:42.053489 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:42.053343 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7g5s\" (UniqueName: \"kubernetes.io/projected/11f58669-a681-4d66-aebd-d8c6029d7617-kube-api-access-l7g5s\") pod \"must-gather-sx6md\" (UID: \"11f58669-a681-4d66-aebd-d8c6029d7617\") " pod="openshift-must-gather-sb69v/must-gather-sx6md" Sep 10 01:04:42.053653 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:42.053634 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/11f58669-a681-4d66-aebd-d8c6029d7617-must-gather-output\") pod \"must-gather-sx6md\" (UID: \"11f58669-a681-4d66-aebd-d8c6029d7617\") " pod="openshift-must-gather-sb69v/must-gather-sx6md" Sep 10 01:04:42.061676 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:42.061655 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7g5s\" (UniqueName: \"kubernetes.io/projected/11f58669-a681-4d66-aebd-d8c6029d7617-kube-api-access-l7g5s\") pod \"must-gather-sx6md\" (UID: \"11f58669-a681-4d66-aebd-d8c6029d7617\") " pod="openshift-must-gather-sb69v/must-gather-sx6md" Sep 10 01:04:42.195777 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:42.195683 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sb69v/must-gather-sx6md" Sep 10 01:04:42.468023 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:42.467996 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sb69v/must-gather-sx6md"] Sep 10 01:04:42.469583 ip-10-0-129-142 kubenswrapper[2567]: W0910 01:04:42.469558 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11f58669_a681_4d66_aebd_d8c6029d7617.slice/crio-02984da4ae2b16838e031630b9db4f72d316e4c94c0988ed1325e601e13d0c68 WatchSource:0}: Error finding container 02984da4ae2b16838e031630b9db4f72d316e4c94c0988ed1325e601e13d0c68: Status 404 returned error can't find the container with id 02984da4ae2b16838e031630b9db4f72d316e4c94c0988ed1325e601e13d0c68 Sep 10 01:04:43.144539 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:43.144504 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sb69v/must-gather-sx6md" event={"ID":"11f58669-a681-4d66-aebd-d8c6029d7617","Type":"ContainerStarted","Data":"02984da4ae2b16838e031630b9db4f72d316e4c94c0988ed1325e601e13d0c68"} Sep 10 01:04:44.159337 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:44.159300 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sb69v/must-gather-sx6md" event={"ID":"11f58669-a681-4d66-aebd-d8c6029d7617","Type":"ContainerStarted","Data":"9e3aa97feb716806097da97de05ab5db604f7e97b6d4a09f014a208252488b87"} Sep 10 01:04:45.167339 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:45.167296 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sb69v/must-gather-sx6md" event={"ID":"11f58669-a681-4d66-aebd-d8c6029d7617","Type":"ContainerStarted","Data":"39b0dca04a8b1bbc99ab2d05242c8dfcc9d4b64d5c52fe14de9b287bd41b3db3"} Sep 10 01:04:45.183961 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:45.183906 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sb69v/must-gather-sx6md" podStartSLOduration=2.695922984 podStartE2EDuration="4.183890764s" totalImagesPullingTime="1.48796778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 01:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 01:04:45.183586002 +0000 UTC m=+868.133988172" watchObservedRunningTime="2026-09-10 01:04:45.183890764 +0000 UTC m=+868.134292885" Sep 10 01:04:45.486197 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:45.486116 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j8t49_0b60eed6-1260-4550-b2ff-b2c56076c290/global-pull-secret-syncer/0.log" Sep 10 01:04:45.662612 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:45.662569 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r4r6n_b5992aa1-3bf0-435c-b9e0-a9fb16d6c16d/konnectivity-agent/0.log" Sep 10 01:04:45.684932 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:45.684896 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-142.ec2.internal_2a9995c1c97ee8b5062e519ab75540ba/haproxy/0.log" Sep 10 01:04:48.522048 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:48.522006 2567 scope.go:117] "RemoveContainer" containerID="f6c7e13270c79700d09707292db3fd34b23b48bb1a73522eb43abd01ff86b08b" Sep 10 01:04:48.522656 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:04:48.522230 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:04:50.601502 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:50.601460 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7ff579cd75-vnfk2_3bd8fe49-221a-405d-a4d2-61cb9e9a052d/authorino/0.log" Sep 10 01:04:50.693272 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:50.693232 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-8mllv_632545ba-dc59-4fc4-9fc1-825de11da97d/kuadrant-console-plugin/0.log" Sep 10 01:04:50.762066 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:50.762034 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-hdnzh_fc123716-755d-4870-8313-7816e887f63d/limitador/0.log" Sep 10 01:04:52.318758 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:52.318676 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40eb8857-3ced-41d3-a664-3984e23c9008/alertmanager/0.log" Sep 10 01:04:52.343750 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:52.343683 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40eb8857-3ced-41d3-a664-3984e23c9008/config-reloader/0.log" Sep 10 01:04:52.369238 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:52.369206 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40eb8857-3ced-41d3-a664-3984e23c9008/kube-rbac-proxy-web/0.log" Sep 10 01:04:52.392619 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:52.392596 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40eb8857-3ced-41d3-a664-3984e23c9008/kube-rbac-proxy/0.log" Sep 10 01:04:52.418149 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:52.418101 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40eb8857-3ced-41d3-a664-3984e23c9008/kube-rbac-proxy-metric/0.log" Sep 10 01:04:52.439022 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:52.438997 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40eb8857-3ced-41d3-a664-3984e23c9008/prom-label-proxy/0.log" Sep 10 01:04:52.464487 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:52.464457 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40eb8857-3ced-41d3-a664-3984e23c9008/init-config-reloader/0.log" Sep 10 01:04:52.594927 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:52.594863 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f44cdff77-qkch5_6dff4ff7-87f4-4892-b811-162f7f256099/metrics-server/0.log" Sep 10 01:04:52.745240 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:52.745209 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fglkf_62e96854-4728-4df8-a48d-a03bfcfc1b97/node-exporter/0.log" Sep 10 01:04:52.774155 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:52.774110 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fglkf_62e96854-4728-4df8-a48d-a03bfcfc1b97/kube-rbac-proxy/0.log" Sep 10 01:04:52.801309 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:52.801283 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fglkf_62e96854-4728-4df8-a48d-a03bfcfc1b97/init-textfile/0.log" Sep 10 01:04:53.278537 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:53.278494 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-89dcd698f-2jckf_3c41fc6a-5899-4abd-9fa1-6acc62ec95d1/telemeter-client/0.log" Sep 10 01:04:53.304605 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:53.304579 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-89dcd698f-2jckf_3c41fc6a-5899-4abd-9fa1-6acc62ec95d1/reload/0.log" Sep 10 01:04:53.329542 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:53.329509 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-89dcd698f-2jckf_3c41fc6a-5899-4abd-9fa1-6acc62ec95d1/kube-rbac-proxy/0.log" Sep 10 01:04:53.364500 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:53.364472 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d6cf59c49-bf5rn_411eaa81-989a-4693-8805-98451096721b/thanos-query/0.log" Sep 10 01:04:53.391147 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:53.391115 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d6cf59c49-bf5rn_411eaa81-989a-4693-8805-98451096721b/kube-rbac-proxy-web/0.log" Sep 10 01:04:53.418581 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:53.418551 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d6cf59c49-bf5rn_411eaa81-989a-4693-8805-98451096721b/kube-rbac-proxy/0.log" Sep 10 01:04:53.454196 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:53.454169 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d6cf59c49-bf5rn_411eaa81-989a-4693-8805-98451096721b/prom-label-proxy/0.log" Sep 10 01:04:53.477662 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:53.477634 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d6cf59c49-bf5rn_411eaa81-989a-4693-8805-98451096721b/kube-rbac-proxy-rules/0.log" Sep 10 01:04:53.499724 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:53.499690 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d6cf59c49-bf5rn_411eaa81-989a-4693-8805-98451096721b/kube-rbac-proxy-metrics/0.log" Sep 10 01:04:55.944912 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:55.944883 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-wqn5x_58f9776d-a47a-428e-9e08-4a80ff705aed/download-server/0.log" Sep 10 01:04:55.980859 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:55.980822 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n"] Sep 10 01:04:55.989366 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:55.989338 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:55.995894 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:55.995864 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n"] Sep 10 01:04:56.106122 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.106072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm5rk\" (UniqueName: \"kubernetes.io/projected/1a21494c-bb5b-4361-8fc5-27302a92fc06-kube-api-access-cm5rk\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.106325 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.106166 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a21494c-bb5b-4361-8fc5-27302a92fc06-podres\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.106325 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.106197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a21494c-bb5b-4361-8fc5-27302a92fc06-proc\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.106325 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.106243 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a21494c-bb5b-4361-8fc5-27302a92fc06-lib-modules\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.106325 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.106276 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a21494c-bb5b-4361-8fc5-27302a92fc06-sys\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.207908 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.207829 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a21494c-bb5b-4361-8fc5-27302a92fc06-proc\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.207908 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.207894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a21494c-bb5b-4361-8fc5-27302a92fc06-lib-modules\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.208114 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.207928 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a21494c-bb5b-4361-8fc5-27302a92fc06-sys\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.208114 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.207977 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a21494c-bb5b-4361-8fc5-27302a92fc06-proc\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.208114 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.208014 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm5rk\" (UniqueName: \"kubernetes.io/projected/1a21494c-bb5b-4361-8fc5-27302a92fc06-kube-api-access-cm5rk\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.208114 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.208068 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a21494c-bb5b-4361-8fc5-27302a92fc06-sys\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.208114 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.208070 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a21494c-bb5b-4361-8fc5-27302a92fc06-podres\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.208114 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.208097 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a21494c-bb5b-4361-8fc5-27302a92fc06-lib-modules\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.208355 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.208166 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a21494c-bb5b-4361-8fc5-27302a92fc06-podres\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.216953 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.216924 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm5rk\" (UniqueName: \"kubernetes.io/projected/1a21494c-bb5b-4361-8fc5-27302a92fc06-kube-api-access-cm5rk\") pod \"perf-node-gather-daemonset-pgq7n\" (UID: \"1a21494c-bb5b-4361-8fc5-27302a92fc06\") " pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.312536 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.312504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:56.604859 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.604824 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n"] Sep 10 01:04:56.667314 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:56.667287 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-k6lf2_850b4cbf-8df1-46fa-bc90-ef1b2b2aa3c6/volume-data-source-validator/0.log" Sep 10 01:04:57.269771 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:57.269730 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" event={"ID":"1a21494c-bb5b-4361-8fc5-27302a92fc06","Type":"ContainerStarted","Data":"fffb3482850907eade7e1cc526defcd11c9debee46dd7db46df73157b4fe1189"} Sep 10 01:04:57.270286 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:57.269797 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" event={"ID":"1a21494c-bb5b-4361-8fc5-27302a92fc06","Type":"ContainerStarted","Data":"612f28c8ed17a2eff3c5c1452423a03e09c7b4602253ca07bdf9a83006b9b71b"} Sep 10 01:04:57.270620 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:57.270596 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:04:57.287925 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:57.287866 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" podStartSLOduration=2.287845149 podStartE2EDuration="2.287845149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 01:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 01:04:57.28579953 +0000 UTC m=+880.236201652" watchObservedRunningTime="2026-09-10 01:04:57.287845149 +0000 UTC m=+880.238247271" Sep 10 01:04:57.830327 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:57.830298 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqcjp_c19780d9-7056-4298-a7d7-972ee1a17408/dns/0.log" Sep 10 01:04:57.851985 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:57.851958 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqcjp_c19780d9-7056-4298-a7d7-972ee1a17408/kube-rbac-proxy/0.log" Sep 10 01:04:57.874266 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:57.874240 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bjdbl_d1152275-6e69-42b2-822d-45e0ecc53df8/dns-node-resolver/0.log" Sep 10 01:04:58.443643 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:58.443614 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-84cc88496f-wks9z_37c55d8d-4b21-4a1d-998e-bfcf5b40c6e7/registry/0.log" Sep 10 01:04:58.462957 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:58.462915 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pwbgq_e00484bd-e5bd-440b-90c9-e7644bba6602/node-ca/0.log" Sep 10 01:04:59.469204 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:59.469164 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-569dfc5d57-xz76z_2b466a55-2834-4729-8f60-e772b926c0e9/kube-auth-proxy/0.log" Sep 10 01:04:59.595438 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:04:59.595412 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-587b6fb4b6-v9vlg_5bc421f3-3586-4513-9aaf-9c354af84cf6/router/0.log" Sep 10 01:05:00.172714 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:00.172683 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dmrkj_c11ce5f8-8d74-4158-9702-24fba4e2b2e4/serve-healthcheck-canary/0.log" Sep 10 01:05:00.522132 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:00.522050 2567 scope.go:117] "RemoveContainer" containerID="f6c7e13270c79700d09707292db3fd34b23b48bb1a73522eb43abd01ff86b08b" Sep 10 01:05:00.522906 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:05:00.522877 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:05:00.849412 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:00.849368 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wzwq6_cc8552a4-95dc-440b-9551-0531b59ebdec/kube-rbac-proxy/0.log" Sep 10 01:05:00.869329 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:00.869305 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wzwq6_cc8552a4-95dc-440b-9551-0531b59ebdec/exporter/0.log" Sep 10 01:05:00.890761 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:00.890736 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wzwq6_cc8552a4-95dc-440b-9551-0531b59ebdec/extractor/0.log" Sep 10 01:05:03.234747 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:03.234721 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dc88f9465-n9pf7_dcdce3fe-3802-410e-af19-0e5bb3e9165c/manager/0.log" Sep 10 01:05:03.256253 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:03.256228 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dc88f9465-n9pf7_dcdce3fe-3802-410e-af19-0e5bb3e9165c/copy-manifests/0.log" Sep 10 01:05:04.296711 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:04.296685 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sb69v/perf-node-gather-daemonset-pgq7n" Sep 10 01:05:04.345424 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:04.345379 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56bf56cd54-8lh68_5d4dfe06-d845-4f0f-aac5-9c28d9991ee2/manager/0.log" Sep 10 01:05:06.141553 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:06.141528 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-569dfc5d57-xz76z_2b466a55-2834-4729-8f60-e772b926c0e9/kube-auth-proxy/0.log" Sep 10 01:05:06.206645 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:06.206618 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-587b6fb4b6-v9vlg_5bc421f3-3586-4513-9aaf-9c354af84cf6/router/0.log" Sep 10 01:05:07.533289 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:07.533227 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-569dfc5d57-xz76z_2b466a55-2834-4729-8f60-e772b926c0e9/kube-auth-proxy/0.log" Sep 10 01:05:07.604511 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:07.604483 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-587b6fb4b6-v9vlg_5bc421f3-3586-4513-9aaf-9c354af84cf6/router/0.log" Sep 10 01:05:09.993749 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:09.993711 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-c6qn2_1fc14129-390a-444d-a5d4-2006d4eaaf82/kube-storage-version-migrator-operator/1.log" Sep 10 01:05:09.994716 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:09.994695 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-c6qn2_1fc14129-390a-444d-a5d4-2006d4eaaf82/kube-storage-version-migrator-operator/0.log" Sep 10 01:05:11.140464 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:11.140434 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wl9j4_a9c8c435-a9c3-48e8-86a9-0671d814c4fa/kube-multus-additional-cni-plugins/0.log" Sep 10 01:05:11.163320 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:11.163295 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wl9j4_a9c8c435-a9c3-48e8-86a9-0671d814c4fa/egress-router-binary-copy/0.log" Sep 10 01:05:11.184575 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:11.184548 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wl9j4_a9c8c435-a9c3-48e8-86a9-0671d814c4fa/cni-plugins/0.log" Sep 10 01:05:11.204721 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:11.204701 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wl9j4_a9c8c435-a9c3-48e8-86a9-0671d814c4fa/bond-cni-plugin/0.log" Sep 10 01:05:11.226062 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:11.226040 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wl9j4_a9c8c435-a9c3-48e8-86a9-0671d814c4fa/routeoverride-cni/0.log" Sep 10 01:05:11.257141 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:11.257116 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wl9j4_a9c8c435-a9c3-48e8-86a9-0671d814c4fa/whereabouts-cni-bincopy/0.log" Sep 10 01:05:11.280011 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:11.279973 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wl9j4_a9c8c435-a9c3-48e8-86a9-0671d814c4fa/whereabouts-cni/0.log" Sep 10 01:05:11.479973 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:11.479879 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gm7fp_e8fc08e6-f72d-4bdb-bd82-f94d878a07c8/kube-multus/0.log" Sep 10 01:05:11.521351 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:11.521317 2567 scope.go:117] "RemoveContainer" containerID="f6c7e13270c79700d09707292db3fd34b23b48bb1a73522eb43abd01ff86b08b" Sep 10 01:05:11.521563 ip-10-0-129-142 kubenswrapper[2567]: E0910 01:05:11.521522 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5pznh_llm(140eb1c8-5815-4172-8771-4d280c821cd0)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5pznh" podUID="140eb1c8-5815-4172-8771-4d280c821cd0" Sep 10 01:05:11.580917 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:11.580810 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bf2vw_94aee17f-23d4-41f3-8b56-2d42b7c23fb0/network-metrics-daemon/0.log" Sep 10 01:05:11.598757 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:11.598731 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bf2vw_94aee17f-23d4-41f3-8b56-2d42b7c23fb0/kube-rbac-proxy/0.log" Sep 10 01:05:12.818278 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:12.818239 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/ovn-controller/0.log" Sep 10 01:05:12.834083 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:12.834054 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/ovn-acl-logging/0.log" Sep 10 01:05:12.834083 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:12.834069 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/ovn-acl-logging/1.log" Sep 10 01:05:12.853772 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:12.853731 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/kube-rbac-proxy-node/0.log" Sep 10 01:05:12.874807 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:12.874775 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 01:05:12.895667 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:12.895644 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/northd/0.log" Sep 10 01:05:12.916942 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:12.916917 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/nbdb/0.log" Sep 10 01:05:12.938200 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:12.938165 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/sbdb/0.log" Sep 10 01:05:12.980960 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:12.980926 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lh25b_c6eca841-6472-4081-99af-183ba91640ec/ovnkube-controller/0.log" Sep 10 01:05:14.051584 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:14.051552 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-2v4lf_438648da-d082-49d7-adf6-09a52abf1f97/check-endpoints/0.log" Sep 10 01:05:14.099083 ip-10-0-129-142 kubenswrapper[2567]: I0910 01:05:14.099056 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-mvqfv_b68cbf13-c4cc-463e-b9bb-f184673d2bff/network-check-target-container/0.log"